3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds

50 %
50 %
Information about 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds

Published on January 17, 2016

Author: zhopasushami

Source: slideshare.net

1. ザニケエフ マラット maratishe@gmail.com maratishe.github.io 2016/01/14 @PRO研@博多 3-Way Scripts PDF: bit.do/160114 as a Practical Platform for Secure Distributed Code in Clouds

2. . Things You Might've Noticed • most coding today is done in scripting languages -- php, python, ruby, .... • DiY deploy is becoming more common than platforms -- Docker deploy via filesystem diffs • smartphone-centric coding is already a reality and reaches further into IoT, IoV, etc. • .... a demo? M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 2/24 ... 2/24

3. . 3-Way Scripts function callme (…) … Class NAME Other code, Manager CLI mode $a = new NAME() $a ->callme (); HTTP mode $a = new NAME() echo toJSON ( $a ->callme ()); OperatorRemote code Use in Object mode 01 M.Zhanikeev "Github Public Repository for the 3-Way Scripting Project" https://github.com/maratishe/3wayscripting (current) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 3/24 ... 3/24

4. . The Need (also for Speed) • 2 ways wanted 06 .. 詳細 : high-thru local vs low-thru remote calls to A A B C Many Many HTTP REQ HTTP REP (small data) new, call CLI High volume Big Data Manager 06 M.Zhanikeev "Streaming Algorithms for Big Data Processing on Multicore" CRC (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 4/24 ... 4/24

5. . Objectives 1. heterogeneity ◦ in clouds known as federated and fog clouds 03 ◦ in coding, ambient 18 and p2p networking between instances/agents 15 ◦ ultimately VNE .. 詳細 for distributed software agents 2. volatility ◦ again, fog clouds 03 ambient programming 18 ◦ hierarchical structures -- like Fractal 14 3. autonomy ◦ not much in programming but more actively discussed in clouds, network management, etc. 09 ◦ distant goal is Truly Autonomous .. 詳細 03 M.Zhanikeev "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015) 18 J.Dedecker+4 "Ambient-Oriented Programming in AmbientTalk" 20th ECOOP (2006) 15 M.Albano+2 "Hierarchical P2P Overlays for DVE: An Additively Weighted Voronoi Based Approach" ICUMT (2009) 14 F.Baude+2 "From Distributed Objects to Hierarchical Grid Components" CoopIS, DOA, and ODBASE, Springer LNCS (2003) 09 M.Zhanikeev "Population Management in Clouds is a Do-It-Yourself Technology" IETF94/NMRG (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 5/24 ... 5/24

6. . Theory of Distributed Computing A Platform Platform Bc C Run A. CORBA model A B B. Current (traditional) Model Platform C. Distributed Code (proposed) A Platform Platform B C Run 3-way code Distribution borders (network, etc.) Code (objects, scripts) Data, messages Runtime Invocation routes XYZ • CORBA used to stringify and send objects • modern platforms mostly send data • 3-way code is unique ◦ platformless ◦ autonomous ◦ volatility OK = adaptible ◦ ... M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 6/24 ... 6/24

7. . Class/Function Call-by-Variable • most scripting languages (PHP) allow for some nifty referencing techniques • key to using the same code in 3+ ways $a = new NAME(); $b = ‘callme’; $a->$b( $param, $defaultparam = 10); M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 7/24 ... 7/24

8. . Security Features M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 8/24 ... 8/24

9. . Basic Security for Web API AB Many Many REQ( md5p , …) Make secure Operator, Manager mp5p mp5 (file) Attacker Manager M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 9/24 ... 9/24

10. . More Specific on MD5 Keys BA Each Each REQ( key , …) keyfile Operator/ automation (once)c web.php make() verify same dir. Attacker Manager (key exchange) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 10/24 ... 10/24

11. . web.php key management • the ultimate objective is : it has to be humanly simple • see source code at 01 • key made by make() is mapped to tag, then to place • load() is internal, used for de-mapping from place/tag make( $libdir,$stuff,$length=10){ // returns $key tag( $key,$tag,$cldir=‘.’){ // outgoing place( $name,$iport,$tag,$cldir=‘.’){ // outgoing private load( $place,$tag,$cldir=‘.’){ // outgoing 01 M.Zhanikeev "Github Public Repository for the 3-Way Scripting Project" https://github.com/maratishe/3wayscripting (current) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 11/24 ... 11/24

12. . Cloud Distribution/Deploy M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 12/24 ... 12/24

13. . (1) 3-Way Scripts on Docker • Docker is mostly best for autonomy and isolation of execution environment • requireme.php has all the dependencies that I use for my PHP scripting -- no need for any other files • ... but need at least PHP 5.6 -- it has built-in web server • the magic: pack example.php, my3wayscript.php, web.php, requireme.php into allinone.tbz for deploy M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 13/24 ... 13/24

14. . (1) Deploy via Dockerfile • based on official PHP 5.6 • adds some utilities • downloads and unpacks allinone.tbz • prepare: download github.com/ maratishe/3wayscripting, unzip, cd • build: docker build -t my3way . • run: docker run -ti -p 8001:8001 --rm my3way php example.php test M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 14/24 ... 14/24

15. . (2) Application: SimpleCV (vision lib) API • example of applying 3-way scripts to vision and the related AI • SimpleCV is better/simpler than the traditional OpenCV or other tools • we can pack it together with a 3-way API • the guys from sightmachine already created Docker container, but we can make it even better M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 15/24 ... 15/24

16. . (2) Deploy via Dockerfile • has no PHP, so need to add it • prepare: download github.com/ maratishe/simplecvapi, unzip, cd • build: docker build -t cvapi . • run: docker run -ti -p 8001:8001--rm cvapi python test.py M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 16/24 ... 16/24

17. . Wrapup : Feature Comparison • note the learning curve -- very important for modern programming and edge boxes .. 詳細 • destined for wireless fog boxes which need platformless agents .. 詳細 • SimpleCV API is a natural application of the 3-way scripting method -- but not limited by this particular usecase (Web) Sockets RESTful calls Hierarchical structure Heterogeneous environments Learning curve (simplicity) Needs a platform? Traffic encoding optional? Traditional (Corba, ESB, MPI,…) YES NO NO NO NO YES NO Advanced/modern (SOC, Ibis, …) YES YES YES YES NO YES NO Distributed code (proposed) YES YES YES YES YES NO YES M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 17/24 ... 17/24

18. . That’s all, thank you ... M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 18/24 ... 18/24

19. . Application: Hadoop Interface . Hadoop Agent .. . ... is software that runs locally as an agent of the remote client Storage Node (shard) Time-Aware Sub-Store(s) Manager Client Machine Client Your Sketcher You Start Use Schedule Multicore Replay Replay Node many • Hadoop interface is very intensive, cannot be done remotely • there are also alternatives to Hadoop 06 • one of applications for 3-way scripts .. 戻る 06 M.Zhanikeev "Streaming Algorithms for Big Data Processing on Multicore" CRC (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 19/24 ... 19/24

20. . VNE: Virtual Network Embedding . VNE .. . ... is the best way to formulate optimization of multiple overlayed virtual (service) networks Physical layer Virtual Layer1 VN Request 2 Make VN 3 VN Reply 4 Virtual Virtual Physical • still active area of research, good heuristics wanted 07 • best for service networks in clouds .. 戻る 07 M.Zhanikeev "A New VNE Method for More Responsive Networking in Many-to-Many Groups" 7th ICUFN (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 20/24 ... 20/24

21. . Truly Autonomous Agents . True Autonomy .. . ... is alternative to VNE in that optimization is done autonomously at service side Network Provider s (NOC) Agent Service Traditional agents True Autonomy • part of current standards discussion on future network management 09 • traditional: NOC + agents but NOC is interface = bottleneck • true autonomy: agents are open for direct coordination with remove services .. 戻る 09 09 M.Zhanikeev "Population Management in Clouds is a Do-It-Yourself Technology" IETF94/NMRG (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 21/24 ... 21/24

22. . Wireless Network Edge . Reachable Devices .. . ... are boxes that talk to your smartphone using P2P WiFi (WiFi Direct is best today) AP User Internet User Internet WiFi Congestion User Internet 3G Smartphone Device Device Device AP Design WLAN Design Reachable Devices Design AP DeviceWiFi User Internet AP Design (2) Congestion WiFi P2P WiFi Cannot use at the same time Reachable Platform • modern boxes are mostly based on the AP Design -- connectivity problem • even if conenctivity problem is resolved, you have congestion problem • with Reachable Technology, smartphone is the realtime mid-way interface between clouds and devices • link to code: software agent is running at (1) smartphone and (2) the box .. 戻る M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 22/24 ... 22/24

23. . Example Edge Box for 3-Way Scripts • currently trying to build this box based on conventional Xen • LHAP is Local Hardware Awareness Platform 03 • software agents are running at the box, those are Beacons, Wireless Data Hubs, etc. .. 戻る WiFi Wireless users Wireless AP Physical Device LHAP VM VM Con.Con.Con. Storage Sensors … Beacon WiFi AP WiFi Client P2P WiFi 03 M.Zhanikeev "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015) M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 23/24 ... 23/24

24. . Binary Diffs and DiffHub Idea . Binary Diffs .. . ... are the best way to achieve traffic efficiency in a datatype-indiferent way Cloud Drive User A User B New Old Old Diff Diff Old version New version Binary diff DiffHub • exampe: Docker uses filesystem diffs • recent study: binary diffs are better than filesystem diffs • connection: efficient deploy/ maintain of scale-out code .. 戻る M.Zhanikeev -- maratishe@gmail.com -- 3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds -- bit.do/160114 24/24 ... 24/24

Add a comment

Related pages

Marat Zhanikeev - Google+

Marat Zhanikeev ... 3-Way Scripts as a Base Unit for Flexible Scale-Out Code. ... 3-Way Scripts as a Practical Platform for Secure Distributed Code in ...
Read more

Practical Guide to Platform-as-a-Service (PaaS)

... was written by the CSCC to provide a practical reference to ... The "Practical Guide to Platform ... you the most secure Windows platform ...
Read more

Microsoft Azure: Cloud Computing Platform & Services

Logic Apps Automate the access and use of data across clouds without writing code; ... creating secure ... the Microsoft Azure platform has ...
Read more

.JAVA, NET Component Packs for Excel Word PDF PowerPoint ...

The JAVA, .NET(C#, VB.NET, ASP.NET) Component packs for Excel, Word, PDF, ... Platforms:.NET. Read properties of different objects in diagrams.
Read more

Azure Code Samples | Microsoft Azure

What is Azure Learn the basics about Microsoft's cloud platform; ... of data across clouds without writing code; ... for creating secure ...
Read more

Introduction to the C# Language and the .NET Framework

... XML Web services, distributed components, client ... Visual C# provides an advanced code ... and Web resources about C# to learn practical ...
Read more

Open vStorage

Your storage cluster is geographically distributed and spread into ... 3-way data replication ... aspects of the Open vStorage platform to ...
Read more

Google Cloud Platform

Google Cloud Platform lets you build and host applications and ... A framework that allows for the distributed processing of large data sets across ...
Read more