Skip to main content

2017 | OriginalPaper | Buchkapitel

\(\mathbb {ECHO}\): An Adaptive Orchestration Platform for Hybrid Dataflows across Cloud and Edge

verfasst von : Pushkara Ravindra, Aakash Khochare, Siva Prakash Reddy, Sarthak Sharma, Prateeksha Varshney, Yogesh Simmhan

Erschienen in: Service-Oriented Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The Internet of Things (IoT) is offering unprecedented observational data that are used for managing Smart City utilities. Edge and Fog gateway devices are an integral part of IoT deployments to acquire real-time data and enact controls. Recently, Edge-computing is emerging as first-class paradigm to complement Cloud-centric analytics. But a key limitation is the lack of a platform-as-a-service for applications spanning Edge and Cloud. Here, we propose \(\mathbb {ECHO}\), an orchestration platform for dataflows across distributed resources. \(\mathbb {ECHO}\) ’s hybrid dataflow composition can operate on diverse data models – streams, micro-batches and files, and interface with native runtime engines like TensorFlow and Storm to execute them. It manages the application’s lifecycle, including container-based deployment and a registry for state management. \(\mathbb {ECHO}\) can schedule the dataflow on different Edge, Fog and Cloud resources, and also perform dynamic task migration between resources. We validate the \(\mathbb {ECHO}\) platform for executing video analytics and sensor streams for Smart Traffic and Smart Utility applications on Raspberry Pi, NVidia TX1, ARM64 and Azure Cloud VM resources, and present our results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Simmhan, Y., Aman, S., Kumbhare, A., Liu, R., Stevens, S., Zhou, Q., Prasanna, V.: Cloud-based software platform for big data analytics in smart grids. IEEE/AIP Comput. Sci. Eng. (2013) Simmhan, Y., Aman, S., Kumbhare, A., Liu, R., Stevens, S., Zhou, Q., Prasanna, V.: Cloud-based software platform for big data analytics in smart grids. IEEE/AIP Comput. Sci. Eng. (2013)
2.
Zurück zum Zitat Amrutur, B., Rajaraman, V., Acharya, S., Ramesh, R., Joglekar, A., Sharma, A., Simmhan, Y., Lele, A., Mahesh, A., Sankaran, S.: An open smart city IoT test bed: street light poles as smart city spines. In: ACM/IEEE International Conference on Internet of Things Design and Implementation (2017) Amrutur, B., Rajaraman, V., Acharya, S., Ramesh, R., Joglekar, A., Sharma, A., Simmhan, Y., Lele, A., Mahesh, A., Sankaran, S.: An open smart city IoT test bed: street light poles as smart city spines. In: ACM/IEEE International Conference on Internet of Things Design and Implementation (2017)
3.
Zurück zum Zitat Simmhan, Y.: IoT analytics across edge and cloud platforms. IEEE IoT Newsl., May 2017 Simmhan, Y.: IoT analytics across edge and cloud platforms. IEEE IoT Newsl., May 2017
4.
Zurück zum Zitat Garcia Lopez, P., Montresor, A., Epema, D., Datta, A., Higashino, T., Iamnitchi, A., Barcellos, M., Felber, P., Riviere, E.: Edge-centric computing: vision and challenges. ACM Comput. Comm. Rev. (2015) Garcia Lopez, P., Montresor, A., Epema, D., Datta, A., Higashino, T., Iamnitchi, A., Barcellos, M., Felber, P., Riviere, E.: Edge-centric computing: vision and challenges. ACM Comput. Comm. Rev. (2015)
5.
Zurück zum Zitat Ghosh, R., Simmhan, Y.: Distributed scheduling of event analytics across edge and cloud, CoRR, no. 1608.01537 (2016) Ghosh, R., Simmhan, Y.: Distributed scheduling of event analytics across edge and cloud, CoRR, no. 1608.01537 (2016)
6.
Zurück zum Zitat Varshney, P., Simmhan, Y.: Demystifying fog computing: Characterizing architectures, applications and abstractions. In: IEEE International Conference on Fog and Edge Computing (2017) Varshney, P., Simmhan, Y.: Demystifying fog computing: Characterizing architectures, applications and abstractions. In: IEEE International Conference on Fog and Edge Computing (2017)
7.
Zurück zum Zitat Mineraud, J., Mazhelis, O., Su, X., Tarkoma, S.: A gap analysis of internet-of-things platforms. Comput. Commun. 89, 5–16 (2016)CrossRef Mineraud, J., Mazhelis, O., Su, X., Tarkoma, S.: A gap analysis of internet-of-things platforms. Comput. Commun. 89, 5–16 (2016)CrossRef
11.
Zurück zum Zitat Abadi, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. In: USENIX Symposium on Operating Systems Design and Implementation (2016) Abadi, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. In: USENIX Symposium on Operating Systems Design and Implementation (2016)
12.
Zurück zum Zitat Beart, P.: Automatic resource discovery for the internet of things - specification, The British Standards Institution. Tech. Rep. PAS 212:2016 (2016) Beart, P.: Automatic resource discovery for the internet of things - specification, The British Standards Institution. Tech. Rep. PAS 212:2016 (2016)
13.
Zurück zum Zitat Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (2008) Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
14.
Zurück zum Zitat Shukla, A., Chaturvedi, S., Simmhan, Y.: RIoTBench: a real-time IoT benchmark for distributed stream processing platforms, CoRR, no. 1701.08530 (2017) Shukla, A., Chaturvedi, S., Simmhan, Y.: RIoTBench: a real-time IoT benchmark for distributed stream processing platforms, CoRR, no. 1701.08530 (2017)
15.
Zurück zum Zitat Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger, CoRR, no. 1612.08242 (2016) Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger, CoRR, no. 1612.08242 (2016)
16.
Zurück zum Zitat Georgantas, N., Billet, B.: Revisiting service-oriented architecture for the IoT: a middleware perspective. In: International Conference on Service Oriented Computing (2016) Georgantas, N., Billet, B.: Revisiting service-oriented architecture for the IoT: a middleware perspective. In: International Conference on Service Oriented Computing (2016)
17.
Zurück zum Zitat Billet, B., Issarny, V.: From task graphs to concrete actions: a new task mapping algorithm for the future internet of things. In: IEEE International Conference on Mobile Ad Hoc Sensor Systems (2014) Billet, B., Issarny, V.: From task graphs to concrete actions: a new task mapping algorithm for the future internet of things. In: IEEE International Conference on Mobile Ad Hoc Sensor Systems (2014)
18.
Zurück zum Zitat Hong, K., Lillethun, D., Ramachandran, U., Ottenwälder, B., Koldehofe, B.: Mobile fog: a programming model for large-scale applications on the internet of things. In: ACM SIGCOMM Workshop on Mobile Cloud Computing (2013) Hong, K., Lillethun, D., Ramachandran, U., Ottenwälder, B., Koldehofe, B.: Mobile fog: a programming model for large-scale applications on the internet of things. In: ACM SIGCOMM Workshop on Mobile Cloud Computing (2013)
19.
Zurück zum Zitat Yang, L., Cao, J., Yuan, Y., Li, T., Han, A., Chan, A.: A framework for partitioning and execution of data stream applications in mobile cloud computing. ACM SIGMETRICS Performance Eval. Rev. 40(4) (2013) Yang, L., Cao, J., Yuan, Y., Li, T., Han, A., Chan, A.: A framework for partitioning and execution of data stream applications in mobile cloud computing. ACM SIGMETRICS Performance Eval. Rev. 40(4) (2013)
20.
Zurück zum Zitat Reiter, A., Prünster, B., Zefferer, T.: Hybrid mobile edge computing: Unleashing the full potential of edge computing in mobile device use cases. In: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) (2017) Reiter, A., Prünster, B., Zefferer, T.: Hybrid mobile edge computing: Unleashing the full potential of edge computing in mobile device use cases. In: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) (2017)
21.
Zurück zum Zitat Chun, B.-G., Ihm, S., Maniatis, P., Naik, M., Patti, A.: Clonecloud: elastic execution between mobile device and cloud. In: Conference on Computer Systems (2011) Chun, B.-G., Ihm, S., Maniatis, P., Naik, M., Patti, A.: Clonecloud: elastic execution between mobile device and cloud. In: Conference on Computer Systems (2011)
22.
Zurück zum Zitat Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: Seti@ home: an experiment in public-resource computing. CACM 45(11) (2002) Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: Seti@ home: an experiment in public-resource computing. CACM 45(11) (2002)
Metadaten
Titel
: An Adaptive Orchestration Platform for Hybrid Dataflows across Cloud and Edge
verfasst von
Pushkara Ravindra
Aakash Khochare
Siva Prakash Reddy
Sarthak Sharma
Prateeksha Varshney
Yogesh Simmhan
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-69035-3_28