Skip to main content
Top

2018 | OriginalPaper | Chapter

Datalyzer: Streaming Data Applications Made Easy

Authors : Mario González-Jiménez, Juan de Lara

Published in: Web Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, streaming data are continuously generated from thousands of sources, including social networks, mobile apps, sensors, e-commerce transactions, and many more. Hence, it becomes very useful to build applications able to process these data, with the purpose of filtering interesting parts, monitor their run-time evolution, persist valuable chunks, trigger events upon certain conditions are met and provide analytics. While several frameworks and systems have emerged to create this kind of applications, these systems tend to be low-level, based on complicated APIs, challenging to install and configure for end-users, and requiring from high performant hardware for their execution. Our goal is to lower the entry level to develop, deploy and run streaming applications.
To accomplish this goal, we propose Datalyzer, an approach to create streaming data applications on the cloud based on a visual language. This way, Datalyzer provides a facility to describe streaming data sources in an open way, and a visual language to describe the execution flow of the streaming application. Datalyzer is based on model-based development principles, where code is generated automatically, and then compiled, deployed and executed on the cloud. As a proof of concept, we describe a case study in enterprise systems, and how it can be built using our prototype tool.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Brambilla, M., Cabot, J., Wimmer, M.: Model-Driven Software Engineering in Practice. Synthesis Lectures on Software Engineering, 2nd edn. Morgan & Claypool Publishers, San Rafael (2017) Brambilla, M., Cabot, J., Wimmer, M.: Model-Driven Software Engineering in Practice. Synthesis Lectures on Software Engineering, 2nd edn. Morgan & Claypool Publishers, San Rafael (2017)
2.
go back to reference de Assunção, M.D., Veith, A.D.S., Buyya, R.: Distributed data stream processing and edge computing: a survey on resource elasticity and future directions. J. Netw. Comput. Appl. 103, 1–17 (2018)CrossRef de Assunção, M.D., Veith, A.D.S., Buyya, R.: Distributed data stream processing and edge computing: a survey on resource elasticity and future directions. J. Netw. Comput. Appl. 103, 1–17 (2018)CrossRef
3.
go back to reference Dindar, N., Tatbul, N., Miller, R.J., Haas, L.M., Botan, I.: Modeling the execution semantics of stream processing engines with SECRET. VLDB J. 22(4), 421–446 (2013)CrossRef Dindar, N., Tatbul, N., Miller, R.J., Haas, L.M., Botan, I.: Modeling the execution semantics of stream processing engines with SECRET. VLDB J. 22(4), 421–446 (2013)CrossRef
4.
go back to reference Harth, A., Knoblock, C.A., Stadtmüller, S., Studer, R., Szekely, P.A.: On-the-fly integration of static and dynamic sources. In: COLD. CEUR Workshop Proceedings, vol. 1034 (2013) Harth, A., Knoblock, C.A., Stadtmüller, S., Studer, R., Szekely, P.A.: On-the-fly integration of static and dynamic sources. In: COLD. CEUR Workshop Proceedings, vol. 1034 (2013)
5.
go back to reference Hirzel, M., et al.: IBM streams processing language: analyzing big data in motion. IBM J. Res. Dev. 57(3/4), 7 (2013)CrossRef Hirzel, M., et al.: IBM streams processing language: analyzing big data in motion. IBM J. Res. Dev. 57(3/4), 7 (2013)CrossRef
6.
go back to reference Luckham, D.C.: The power of events - an introduction to complex event processing in distributed enterprise systems. ACM (2005) Luckham, D.C.: The power of events - an introduction to complex event processing in distributed enterprise systems. ACM (2005)
7.
go back to reference Rettig, L., Khayati, M., Cudré-Mauroux, P., Piórkowski, M.: Online anomaly detection over big data streams. In: 2015 IEEE International Conference on Big Data, pp. 1113–1122. IEEE (2015) Rettig, L., Khayati, M., Cudré-Mauroux, P., Piórkowski, M.: Online anomaly detection over big data streams. In: 2015 IEEE International Conference on Big Data, pp. 1113–1122. IEEE (2015)
9.
go back to reference Tatbul, N.: Streaming data integration: challenges and opportunities. In: IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010), pp. 155–158 (2010) Tatbul, N.: Streaming data integration: challenges and opportunities. In: IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010), pp. 155–158 (2010)
12.
go back to reference Zhuang, Z., Feng, T., Pan, Y., Ramachandra, H., Sridharan, B.: Effective multi-stream joining in Apache Samza framework. In: 2016 IEEE International Conference on Big Data, pp. 267–274. IEEE Computer Society (2016). See also https://samza.apache.org/ Zhuang, Z., Feng, T., Pan, Y., Ramachandra, H., Sridharan, B.: Effective multi-stream joining in Apache Samza framework. In: 2016 IEEE International Conference on Big Data, pp. 267–274. IEEE Computer Society (2016). See also https://​samza.​apache.​org/​
Metadata
Title
Datalyzer: Streaming Data Applications Made Easy
Authors
Mario González-Jiménez
Juan de Lara
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91662-0_34

Premium Partner