Skip to main content
Top

2017 | OriginalPaper | Chapter

Dealing with Velocity and Variety in the Acquisition of Heterogeneous Sensor Data

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

ETL (Extraction-Transform-Load) tools, traditionally developed to operate offline, need to be enhanced to deal with various, fast, big and fresh data and be executed on the edge of the network during the acquisition process. In this dissertation we wish to develop facilities that from one side make easy, scalable and controllable the development of data acquisition plans that can be executed on the edge of the network during loading and transmission. From the other side, we wish to deal with the variety of the data and verify when the developed data acquisition plans adhere to the common semantics adopted in the Domain Ontology. These facilities are included in StreamLoader, a web application tailored for the specification and monitoring of sensor data acquisition plans.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Apparent temperature is a value of temperature adjusted with the level of humidity.
 
Literature
1.
go back to reference Dong, M., Kimata, T., Zettsu, K.: Service-controlled networking: dynamic in-network data fusion for heterogeneous sensor networks. In: IEEE International Symposium on Reliable Distributed Systems Workshops (SRDSW), pp. 94–99 (2014) Dong, M., Kimata, T., Zettsu, K.: Service-controlled networking: dynamic in-network data fusion for heterogeneous sensor networks. In: IEEE International Symposium on Reliable Distributed Systems Workshops (SRDSW), pp. 94–99 (2014)
2.
go back to reference Bermudez-Edo, M., et al.: IoT-Lite ontology (2015) Bermudez-Edo, M., et al.: IoT-Lite ontology (2015)
3.
go back to reference W3C Semantic Sensor Network Group: Semantic sensor network ontology (2005) W3C Semantic Sensor Network Group: Semantic sensor network ontology (2005)
4.
go back to reference Ankit, J., et al.: Learning Storm. Packt Publishing, Birmingham (2014) Ankit, J., et al.: Learning Storm. Packt Publishing, Birmingham (2014)
5.
go back to reference Mesiti, M., et al.: StreamLoader: An event-driven ETL system for the on-line processing of heterogeneous sensor data. In: Proceedings of International Conference on Extending Database Technology, pp. 628–631 (2016) Mesiti, M., et al.: StreamLoader: An event-driven ETL system for the on-line processing of heterogeneous sensor data. In: Proceedings of International Conference on Extending Database Technology, pp. 628–631 (2016)
6.
go back to reference Neumeyer, L., et al.: S4: distributed stream computing platform. In: International Workshop on Data Mining ICDMW, pp. 170–177 (2010) Neumeyer, L., et al.: S4: distributed stream computing platform. In: International Workshop on Data Mining ICDMW, pp. 170–177 (2010)
7.
go back to reference Kabra, N., et al.: Efficient mid-query re-optimization of sub-optimal query execution plans. SIGMOD Rec. 27(2), 106–117 (1998)CrossRef Kabra, N., et al.: Efficient mid-query re-optimization of sub-optimal query execution plans. SIGMOD Rec. 27(2), 106–117 (1998)CrossRef
8.
go back to reference Markl, V., et al.: Robust query processing through progressive optimization. In: Proceedings of International Conferences on Management of Data, SIGMOD, pp. 659–670 (2004) Markl, V., et al.: Robust query processing through progressive optimization. In: Proceedings of International Conferences on Management of Data, SIGMOD, pp. 659–670 (2004)
9.
go back to reference Sheth, A., et al.: Semantic sensor web. IEEE Internet Comput. 12(4), 78–83 (2008)CrossRef Sheth, A., et al.: Semantic sensor web. IEEE Internet Comput. 12(4), 78–83 (2008)CrossRef
10.
go back to reference Karau, H., et al.: Learning Spark: Lightning-Fast Big Data Analysis. O’Reilly Media, Beijing (2015) Karau, H., et al.: Learning Spark: Lightning-Fast Big Data Analysis. O’Reilly Media, Beijing (2015)
Metadata
Title
Dealing with Velocity and Variety in the Acquisition of Heterogeneous Sensor Data
Author
Luca Ferrari
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58694-6_35

Premium Partner