skip to main content
research-article

Demand-based sensor data gathering with multi-query optimization

Published:01 August 2020Publication History
Skip Abstract Section

Abstract

In the Internet of Things, billions of sensors provide data streams to applications. The data are predominately acquired from devices with constrained computational capabilities, often serving multiple queries simultaneously. Sensor nodes, are typically oblivious to the specific needs of applications. The potential requirements of diverse applications force them to push data at a higher rate than required by a specific, currently running application. That is suboptimal due to 1. constraints in the network bandwidth, 2. expenses for transmissions, and 3. limited computational power. However, decreasing data gathering frequency may reduce the applications' accuracy. In this paper, we demonstrate a technique for minimizing the number of network transmissions while maintaining the desired accuracy. The presented algorithm for read- and transmission-sharing among queries goes hand-in-hand with state-of-the-art machine learning techniques for adaptive sampling. We 1. implement the technique and deploy it on a sensor node, 2. replay sensor-data from two real-world scenarios, 3. provide an interface for submitting custom queries, and 4. present an interactive dashboard. Here, visitors observe live statistics on the read- and transmission savings achieved in real-world use-cases. The dashboard also visualizes optimizations currently performed by the read scheduling procedure and hence conveys real-time insights and a deep understanding of the presented algorithm.

References

  1. L. Atzori, A. Iera, and G. Morabito. The internet of things: A survey. Computer networks, 54(15):2787--2805, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. P. Carbone, A. Katsifodimos, S. Ewen, V. Markl, S. Haridi, and K. Tzoumas. Apache flink: Stream and batch processing in a single engine. IEEE Big Data Bulletin, 36(4), 2015.Google ScholarGoogle Scholar
  3. L. Da Xu, W. He, and S. Li. Internet of things in industries: A survey. IEEE Transactions on industrial informatics, 10(4):2233--2243, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  4. L. Fan and L. Xiong. An adaptive approach to real-time aggregate monitoring with differential privacy. IEEE TKDE, 26(9), 2014.Google ScholarGoogle Scholar
  5. D. Giouroukis, A. Dadiani, J. Traub, S. Zeuch, and V. Markl. A survey of adaptive sampling and filtering algorithms for the internet of things. In DEBS'20: 14th ACM International Conference on Distributed and Event-Based Systems, 2020. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. D. Giouroukis, J. Hülsmann, J. von Bleichert, M. Geldenhuys, T. Stullich, F. Gutierrez, J. Traub, K. Beedkar, and V. Markl. Resense: Transparent record and replay of sensor data in the Internet of Things. In Proceedings of the International Conference on Extending Database Technology (EDBT), 2019.Google ScholarGoogle Scholar
  7. S. R. Madden, M. J. Franklin, J. M. Hellerstein, and W. Hong. TinyDB: an acquisitional query processing system for sensor networks. TODS, 30(1), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. C. Mutschler, H. Ziekow, and Z. Jerzak. The debs 2013 grand challenge. In Proceedings of the 7th ACM international conference on Distributed event-based systems, pages 289--294, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. A. Tavakoli, A. Kansal, and S. Nath. On-line sensing task optimization for shared sensors. IPSN, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Toshniwal, S. Taneja, A. Shukla, K. Ramasamy, J. M. Patel, S. Kulkarni, J. Jackson, K. Gade, M. Fu, J. Donham, et al. Storm@twitter. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 147--156, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. J. Traub, S. Breß, T. Rabl, A. Katsifodimos, and V. Markl. Optimized on-demand data streaming from sensor nodes. In ACM SoCC, 2017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. Trihinas, G. Pallis, and M. D. Dikaiakos. AdaM: An adaptive monitoring framework for sampling and filtering on IoT devices. IEEE Big Data, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. R. van der Meulen. Gartner says 6.4 billion connected things will be in use in 2016, up 30 percent from 2015. 2015.Google ScholarGoogle Scholar
  14. S. Xiang, H. B. Lim, and K.-L. Tan. Impact of multi-query optimization in sensor networks. In Proceedings of the 3rd workshop on Data management for sensor networks: in conjunction with VLDB 2006, pages 7--12, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. S. Xiang, H. B. Lim, K.-L. Tan, and Y. Zhou. Two-tier multiple query optimization for sensor networks. ICDCS, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Zeuch, A. Chaudhary, B. Del Monte, H. Gavriilidis, D. Giouroukis, P. M. Grulich, S. Breß, J. Traub, and V. Markl. The nebulastream platform: Data and application management for the internet of things. In Conference on Innovative Data Systems Research (CIDR), 2019.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image Proceedings of the VLDB Endowment
    Proceedings of the VLDB Endowment  Volume 13, Issue 12
    August 2020
    1710 pages
    ISSN:2150-8097
    Issue’s Table of Contents

    Publisher

    VLDB Endowment

    Publication History

    • Published: 1 August 2020
    Published in pvldb Volume 13, Issue 12

    Qualifiers

    • research-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader