skip to main content
10.1145/3131542.3131557acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiotConference Proceedingsconference-collections
research-article

A multi-tier data reduction mechanism for IoT sensors

Published:22 October 2017Publication History

ABSTRACT

The increasing number and variety of IoT (Internet of Things) devices produce a huge amount of diverse data upon which applications are built. Depending on the specific use case, the sampling rate of IoT sensors may be high, thus leading the devices to fast energy and storage depletion. One option to address these issues is to perform data reduction at the source nodes so as to decrease both energy consumption and used storage. Most of current available solutions perform data reduction only at a single tier of the IoT architecture (e.g., at gateways), or simply operate a-posteriori once the data transmission has already taken place (i.e., at the cloud data center). This paper proposes a multi-tier data reduction mechanism deployed at both gateways and the edge tier. At the gateways, we apply the PIP (Perceptually Important Point) method to represent the features of a time series by using a finite amount of data. We extend such an algorithm by introducing several techniques, namely interval restriction, dynamic caching and weighted sequence selection. At the edge tier, we propose a data fusion method based on an optimal set selection. Such a method employs a simple strategy to fuse the data in the same time domain for a specific location. Finally, we evaluate the performance of the proposed filtering and the fusion technique. The obtained results demonstrate the efficiency of the proposed mechanism in terms of time and accuracy.

References

  1. Mohammad Abu Alsheikh, Shaowei Lin, Dusit Niyato, and Hwee-Pink Tan. 2016. Rate-Distortion Balanced Data Compression for Wireless Sensor Networks. IEEE Sensors Journal 16, 12 (jun 2016), 5072--5083.Google ScholarGoogle Scholar
  2. Mohammad Abu Alsheikh, Shaowei Lin, Hwee-Pink Tan, and Dusit Niyato. 2015. Toward a robust sparse data representation for wireless sensor networks. In 2015 IEEE 40th Conference on Local Computer Networks (LCN). IEEE, 117--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Boulat A Bash, John W Byers, and Jeffrey Considine. 2004. Approximately uniform random sampling in sensor networks. In Proceeedings of the 1st international workshop on Data management for sensor networks: in conjunction with VLDB 2004. ACM, 32--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Siyao Cheng, Jianzhong Li, Qianqian Ren, and Lei Yu. 2010. Bernoulli sampling based (ε, Δ)-approximate aggregation in large-scale sensor networks. In Proceedings of the 29th conference on Information communications. IEEE Press, 1181--1189. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Chiang, S. Ha, C. L. I, F. Risso, and T. Zhang. 2017. Clarifying Fog Computing and Networking: 10 Questions and Answers. IEEE Communications Magazine 55, 4 (April 2017), 18--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Seung-Seok Choi, Sung-Hyuk Cha, and Charles C Tappert. 2010. A survey of binary similarity and distance measures. Journal of Systemics, Cybernetics and Informatics 8, 1 (2010), 43--48.Google ScholarGoogle Scholar
  7. Fu-Lai Chung, Tak-Chung Fu, R Luk, and V Ng. 2001. Flexible time series pattern matching based on perceptually important points. (2001).Google ScholarGoogle Scholar
  8. Mario Di Francesco, Mayank Raj, Na Li, and Sajal K. Das. 2012. A Storage Infrastructure for Heterogeneous and Multimedia Data in the Internet of Things. In The 2012 IEEE International Conference on Internet of Things (iThings 2012). 26--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Kai-Wei Fan, Sha Liu, and Prasun Sinha. 2007. Structure-free data aggregation in sensor networks. IEEE Transactions on Mobile Computing 6, 8 (2007), 929--942. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Elena Fasolo, Michele Rossi, Jorg Widmer, and Michele Zorzi. 2007. In-network aggregation techniques for wireless sensor networks: a survey. IEEE Wireless Communications 14, 2 (2007), 70--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jayavardhana Gubbi, Rajkumar Buyya, Slaven Marusic, and Marimuthu Palaniswami. 2013. Internet of Things (IoT): A vision, architectural elements, and future directions. Future Generation Computer Systems 29, 7 (2013), 1645 -- 1660. Including Special sections: Cyber-enabled Distributed Computing for Ubiquitous Cloud and Network Services & Cloud Computing and Scientific Applications - Big Data, Scalable Analytics, and Beyond. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Zaib Gul, Ahmed Uzair, and Ali Arshad. 2004. Pattern Recognition through Perceptually Important Points in Financial Time Series. International Conference on Fuzzy Sets and Soft Computing in Economics and Finance I (2004), 89--97.Google ScholarGoogle Scholar
  13. YANG Guo-Ning, FENG Xiu-Fang, and FAN Liu-juan. 2012. Multi-Sensor Data Fusion Algorithm Based on Optimal Fusion Set. Journal of Software 23, 1 (2012), 134--140.Google ScholarGoogle Scholar
  14. Zengfeng Huang, Lu Wang, Ke Yi, and Yunhao Liu. 2011. Sampling based algorithms for quantile computation in sensor networks. In Proceedings of the 2011 international conference on Management of data - SIGMOD '11. ACM Press, New York, New York, USA, 745. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ankur Jain and Edward Y Chang. 2004. Adaptive sampling for sensor networks. In Proceeedings of the 1st international workshop on Data management for sensor networks: in conjunction with VLDB 2004. ACM, 10--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Naoto Kimura and Shahram Latifi. 2005. A survey on data compression in wireless sensor networks. In International Conference on Information Technology: Coding and Computing (ITCC'05)-Volume II, Vol. 2. IEEE, 8--13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Shancang Li, Li Da Xu, and Xinheng Wang. 2013. Compressed sensing signal and data acquisition in wireless sensor networks and internet of things. IEEE Transactions on Industrial Informatics 9, 4 (2013), 2177--2186.Google ScholarGoogle ScholarCross RefCross Ref
  18. Song Lin, Benjamin Arai, Dimitrios Gunopulos, and Gautam Das. 2008. Region sampling: Continuous adaptive sampling on sensor networks. In 2008 IEEE 24th International Conference on Data Engineering. IEEE, 794--803. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Xiao-Yang Liu, Yanmin Zhu, Linghe Kong, Cong Liu, Yu Gu, Athanasios V Vasilakos, and Min-You Wu. 2015. CDC: Compressive data collection for wireless sensor networks. IEEE Transactions on Parallel and Distributed Systems 26, 8 (2015), 2188--2197.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Apostolos Papageorgiou, Bin Cheng, and Erno Kovacs. 2015. Real-time data reduction at the network edge of Internet-of-Things systems. In 2015 11th International Conference on Network and Service Management (CNSM). IEEE, 284--291. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Kevin B Pratt and Eugene Fink. 2002. Search for patterns in compressed time series. International Journal of Image and Graphics 2, 01 (2002), 89--106.Google ScholarGoogle ScholarCross RefCross Ref
  22. Michael J. Tarr. 2000. Visual Pattern Recognition. Encyclopedia of psychology (2000), 1--4.Google ScholarGoogle Scholar
  23. Rebecca Willett, Aline Martin, and Robert Nowak. 2004. Backcasting: adaptive sampling for sensor networks. In Proceedings of the 3rd international symposium on Information processing in sensor networks. ACM, 124--133. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    IoT '17: Proceedings of the Seventh International Conference on the Internet of Things
    October 2017
    211 pages
    ISBN:9781450353182
    DOI:10.1145/3131542

    Copyright © 2017 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 22 October 2017

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate28of84submissions,33%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader