skip to main content
research-article

Tracking Human Motions in Photographing: A Context-Aware Energy-Saving Scheme for Smart Phones

Authors Info & Claims
Published:26 September 2017Publication History
Skip Abstract Section

Abstract

Due to the portability of smart phones, more and more people tend to take photos with smart phones. However, energy-saving continues to be a thorny problem, since photographing is a rather power hungry function. To extend the battery life of phones while taking photos, we propose a context-aware energy-saving scheme called “SenSave.” SenSave senses the user’s activities during photographing and adopts suitable energy-saving strategies accordingly. SenSave works based on the observation that a lot of energy during photographing is wasted in preparations before shooting. By leveraging the low power-consuming embedded sensors, such as accelerometer and gyroscope, we can recognize the user’s activities and reduce unnecessary energy consumption. Besides, by maintaining an activity state machine, SenSave can determine the user’s activity progressively and improve the recognition accuracy. Experiment results show that SenSave can recognize the user’s activities with an average accuracy of 95.5% and reduce the energy consumption during photographing by 30.0%, when compared to the approach by frequently turning ON/OFF the camera or screen. Additionally, we enhance “SenSave” by introducing an extended Markov chain to predict the next activity state and adopt the energy-saving strategy in advance. Then, we can reduce the energy consumption during photographing by 36.1%.

References

  1. Daito Akimura, Yoshihiro Kawahara, and Tohru Asami. 2012. Compressed sensing method for human activity sensing using mobile phone accelerometers. In Proceedings of INSS. Google ScholarGoogle ScholarCross RefCross Ref
  2. Niranjan Balasubramanian, Aruna Balasubramanian, and Arun Venkataramani. 2009. Energy consumption in mobile phones: A measurement study and implications for network applications. In Proceedings of ACM SIGCOMM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Frank Bellosa, Andreas Weissel, Martin Waitz, and Simon Kellner. 2003. Event-driven energy accounting for dynamic thermal management. In Proceedings of COLP.Google ScholarGoogle Scholar
  4. Cheng Bo, Lan Zhang, Xiang-Yang Li, Qiuyuan Huang, and Yu Wang. 2013. Silentsense: Silent user identification via touch and movement behavioral biometrics. In Proceedings of ACM MobiCom. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Muhammed Fatih Bulut, Murat Demirbas, and Hakan Ferhatosmanoglu. 2015. LineKing: Coffee shop wait-time monitoring using smartphones. IEEE Trans. Mobile Comput. 14, 10 (2015), 2045--2058. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Aaron Carroll and Gernot Heiser. 2010. An analysis of power consumption in a smartphone. In Proceedings of the USENIX Annual Technical Conference, Vol. 14. Boston, MA.Google ScholarGoogle Scholar
  7. Xiang Chen, Yiran Chen, Zhan Ma, and Felix CA Fernandes. 2013a. How is energy consumed in smartphone display applications? In Proceedings of ACM HotMobile. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Zhenyu Chen, Mu Lin, Fanglin Chen, Nicholas D. Lane, Giuseppe Cardone, Rui Wang, Tianxing Li, Yiqiang Chen, Tanzeem Choudhury, and Andrew T Campbell. 2013b. Unobtrusive sleep monitoring using smartphones. In Proceedings of IEEE PervasiveHealth. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Benedikt Dietrich and Samarjit Chakraborty. 2013. Power management using game state detection on android smartphones. In Proceedings of ACM MobiSys. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Mian Dong and Lin Zhong. 2011. Self-constructive high-rate system energy modeling for battery-powered mobile systems. In Proceedings of ACM MobiSys. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Xiaobo Fan, Wolf-Dietrich Weber, and Luiz Andre Barroso. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of ACM SIGARCH. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Yuanyuan Fan, Lei Xie, Yafeng Yin, and Sanglu Lu. 2015. A context aware energy-saving scheme for smart camera phones based on activity sensing. In Proceedings of IEEE MASS. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Haofu Han, Jiadi Yu, Hongzi Zhu, Yingying Chen, Jie Yang, Guangtao Xue, Yanmin Zhu, and Minglu Li. 2013. E: Energy-efficient engine for frame rate adaptation on smartphones. In Proceedings of ACM Sensys. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Tian Hao, Guoliang Xing, and Gang Zhou. 2013. iSleep: Unobtrusive sleep quality monitoring using smartphones. In Proceedings of ACM Sensys. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Songtao He, Yunxin Liu, and Hucheng Zhou. 2015. Optimizing smartphone power consumption through dynamic resolution scaling. In Proceedings of ACM MobiCom. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Wenjie Hu and Guohong Cao. 2015. Energy-aware video streaming on smartphones. In Proceedings of IEEE INFOCOM. Google ScholarGoogle ScholarCross RefCross Ref
  17. Wenjie Hu, Guohong Cao, Srikanth V Krishanamurthy, and Prasant Mohapatra. 2013. Mobility-assisted energy-aware user contact detection in mobile social networks. In Proceedings of IEEE ICDCS. IEEE, 155--164.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Derick A. Johnson and Mohan M. Trivedi. 2011. Driving style recognition using a smartphone as a sensor platform. In Proceedings of IEEE ITSC. Google ScholarGoogle ScholarCross RefCross Ref
  19. Wazir Zada Khan, Yang Xiang, Mohammed Y. Aalsalem, and Quratulain Arshad. 2013. Mobile phone sensing systems: A survey. IEEE Commun. Surv. Tutor. 15, 1 (2013), 402--427. Google ScholarGoogle ScholarCross RefCross Ref
  20. Jennifer R. Kwapisz, Gary M. Weiss, and Samuel A. Moore. 2011. Activity recognition using cell phone accelerometers. SIGKDD 12, 2 (2011), 74--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Nicholas D. Lane, Emiliano Miluzzo, Hong Lu, Daniel Peebles, Tanzeem Choudhury, and Andrew T. Campbell. 2010. A survey of mobile phone sensing. IEEE Commun. Mag. 48, 9 (2010), 140--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Young-Seol Lee and Sung-Bae Cho. 2011. Activity recognition using hierarchical hidden markov models on a smartphone with 3D accelerometer. In Proceedings of Springer HAIS.Google ScholarGoogle ScholarCross RefCross Ref
  23. Qiang Li, Qi Han, and Limin Sun. 2016. Collaborative recognition of queuing behavior on mobile phones. IEEE Trans. Mobile Comput. 15, 1 (2016), 60--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Robert LiKamWa, Bodhi Priyantha, Matthai Philipose, Lin Zhong, and Paramvir Bahl. 2013. Energy characterization and optimization of image sensing toward continuous mobile vision. In Proceedings of ACM MobiSys.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Emiliano Miluzzo, Nicholas D. Lane, Kristóf Fodor, Ronald Peterson, Hong Lu, Mirco Musolesi, Shane B. Eisenman, Xiao Zheng, and Andrew T. Campbell. 2008. Sensing meets mobile social networks: The design, implementation and evaluation of the cenceme application. In Proceedings of ACM SenSys. ACM, 337--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Chulhong Min, Youngki Lee, Chungkuk Yoo, Kang Seungwoo, Sangwon Choi, Pillsoon Park, Inseok Hwang, Younghyun Ju, Seungpyo Choi, and Junehwa Song. 2015. PowerForecaster: Predicting smartphone power impact of continuous sensing applications at pre-installation time. In Proceedings of ACM SenSys. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Suman Nath. 2012. ACE: Exploiting correlation for energy-efficient and continuous context sensing. In Proceedings of ACM MobiSys. ACM, 29--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Taiwoo Park, Jinwon Lee, Inseok Hwang, Chungkuk Yoo, Lama Nachman, and Junehwa Song. 2011. E-gesture: A collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices. In Proceedings of ACM SenSys. ACM, 260--273. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Huimin Qian, Yaobin Mao, Wenbo Xiang, and Zhiquan Wang. 2010. Recognition of human activities using SVM multi-class classifier. Pattern Recogn. Lett. 31, 2 (2010), 100--111. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Moo-Ryong Ra, Jeongyeup Paek, Abhishek B. Sharma, Ramesh Govindan, Martin H. Krieger, and Michael J. Neely. 2010. Energy-delay tradeoffs in smartphone applications. In Proceedings of ACM MobiSys. ACM, 255--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Dinesh Rajan, Russell Zuck, and Christian Poellabauer. 2006. Workload-aware dual-speed dynamic voltage scaling. In Proceedings of IEEE RTCSA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Yanzhi Ren, Yingying Chen, Mooi Choo Chuah, and Jie Yang. 2015a. User verification leveraging gait recognition for smartphone enabled mobile healthcare systems. IEEE Trans. Mobile Comput. 14, 9 (2015), 1961--1974. Google ScholarGoogle ScholarCross RefCross Ref
  33. Yanzhi Ren, Chen Wang, Jie Yang, and Chen Yingying. 2015b. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In Proceedings of IEEE INFOCOM.Google ScholarGoogle ScholarCross RefCross Ref
  34. Samsu Sempena, Nur Ulfa Maulidevi, and Peb Ruswono Aryan. 2011. Human action recognition using dynamic time warping. In Proceedings of IEEE ICEEI. IEEE, 1--5. Google ScholarGoogle ScholarCross RefCross Ref
  35. Muhammad Shahzad, Alex X. Liu, and Arjmand Samuel. 2013. Secure unlocking of mobile touch screen devices by simple gestures: You can see it but you cannot do it. In Proceedings of ACM MobiCom. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Lin Sun, Li Bin Zhang, Daqing, Bin Guo, and Shijian Li. 2010. Activity recognition on an accelerometer embedded mobile phone with varying positions and orientations. Ubiq. Intell. Comput. 6406 (2010), 548--562. Google ScholarGoogle ScholarCross RefCross Ref
  37. Google Inc. 2016a. Android APIs. Retrieved from http://developer.android.com/reference/android/hardware/SensorEvent.html#values.Google ScholarGoogle Scholar
  38. Google Inc. 2016b. Camera Parameters. Retrieved from https://developer.android.com/reference/android/hardware/Camera.Parameters.html.Google ScholarGoogle Scholar
  39. Google Inc. 2016c. Sensor types. Retrieved from https://source.android.com/devices/sensors/sensor-types.html.Google ScholarGoogle Scholar
  40. KS Mobile Inc. 2014. Top 10 Battery Draining Apps for Android. Retrieved from http://www.businesswire.com/news/home/20140227005449/en/Clean-Master-Announces-Top-10-Android-Vampire.Google ScholarGoogle Scholar
  41. Monsoon Solutions Inc. 2015. Monsoon Power Monitor. Retrieved from https://www.msoon.com/LabEquipment/PowerMonitor/.Google ScholarGoogle Scholar
  42. Junjue Wang, Kaichen Zhao, Xinyu Zhang, and Chunyi Peng. 2014. Ubiquitous keyboard for small mobile devices: Harnessing multipath fading for fine-grained keystroke localization. In Proceedings of ACM MobiSys. ACM, 14--27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Fengyuan Xu, Yunxin Liu, Qun Li, and Yongguang Zhang. 2013. V-edge: Fast self-constructive power modeling of smartphones based on battery voltage dynamics. In Proceedings of NSDI.Google ScholarGoogle Scholar
  44. Zhixian Yan, Vigneshwaran Subbaraju, Chakraborty, Dipanjan, Archan Misra, and Karl Aberer. 2012. Energy-efficient continuous activity recognition on mobile phones: An activity-adaptive approach. In Proceedings of ISWC. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Zheng Yang, Longfei Shangguan, Zimu Gu, Weixi amd Zhou, Chenshu Wu, and Yunhao Liu. 2014. Sherlock: Micro-environment sensing for smartphones. IEEE Trans. Parall. Distrib. Syst. 25, 12 (2014), 3295--3305. Google ScholarGoogle ScholarCross RefCross Ref
  46. Yafeng Yin, Qun Li, Lei Xie, Shanhe Yi, Edmund Novak, and Sanglu Lu. 2016. CamK: A camera-based keyboard for small mobile devices. In Proceedings of the IEEE INFOCOM. IEEE, 1--9. Google ScholarGoogle ScholarCross RefCross Ref
  47. Jiadi Yu, Haofu Han, Hongzi Zhu, Yingying Chen, Jie Yang, Yanmin Zhu, Guangtao Xue, and Minglu Li. 2015. Sensing human-screen interaction for energy-efficient frame rate adaptation on smartphones. IEEE Trans. Mobile Comput. 14, 8 (2015). Google ScholarGoogle ScholarCross RefCross Ref
  48. Bo Zhao, Wenjie Hu, Qiang Zheng, and Guohong Cao. 2015. Energy-aware web browsing on smartphones. IEEE Trans. Parall. Distrib. Syst. 26, 3 (2015), 761--774. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Tracking Human Motions in Photographing: A Context-Aware Energy-Saving Scheme for Smart Phones

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Sensor Networks
        ACM Transactions on Sensor Networks  Volume 13, Issue 4
        November 2017
        290 pages
        ISSN:1550-4859
        EISSN:1550-4867
        DOI:10.1145/3139355
        • Editor:
        • Chenyang Lu
        Issue’s Table of Contents

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 26 September 2017
        • Accepted: 1 April 2017
        • Revised: 1 November 2016
        • Received: 1 January 2016
        Published in tosn Volume 13, Issue 4

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader