Skip to main content
Top

2018 | OriginalPaper | Chapter

Framework for Human Activity Recognition on Smartphones and Smartwatches

Authors : Blagoj Mitrevski, Viktor Petreski, Martin Gjoreski, Biljana Risteska Stojkoska

Published in: ICT Innovations 2018. Engineering and Life Sciences

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As activity recognition becomes an integral part of many mobile applications, its requirement for lightweight and accurate techniques leads to development of new tools and algorithms. This paper has three main contributions: (1) to design an architecture for automatic data collection, thus reducing the time and cost and making the process of developing new activity recognition techniques convenient for software developers as well as for the end users; (2) to develop new algorithm for activity recognition based on Long Short Term Memory networks, which is able to learn features from raw accelerometer data, completely bypassing the process of generating hand-crafted features; and (3) to investigate which combinations of smartphone and smartwatch sensors gives the best results for the activity recognition problem, i.e. to analyze if the accuracy benefits of those combinations are greater than the additional costs for combining those sensors.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., Havinga, P.: Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In 2010 23rd International Conference on Architecture of Computing Systems (ARCS), pp. 1–10. VDE (2010) Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., Havinga, P.: Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In 2010 23rd International Conference on Architecture of Computing Systems (ARCS), pp. 1–10. VDE (2010)
2.
go back to reference Risteska Stojkoska, B., Trivodaliev, K., Davcev, D.: Internet of things framework for home care systems. Wireless Commun. Mobile Comput. 2017 (2017) Risteska Stojkoska, B., Trivodaliev, K., Davcev, D.: Internet of things framework for home care systems. Wireless Commun. Mobile Comput. 2017 (2017)
3.
go back to reference Weinstein, A.R., et al.: The joint effects of physical activity and body mass index on coronary heart disease risk in women. Arch. Intern. Med. 168(8), 884–890 (2008)CrossRef Weinstein, A.R., et al.: The joint effects of physical activity and body mass index on coronary heart disease risk in women. Arch. Intern. Med. 168(8), 884–890 (2008)CrossRef
4.
go back to reference Hu, G., Barengo, N.C., Tuomilehto, J., Lakka, T.A., Nissinen, A., Jousilahti, P.: Relationship of physical activity and body mass index to the risk of hypertension: a prospective study in Finland. Hypertension 43(1), 25–30 (2004)CrossRef Hu, G., Barengo, N.C., Tuomilehto, J., Lakka, T.A., Nissinen, A., Jousilahti, P.: Relationship of physical activity and body mass index to the risk of hypertension: a prospective study in Finland. Hypertension 43(1), 25–30 (2004)CrossRef
5.
go back to reference Haapanen, N., Miilunpalo, S., Vuori, I., Oja, P., Pasanen, M.: Association of leisure time physical activity with the risk of coronary heart disease, hypertension and diabetes in middle-aged men and women. Int. J. Epidemiol. 26(4), 739–747 (1997)CrossRef Haapanen, N., Miilunpalo, S., Vuori, I., Oja, P., Pasanen, M.: Association of leisure time physical activity with the risk of coronary heart disease, hypertension and diabetes in middle-aged men and women. Int. J. Epidemiol. 26(4), 739–747 (1997)CrossRef
6.
go back to reference Jia, Y.: Diatetic and exercise therapy against diabetes mellitus. In: ICINIS 2009. Second International Conference on Intelligent Networks and Intelligent Systems, 2009, pp. 693–696. IEEE (2009) Jia, Y.: Diatetic and exercise therapy against diabetes mellitus. In: ICINIS 2009. Second International Conference on Intelligent Networks and Intelligent Systems, 2009, pp. 693–696. IEEE (2009)
7.
go back to reference Zdravevski, E., Stojkoska, B.R., Standl, M., Schulz, H.: Automatic machine-learning based identification of jogging periods from accelerometer measurements of adolescents under field conditions. PLoS ONE 12(9), e0184216 (2017)CrossRef Zdravevski, E., Stojkoska, B.R., Standl, M., Schulz, H.: Automatic machine-learning based identification of jogging periods from accelerometer measurements of adolescents under field conditions. PLoS ONE 12(9), e0184216 (2017)CrossRef
8.
go back to reference Ordóñez, F.J., Roggen, D.: Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1), 115 (2016)CrossRef Ordóñez, F.J., Roggen, D.: Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1), 115 (2016)CrossRef
9.
go back to reference Milenkoski, M., Trivodaliev, K., Kalajdziski, S., Jovanov, M., Stojkoska, B.R.: Real time human activity recognition on smartphones using LSTM Networks. In: MIPRO (2018) Milenkoski, M., Trivodaliev, K., Kalajdziski, S., Jovanov, M., Stojkoska, B.R.: Real time human activity recognition on smartphones using LSTM Networks. In: MIPRO (2018)
10.
go back to reference Stojkoska, B.R., Nikolovski, Z.: Data compression for energy efficient IoT solutions. In: 2017 25th Telecommunication Forum (TELFOR), pp. 1–4. IEEE (2017) Stojkoska, B.R., Nikolovski, Z.: Data compression for energy efficient IoT solutions. In: 2017 25th Telecommunication Forum (TELFOR), pp. 1–4. IEEE (2017)
11.
go back to reference Stojkoska, B.R., Trivodaliev, K.: Enabling internet of things for smart homes through fog computing. In: 2017 25th Telecommunication Forum (TELFOR), pp. 1–4. IEEE (2017) Stojkoska, B.R., Trivodaliev, K.: Enabling internet of things for smart homes through fog computing. In: 2017 25th Telecommunication Forum (TELFOR), pp. 1–4. IEEE (2017)
12.
go back to reference Stojkoska, B.L.R., Trivodaliev, K.V.: A review of internet of things for smart home: challenges and solutions. J. Cleaner Prod. 140, 1454–1464 (2017)CrossRef Stojkoska, B.L.R., Trivodaliev, K.V.: A review of internet of things for smart home: challenges and solutions. J. Cleaner Prod. 140, 1454–1464 (2017)CrossRef
13.
go back to reference Pollack, M.E., et al.: Autominder: an intelligent cognitive orthotic system for people with memory impairment. Robot. Auton. Syst. 44(3), 273–282 (2003)CrossRef Pollack, M.E., et al.: Autominder: an intelligent cognitive orthotic system for people with memory impairment. Robot. Auton. Syst. 44(3), 273–282 (2003)CrossRef
14.
go back to reference Yin, J., Yang, Q., Pan, J.J.: Sensor-based abnormal human-activity detection. IEEE Trans. Knowl. Data Eng. 20(8), 1082–1090 (2008)CrossRef Yin, J., Yang, Q., Pan, J.J.: Sensor-based abnormal human-activity detection. IEEE Trans. Knowl. Data Eng. 20(8), 1082–1090 (2008)CrossRef
15.
go back to reference Long, X., Yin, B., Aarts, R.M.: Single-accelerometer-based daily physical activity classification. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2009, EMBC 2009, pp. 6107–6110. IEEE (2009) Long, X., Yin, B., Aarts, R.M.: Single-accelerometer-based daily physical activity classification. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2009, EMBC 2009, pp. 6107–6110. IEEE (2009)
17.
go back to reference Kim, E., Helal, S., Cook, D.: Human activity recognition and pattern discovery. IEEE Pervasive Comput. 9(1), 48 (2010)CrossRef Kim, E., Helal, S., Cook, D.: Human activity recognition and pattern discovery. IEEE Pervasive Comput. 9(1), 48 (2010)CrossRef
18.
go back to reference Liu, X., Liu, L., Simske, S. J., Liu, J.: Human daily activity recognition for healthcare using wearable and visual sensing data. In: IEEE International Conference on Healthcare Informatics (ICHI), 2016, pp. 24–31. IEEE (2016) Liu, X., Liu, L., Simske, S. J., Liu, J.: Human daily activity recognition for healthcare using wearable and visual sensing data. In: IEEE International Conference on Healthcare Informatics (ICHI), 2016, pp. 24–31. IEEE (2016)
19.
go back to reference Yang, J.Y., Wang, J.S., Chen, Y.P.: Using acceleration measurements for activity recognition: an effective learning algorithm for constructing neural classifiers. Pattern Recognit. Lett. 29(16), 2213–2220 (2008)CrossRef Yang, J.Y., Wang, J.S., Chen, Y.P.: Using acceleration measurements for activity recognition: an effective learning algorithm for constructing neural classifiers. Pattern Recognit. Lett. 29(16), 2213–2220 (2008)CrossRef
20.
go back to reference Kwapisz, J.R., Weiss, G.M., Moore, S.A.: Activity recognition using cell phone accelerometers. ACM SigKDD Explor. Newslett. 12(2), 74–82 (2011)CrossRef Kwapisz, J.R., Weiss, G.M., Moore, S.A.: Activity recognition using cell phone accelerometers. ACM SigKDD Explor. Newslett. 12(2), 74–82 (2011)CrossRef
21.
go back to reference Zeng, M., et al.: Convolutional neural networks for human activity recognition using mobile sensors. In: 2014 6th International Conference on Mobile Computing, Applications and Services (MobiCASE), pp. 197–205. IEEE (2014) Zeng, M., et al.: Convolutional neural networks for human activity recognition using mobile sensors. In: 2014 6th International Conference on Mobile Computing, Applications and Services (MobiCASE), pp. 197–205. IEEE (2014)
22.
go back to reference Murad, A., Pyun, J.Y.: Deep recurrent neural networks for human activity recognition. Sensors 17(11), 2556 (2017)CrossRef Murad, A., Pyun, J.Y.: Deep recurrent neural networks for human activity recognition. Sensors 17(11), 2556 (2017)CrossRef
23.
go back to reference Anguita, D., Ghio, A., Oneto, L., Llanas Parra, F.X., Reyes Ortiz, J.L.: Energy efficient smartphone-based activity recognition using fixed-point arithmetic. J. Univ. Comput. Sci. 19(9), 1295–1314 (2013) Anguita, D., Ghio, A., Oneto, L., Llanas Parra, F.X., Reyes Ortiz, J.L.: Energy efficient smartphone-based activity recognition using fixed-point arithmetic. J. Univ. Comput. Sci. 19(9), 1295–1314 (2013)
24.
go back to reference Gordon, D., Czerny, J., Miyaki, T., Beigl, M.: Energy-efficient activity recognition using prediction. In: 2012 16th International Symposium on Wearable Computers (ISWC), pp. 29–36. IEEE, June 2012 Gordon, D., Czerny, J., Miyaki, T., Beigl, M.: Energy-efficient activity recognition using prediction. In: 2012 16th International Symposium on Wearable Computers (ISWC), pp. 29–36. IEEE, June 2012
25.
go back to reference Oneto, L., Ortiz, J.L., Anguita, D.: Constraint-aware data analysis on mobile devices: an application to human activity recognition on smartphones. In: Adaptive Mobile Computing, pp. 127–149 (2017) Oneto, L., Ortiz, J.L., Anguita, D.: Constraint-aware data analysis on mobile devices: an application to human activity recognition on smartphones. In: Adaptive Mobile Computing, pp. 127–149 (2017)
26.
go back to reference Stisen, A., et al.: Smart devices are different: assessing and mitigating mobile sensing heterogeneities for activity recognition. In: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys 2015), Seoul, Korea (2015) Stisen, A., et al.: Smart devices are different: assessing and mitigating mobile sensing heterogeneities for activity recognition. In: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys 2015), Seoul, Korea (2015)
28.
go back to reference Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
29.
go back to reference Gers, F.A., Schmidhuber, J., Cummins, F.: Learning to forget: continual prediction with LSTM. Neural Comput. 12(10), 2451–2471 (2000)CrossRef Gers, F.A., Schmidhuber, J., Cummins, F.: Learning to forget: continual prediction with LSTM. Neural Comput. 12(10), 2451–2471 (2000)CrossRef
30.
go back to reference Sainath, T.N., Vinyals, O., Senior, A., Sak, H.: Convolutional, long short-term memory, fully connected deep neural networks. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (Icassp), pp. 4580–4584. IEEE (2015) Sainath, T.N., Vinyals, O., Senior, A., Sak, H.: Convolutional, long short-term memory, fully connected deep neural networks. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (Icassp), pp. 4580–4584. IEEE (2015)
31.
go back to reference McGraw, I., et al.: Personalized speech recognition on mobile devices. In: 2016 IEEE International Conference on Acoustics, Speech And Signal Processing (ICASSP), pp. 5955–5959. IEEE (2016) McGraw, I., et al.: Personalized speech recognition on mobile devices. In: 2016 IEEE International Conference on Acoustics, Speech And Signal Processing (ICASSP), pp. 5955–5959. IEEE (2016)
32.
go back to reference Alsharif, O., Ouyang, T., Beaufays, F., Zhai, S., Breuel, T., Schalkwyk, J.: Long short term memory neural network for keyboard gesture decoding. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2076–2080. IEEE (2015) Alsharif, O., Ouyang, T., Beaufays, F., Zhai, S., Breuel, T., Schalkwyk, J.: Long short term memory neural network for keyboard gesture decoding. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2076–2080. IEEE (2015)
Metadata
Title
Framework for Human Activity Recognition on Smartphones and Smartwatches
Authors
Blagoj Mitrevski
Viktor Petreski
Martin Gjoreski
Biljana Risteska Stojkoska
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00825-3_8

Premium Partner