Skip to main content
Top
Published in: Neural Processing Letters 6/2021

09-08-2021

Time Analysis in Human Activity Recognition

Authors: Manuel Gil-Martín, Rubén San-Segundo, Fernando Fernández-Martínez, Javier Ferreiros-López

Published in: Neural Processing Letters | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Continuous human activity recognition from inertial signals is performed by splitting these temporal signals into time windows and identifying the activity in each window. Defining the appropriate window duration has been the target of several previous works. In most of these analyses, the recognition performance increases with the windows duration until an optimal value and decreases or saturates for longer windows. This paper evaluates several strategies to combine sub-window information inside a window, obtaining important improvements for long windows. This evaluation was performed using a state-of-the-art human activity recognition system based on Convolutional Neural Networks (CNNs). This deep neural network includes convolutional layers to learn features from signal spectra and additional fully connected layers to classify the activity at each window. All the analyses were carried out using two public datasets (PAMAP2 and USC-HAD) and a Leave-One-Subject-Out (LOSO) cross-validation. For 10-s windows, the accuracy increased from 90.1 (± 0.66) to 94.27 (± 0.46) in PAMAP2 and from 80.54 (± 0.73) to 84.46 (± 0.67) in USC-HAD. For 20-s windows, the improvements were from 92.66 (± 0.58) to 96.35 (± 0.38) (PAMAP2) and from 78.39 (± 0.76) to 86.36 (± 0.57) (USC-HAD).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Fang H, Hu C (2014) Recognizing Human Activity in Smart Home Using Deep Learning algorithm. In 33rd Chinese Control Conference (CCC), Nanjing, Peoples of Pepublic China, 2014. Jul 28–30 2014, in Chinese Control Conference, pp 4716–4720. [Online]. Available: <Go to ISI>://WOS:000366482804147 Fang H, Hu C (2014) Recognizing Human Activity in Smart Home Using Deep Learning algorithm. In 33rd Chinese Control Conference (CCC), Nanjing, Peoples of Pepublic China, 2014. Jul 28–30 2014, in Chinese Control Conference, pp 4716–4720. [Online]. Available: <Go to ISI>://WOS:000366482804147
6.
go back to reference Neto et al. (2016) Recognition of Human Activities using the User's Context and the Activity Theory for Risk Prediction. (in English), Proceedings of the 18th International Conference on Enterprise Information Systems, Vol 2 (Iceis), Proceedings Paper pp 282–289 https://doi.org/10.5220/0005832202820289. Neto et al. (2016) Recognition of Human Activities using the User's Context and the Activity Theory for Risk Prediction. (in English), Proceedings of the 18th International Conference on Enterprise Information Systems, Vol 2 (Iceis), Proceedings Paper pp 282–289 https://​doi.​org/​10.​5220/​0005832202820289​.
9.
go back to reference Gil-Martín M, Antúnez-Durango J, San-Segundo R (2020) Adaptation and selection techniques based on deep learning for human activity recognition using inertial sensors. Eng Proceed 2(1):22 Gil-Martín M, Antúnez-Durango J, San-Segundo R (2020) Adaptation and selection techniques based on deep learning for human activity recognition using inertial sensors. Eng Proceed 2(1):22
13.
go back to reference Lin CY, Chen BY, Wu WC, Lin EY, Tsai CL (2015) Human Action Recognition Based on Non-negative Matrix Factorization. In Asia-Pacific-Signal-and-Information-Processing-Association Annual Summit and Conference (APSIPA ASC), Hong Kong, Peoples Rebublic of China. In Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2015, pp 1091-1093. [Online]. Available: <Go to ISI>://WOS:000382954100206 Lin CY, Chen BY, Wu WC, Lin EY, Tsai CL (2015) Human Action Recognition Based on Non-negative Matrix Factorization. In Asia-Pacific-Signal-and-Information-Processing-Association Annual Summit and Conference (APSIPA ASC), Hong Kong, Peoples Rebublic of China. In Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2015, pp 1091-1093. [Online]. Available: <Go to ISI>://WOS:000382954100206
17.
go back to reference Reiss A, and Stricker D (2012) "Creating and benchmarking a new dataset for physical activity monitoring. Presented at the Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments, Heraklion, Crete, Greece, [Online]. Available: https://doi.org/10.1145/2413097.2413148. Reiss A, and Stricker D (2012) "Creating and benchmarking a new dataset for physical activity monitoring. Presented at the Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments, Heraklion, Crete, Greece, [Online]. Available: https://​doi.​org/​10.​1145/​2413097.​2413148.
22.
go back to reference Abdel-Salam R, Mostafa R, and Hadhood M (2021) Human activity recognition using wearable sensors: review, challenges, evaluation benchmark. p. arXiv:2101.01665 Abdel-Salam R, Mostafa R, and Hadhood M (2021) Human activity recognition using wearable sensors: review, challenges, evaluation benchmark. p. arXiv:​2101.​01665
23.
go back to reference Tanjid Hasan Tonmoy M, Mahmud S, Mahbubur Rahman AKM, Ashraful Amin M, and Ali AA, Hierarchical self attention based autoencoder for open-set human activity recognition. p. arXiv:2103.04279 Tanjid Hasan Tonmoy M, Mahmud S, Mahbubur Rahman AKM, Ashraful Amin M, and Ali AA, Hierarchical self attention based autoencoder for open-set human activity recognition. p. arXiv:​2103.​04279
24.
go back to reference Mahmud S et al. (2020) Human activity recognition from wearable sensor data using self-attention. p. arXiv:2003.09018 Mahmud S et al. (2020) Human activity recognition from wearable sensor data using self-attention. p. arXiv:​2003.​09018
27.
go back to reference Pirttikangas S, Fujinami K, Nakajima T (2006) Feature selection and activity recognition from wearable sensors. Ubiquitous Comput Syst, Proceed 4239:516–527CrossRef Pirttikangas S, Fujinami K, Nakajima T (2006) Feature selection and activity recognition from wearable sensors. Ubiquitous Comput Syst, Proceed 4239:516–527CrossRef
28.
go back to reference Stikic M, Huynh T, Van Laerhoven K, Schiele B (2008) ADL Recognition Based on the Combination of RFID and Accelerometer Sensing. 2008 2nd International Conference on Pervasive Computing Technologies for Healthcare. pp 245 Stikic M, Huynh T, Van Laerhoven K, Schiele B (2008) ADL Recognition Based on the Combination of RFID and Accelerometer Sensing. 2008 2nd International Conference on Pervasive Computing Technologies for Healthcare. pp 245
29.
go back to reference Sun L, Zhang D, Li B, Guo B, and Li S (2010) Activity recognition on an accelerometer embedded mobile phone with varying positions and orientations. Ubiquitous Intelligence and Computing, vol. 6406, p 548 Sun L, Zhang D, Li B, Guo B, and Li S (2010) Activity recognition on an accelerometer embedded mobile phone with varying positions and orientations. Ubiquitous Intelligence and Computing, vol. 6406, p 548
32.
go back to reference Zhang M, Sawchuk AA, and Assoc Comp M (2012) USC-HAD: A daily activity dataset for ubiquitous activity recognition using wearable sensors. Ubicomp'12: Proceedings of the 2012 Acm International Conference on Ubiquitous Computing pp 1036–1043 Zhang M, Sawchuk AA, and Assoc Comp M (2012) USC-HAD: A daily activity dataset for ubiquitous activity recognition using wearable sensors. Ubicomp'12: Proceedings of the 2012 Acm International Conference on Ubiquitous Computing pp 1036–1043
34.
35.
Metadata
Title
Time Analysis in Human Activity Recognition
Authors
Manuel Gil-Martín
Rubén San-Segundo
Fernando Fernández-Martínez
Javier Ferreiros-López
Publication date
09-08-2021
Publisher
Springer US
Published in
Neural Processing Letters / Issue 6/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10611-w

Other articles of this Issue 6/2021

Neural Processing Letters 6/2021 Go to the issue