Skip to main content
Top
Published in: Microsystem Technologies 6/2020

09-01-2020 | Technical Paper

Novel features for intensive human activity recognition based on wearable and smartphone sensors

Authors: Asmita Nandy, Jayita Saha, Chandreyee Chowdhury

Published in: Microsystem Technologies | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

On the lap of this modern era, human activity recognition (HAR) has been of great help in case of health monitoring and rehabilitation. Existing works mostly use one or more specific devices (with embedded sensors) including smartphones for activity recognition and most of the time the detected activities are coarse grained like sit or walk rather than detailed and intensive like sit carrying weight or walk carrying weight. But, intensity of activities reflects valuable insight about a person’s health and more importantly, physical exertion for performing those activities. Consequently, in this paper, we propose an intense activity recognition framework that combines features from smartphone accelerometer (available in almost every smartphone) and that from wearable heartrate sensor. We introduce a set of novel heartrate features that takes into consideration finer variation of heartrate as compared to the resting heartrate of an individual. The proposed framework forms an ensemble model based on different classifiers to address the challenge of usage behavior in terms of how the smartphone is carried. The stack generalization based ensemble model predicts the intensity of activity. We have implemented the framework and tested for a real dataset collected from four users. We have observed that our work is able to identify both static and dynamic intense activities with 96% accuracy, and even found to be better than state of the art techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Acharjee D, Mukherjee A, Mandal JK, Mukherjee N (2016) Activity recognition system using inbuilt sensors of smart mobile phone and minimizing feature vectors. Microsyst Technol 22(11):2715–2722CrossRef Acharjee D, Mukherjee A, Mandal JK, Mukherjee N (2016) Activity recognition system using inbuilt sensors of smart mobile phone and minimizing feature vectors. Microsyst Technol 22(11):2715–2722CrossRef
go back to reference Adi E, Yeh CI, Chou N, Lee MW, Lin YH (2016) Integrated wearable system for monitoring heart rate and step during physical activity. Mob Inf Syst 2016:1–10 Adi E, Yeh CI, Chou N, Lee MW, Lin YH (2016) Integrated wearable system for monitoring heart rate and step during physical activity. Mob Inf Syst 2016:1–10
go back to reference Altin C, Er O (2016) Comparison of different time and frequency domain feature extraction methods on elbow gesture’s emg. Eur J Interdiscip Stud 5:35CrossRef Altin C, Er O (2016) Comparison of different time and frequency domain feature extraction methods on elbow gesture’s emg. Eur J Interdiscip Stud 5:35CrossRef
go back to reference Banerjee T, Keller JM, Skubic M, Stone E (2014) Day or night activity recognition from video using fuzzy clustering techniques. IEEE Trans Fuzzy Syst 22(3):483–493CrossRef Banerjee T, Keller JM, Skubic M, Stone E (2014) Day or night activity recognition from video using fuzzy clustering techniques. IEEE Trans Fuzzy Syst 22(3):483–493CrossRef
go back to reference Choudhury T, Borriello G, Consolvo S, Haehnel D, Harrison B, Hemingway B, Hightower J, Klasnja P, Koscher K, LaMarca A, Landay JA, LeGrand L, Lester J, Rahimi A, Rea A, Wyatt D (2008) The mobile sensing platform: an embedded activity recognition system. IEEE Pervasive Comput 7(2):32–41CrossRef Choudhury T, Borriello G, Consolvo S, Haehnel D, Harrison B, Hemingway B, Hightower J, Klasnja P, Koscher K, LaMarca A, Landay JA, LeGrand L, Lester J, Rahimi A, Rea A, Wyatt D (2008) The mobile sensing platform: an embedded activity recognition system. IEEE Pervasive Comput 7(2):32–41CrossRef
go back to reference Coskun D, Incel OD, Ozgovde A (2015) Phone position/placement detection using accelerometer: impact on activity recognition. In: 2015 IEEE 10th international conference on intelligent sensors, sensor networks and information processing (ISSNIP), pp 1–6 Coskun D, Incel OD, Ozgovde A (2015) Phone position/placement detection using accelerometer: impact on activity recognition. In: 2015 IEEE 10th international conference on intelligent sensors, sensor networks and information processing (ISSNIP), pp 1–6
go back to reference Curone D, Tognetti A, Secco EL, Anania G, Carbonaro N, De Rossi D, Magenes G (2010) Heart rate and accelerometer data fusion for activity assessment of rescuers during emergency interventions. IEEE Trans Inf Technol Biomed 14(3):702–710CrossRef Curone D, Tognetti A, Secco EL, Anania G, Carbonaro N, De Rossi D, Magenes G (2010) Heart rate and accelerometer data fusion for activity assessment of rescuers during emergency interventions. IEEE Trans Inf Technol Biomed 14(3):702–710CrossRef
go back to reference Goldberger A, Amaral L, Glass L, Havlin S, M Hausdorg J, Ivanov P, G Mark R, E Mietus J, B Moody G, Peng CK, Stanley H, Physiobank P (2000) Components of a new research resource for complex physiologic signals. PhysioNet 101 Goldberger A, Amaral L, Glass L, Havlin S, M Hausdorg J, Ivanov P, G Mark R, E Mietus J, B Moody G, Peng CK, Stanley H, Physiobank P (2000) Components of a new research resource for complex physiologic signals. PhysioNet 101
go back to reference Gupta P, Dallas T (2014) Feature selection and activity recognition system using a single triaxial accelerometer. IEEE Trans Biomed Eng 61(6):1780–1786CrossRef Gupta P, Dallas T (2014) Feature selection and activity recognition system using a single triaxial accelerometer. IEEE Trans Biomed Eng 61(6):1780–1786CrossRef
go back to reference Janidarmian M, Roshan Fekr A, Radecka K, Zilic Z (2017) A comprehensive analysis on wearable acceleration sensors in human activity recognition. Sensors 17:529CrossRef Janidarmian M, Roshan Fekr A, Radecka K, Zilic Z (2017) A comprehensive analysis on wearable acceleration sensors in human activity recognition. Sensors 17:529CrossRef
go back to reference Lau SL, König I, David K, Parandian B, Carius-Düssel C, Schultz M (2010) Supporting patient monitoring using activity recognition with a smartphone. In: 2010 7th International symposium on wireless communication systems, pp 810–814 Lau SL, König I, David K, Parandian B, Carius-Düssel C, Schultz M (2010) Supporting patient monitoring using activity recognition with a smartphone. In: 2010 7th International symposium on wireless communication systems, pp 810–814
go back to reference LeeHeyone J, Oh KH, Do JC, Nam CW, Hwang DH, Lee SJ (2019) Angular velocity estimation of rotating plate using extended kalman filter with accelerometer bias model. Microsyst Technol 25:2855–2867CrossRef LeeHeyone J, Oh KH, Do JC, Nam CW, Hwang DH, Lee SJ (2019) Angular velocity estimation of rotating plate using extended kalman filter with accelerometer bias model. Microsyst Technol 25:2855–2867CrossRef
go back to reference Mehrang S, Pietila J, Korhonen I (2018) An activity recognition framework deploying the random forest classifier and a single optical heart rate monitoring and triaxial accelerometer wrist-band. Sensors (Basel) 18(2):613CrossRef Mehrang S, Pietila J, Korhonen I (2018) An activity recognition framework deploying the random forest classifier and a single optical heart rate monitoring and triaxial accelerometer wrist-band. Sensors (Basel) 18(2):613CrossRef
go back to reference Park H, Dong S, Lee M, Youn I (2017) The role of heart-rate variability parameters in activity recognition and energy-expenditure estimation using wearable sensors. Sensors (Basel) 17(7):1698CrossRef Park H, Dong S, Lee M, Youn I (2017) The role of heart-rate variability parameters in activity recognition and energy-expenditure estimation using wearable sensors. Sensors (Basel) 17(7):1698CrossRef
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, VanderPlas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2012) Scikit-learn: machine learning in python. arXiv:abs/1201.0490 Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, VanderPlas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2012) Scikit-learn: machine learning in python. arXiv:​abs/​1201.​0490
go back to reference Powers D (2008) Evaluation: from precision, recall and f-factor to roc, informedness, markedness and correlation. Mach Learn Technol 2 Powers D (2008) Evaluation: from precision, recall and f-factor to roc, informedness, markedness and correlation. Mach Learn Technol 2
go back to reference RoyChowdhury I, Saha J, Chowdhury C (2018) Detailed activity recognition with smartphones. In: 2018 5th International conference on emerging applications of information technology (EAIT), pp 1–4 RoyChowdhury I, Saha J, Chowdhury C (2018) Detailed activity recognition with smartphones. In: 2018 5th International conference on emerging applications of information technology (EAIT), pp 1–4
go back to reference Saha J, Chowdhury C, Biswas S (2018a) Two phase ensemble classifier for smartphone based human activity recognition independent of hardware configuration and usage behaviour. Microsyst Technol 24(6):2737–2752CrossRef Saha J, Chowdhury C, Biswas S (2018a) Two phase ensemble classifier for smartphone based human activity recognition independent of hardware configuration and usage behaviour. Microsyst Technol 24(6):2737–2752CrossRef
go back to reference Saha J, Chowdhury C, Chowdhury IR, Biswas S, Aslam N (2018b) An ensemble of condition based classifiers for device independent detailed human activity recognition using smartphones. Information 9:94CrossRef Saha J, Chowdhury C, Chowdhury IR, Biswas S, Aslam N (2018b) An ensemble of condition based classifiers for device independent detailed human activity recognition using smartphones. Information 9:94CrossRef
go back to reference Shany T, Redmond SJ, Narayanan MR, Lovell NH (2012) Sensors-based wearable systems for monitoring of human movement and falls. IEEE Sens J 12(3):658–670CrossRef Shany T, Redmond SJ, Narayanan MR, Lovell NH (2012) Sensors-based wearable systems for monitoring of human movement and falls. IEEE Sens J 12(3):658–670CrossRef
go back to reference Tapia EM, Intille SS, Haskell W, Larson K, Wright J, King A, Friedman R (2007) Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: 2007 11th IEEE international symposium on wearable computers, pp 37–40 Tapia EM, Intille SS, Haskell W, Larson K, Wright J, King A, Friedman R (2007) Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: 2007 11th IEEE international symposium on wearable computers, pp 37–40
go back to reference Zhou ZH (2015) Ensemble learning. Springer, Boston, pp 411–416 Zhou ZH (2015) Ensemble learning. Springer, Boston, pp 411–416
Metadata
Title
Novel features for intensive human activity recognition based on wearable and smartphone sensors
Authors
Asmita Nandy
Jayita Saha
Chandreyee Chowdhury
Publication date
09-01-2020
Publisher
Springer Berlin Heidelberg
Published in
Microsystem Technologies / Issue 6/2020
Print ISSN: 0946-7076
Electronic ISSN: 1432-1858
DOI
https://doi.org/10.1007/s00542-019-04738-z

Other articles of this Issue 6/2020

Microsystem Technologies 6/2020 Go to the issue