Skip to main content
Top

2015 | OriginalPaper | Chapter

aHead: Considering the Head Position in a Multi-sensory Setup of Wearables to Recognize Everyday Activities with Intelligent Sensor Fusions

Authors : Marian Haescher, John Trimpop, Denys J. C. Matthies, Gerald Bieber, Bodo Urban, Thomas Kirste

Published in: Human-Computer Interaction: Interaction Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we examine the feasibility of Human Activity Recognition (HAR) based on head mounted sensors, both as stand-alone sensors and as part of a wearable multi-sensory network. To prove the feasibility of such setting, an interactive online HAR-system has been implemented to enable for multi-sensory activity recognition while making use of a hierarchical sensor fusion. Our system incorporates 3 sensor positions distributed over the body, which are head (smart glasses), wrist (smartwatch), and hip (smartphone). We are able to reliably distinguish 7 daily activities, which are: resting, being active, walking, running, jumping, cycling and office work. The results of our field study with 14 participants clearly indicate that the head position is applicable for HAR. Moreover, we demonstrate an intelligent multi-sensory fusion concept that increases the recognition performance up to 86.13 % (recall). Furthermore, we found the head to possess very distinctive movement patterns regarding activities of daily living.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The classification accuracy and recall rate are equivalent, when considering multi class classification problems. As we talk about recall, this can be seen analogous to accuracy or overall classification rate. For further information to the measures, please refer to [6] or [11].
 
Literature
1.
go back to reference Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., Havinga, P.: Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In: Proceedings of Architecture of Computing Systems (ARCS), pp.1–10. VDE (2010) Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., Havinga, P.: Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey. In: Proceedings of Architecture of Computing Systems (ARCS), pp.1–10. VDE (2010)
2.
go back to reference Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. Pervasive Computing, pp. 1–17. Springer, Berlin Heidelberg (2004)CrossRef Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. Pervasive Computing, pp. 1–17. Springer, Berlin Heidelberg (2004)CrossRef
3.
go back to reference Bieber, G., Haescher, M., Vahl, M.: Sensor requirements for activity recognition on smart watches. In: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, 67. ACM (2013) Bieber, G., Haescher, M., Vahl, M.: Sensor requirements for activity recognition on smart watches. In: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, 67. ACM (2013)
4.
go back to reference Bieber, G., Luthardt, A., Peter, C., Urban, B. The hearing trousers pocket: activity recognition by alternative sensors. In Proceedings of PETRA, 44. ACM (2011) Bieber, G., Luthardt, A., Peter, C., Urban, B. The hearing trousers pocket: activity recognition by alternative sensors. In Proceedings of PETRA, 44. ACM (2011)
5.
go back to reference Bieber, G., Voskamp, J., Urban, B.: Activity recognition for everyday life on mobile phones. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 289–296. Springer, Heidelberg (2009) Bieber, G., Voskamp, J., Urban, B.: Activity recognition for everyday life on mobile phones. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 289–296. Springer, Heidelberg (2009)
6.
go back to reference Bulling, A., Blanke, U., Schiele, B.: A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput. Surv. (CSUR) 46(3), 1–33 (2014)CrossRef Bulling, A., Blanke, U., Schiele, B.: A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput. Surv. (CSUR) 46(3), 1–33 (2014)CrossRef
7.
go back to reference Ermes, M., Parkka, J., Cluitmans, L.: Advancing from offline to online activity recognition with wearable sensors. In: Proceedings of EMBS, pp. 4451–4454. IEEE (2008) Ermes, M., Parkka, J., Cluitmans, L.: Advancing from offline to online activity recognition with wearable sensors. In: Proceedings of EMBS, pp. 4451–4454. IEEE (2008)
8.
go back to reference Haescher, M., Bieber, G., Trimpop, J., Urban, B., Kirste, T., Salomon, R.: Recognition of Low Amplitude Body Vibrations via Inertial Sensors for Wearable Computing. In: Proceedings of Conference on IoT Technologies for HealthCare (HealthyIoT), Springer (2014) Haescher, M., Bieber, G., Trimpop, J., Urban, B., Kirste, T., Salomon, R.: Recognition of Low Amplitude Body Vibrations via Inertial Sensors for Wearable Computing. In: Proceedings of Conference on IoT Technologies for HealthCare (HealthyIoT), Springer (2014)
9.
go back to reference Hanheide, M., Bauckhage, C., Sagerer, G.: Combining environmental cues and head gestures to interact with wearable devices. In: Proceedings of the 7th international conference on Multimodal interfaces, pp. 25–31. ACM (2005) Hanheide, M., Bauckhage, C., Sagerer, G.: Combining environmental cues and head gestures to interact with wearable devices. In: Proceedings of the 7th international conference on Multimodal interfaces, pp. 25–31. ACM (2005)
10.
go back to reference Ishimaru, S., Kunze, K., Kise, K., Weppner, J., Dengel, A., Lukowicz, P., Bulling, A.: In the blink of an eye: combining head motion and eye blink frequency for activity recognition with google glass. In: Augmented Human International Conference. 15. ACM (2014) Ishimaru, S., Kunze, K., Kise, K., Weppner, J., Dengel, A., Lukowicz, P., Bulling, A.: In the blink of an eye: combining head motion and eye blink frequency for activity recognition with google glass. In: Augmented Human International Conference. 15. ACM (2014)
11.
go back to reference Lara, O.D., Labrador, M.A.: A survey on human activity recognition using wearable sensors. Commun. Surv. Tutorials IEEE 15(3), 1192–1209 (2013)CrossRef Lara, O.D., Labrador, M.A.: A survey on human activity recognition using wearable sensors. Commun. Surv. Tutorials IEEE 15(3), 1192–1209 (2013)CrossRef
12.
go back to reference Lindemann, U., Hock, A., Stuber, M., Keck, W., Becker, C.: Evaluation of a fall detector based on accelerometers: a pilot study. Med. Biol. Eng. Comput. 43(5), 548–551 (2005)CrossRef Lindemann, U., Hock, A., Stuber, M., Keck, W., Becker, C.: Evaluation of a fall detector based on accelerometers: a pilot study. Med. Biol. Eng. Comput. 43(5), 548–551 (2005)CrossRef
13.
go back to reference Madabhushi, A., Aggarwal, J.K.: Using head movement to recognize activity. In: Proceedings of 15th International Conference on Pattern Recognition vol. 4, pp. 698–701. IEEE (2000) Madabhushi, A., Aggarwal, J.K.: Using head movement to recognize activity. In: Proceedings of 15th International Conference on Pattern Recognition vol. 4, pp. 698–701. IEEE (2000)
14.
go back to reference Maurer, U., Smailagic, A., Siewiorek, D.P., Deisher, M.: Activity recognition and monitoring using multiple sensors on different body positions. In: International Workshop on Wearable and Implantable Body Sensor Networks. IEEE (2006) Maurer, U., Smailagic, A., Siewiorek, D.P., Deisher, M.: Activity recognition and monitoring using multiple sensors on different body positions. In: International Workshop on Wearable and Implantable Body Sensor Networks. IEEE (2006)
15.
go back to reference Menz, H.B., Lord, S.R., Fitzpatrick, R.C.: Age-related differences in walking stability. Age Ageing 32(2), 137–142 (2003)CrossRef Menz, H.B., Lord, S.R., Fitzpatrick, R.C.: Age-related differences in walking stability. Age Ageing 32(2), 137–142 (2003)CrossRef
16.
go back to reference Nam, Y., Rho, S., Lee, C.: Physical activity recognition using multiple sensors embedded in a wearable device. In Proceedings of TECS, 12(2), 26. ACM (2013) Nam, Y., Rho, S., Lee, C.: Physical activity recognition using multiple sensors embedded in a wearable device. In Proceedings of TECS, 12(2), 26. ACM (2013)
17.
go back to reference Peter, C., Bieber, G., Urban, B.: Affect-and behaviour-related assistance for families in the home environment. In: Proceedings of PETRA, 47. ACM (2010) Peter, C., Bieber, G., Urban, B.: Affect-and behaviour-related assistance for families in the home environment. In: Proceedings of PETRA, 47. ACM (2010)
18.
go back to reference Polikar, R.: Ensemble based systems in decision making. IEEE Circuits Syst. Mag. 6(3), 21–45 (2006)CrossRef Polikar, R.: Ensemble based systems in decision making. IEEE Circuits Syst. Mag. 6(3), 21–45 (2006)CrossRef
19.
go back to reference Windau, J., Itti, L.: Situation awareness via sensor-equipped eyeglasses. In: International Conference on Intelligent Robots and Systems (IROS), pp. 5674–5679. IEEE (2013) Windau, J., Itti, L.: Situation awareness via sensor-equipped eyeglasses. In: International Conference on Intelligent Robots and Systems (IROS), pp. 5674–5679. IEEE (2013)
20.
go back to reference Ward, J.A., Lukowicz, P., Troster, G., Starner, T.E.: Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1553–1567 (2006)CrossRef Ward, J.A., Lukowicz, P., Troster, G., Starner, T.E.: Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1553–1567 (2006)CrossRef
21.
go back to reference Yang, C.C., Hsu, Y.L.: A review of accelerometry-based wearable motion detectors for physical activity monitoring. Sensors 10(8), 7772–7788 (2010)CrossRef Yang, C.C., Hsu, Y.L.: A review of accelerometry-based wearable motion detectors for physical activity monitoring. Sensors 10(8), 7772–7788 (2010)CrossRef
22.
go back to reference Zhang, M., Sawchuk, A.A.: A feature selection-based framework for human activity recognition using wearable multimodal sensors. In: Proceedings of the 6th International Conference on Body Area Networks, pp. 92–98 (2011) Zhang, M., Sawchuk, A.A.: A feature selection-based framework for human activity recognition using wearable multimodal sensors. In: Proceedings of the 6th International Conference on Body Area Networks, pp. 92–98 (2011)
23.
go back to reference Zappi, P., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., Tröster, G.: Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness. In: Conference on Intelligent Sensors, Sensor Networks and Information, pp. 281–286. IEEE (2007) Zappi, P., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., Tröster, G.: Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness. In: Conference on Intelligent Sensors, Sensor Networks and Information, pp. 281–286. IEEE (2007)
Metadata
Title
aHead: Considering the Head Position in a Multi-sensory Setup of Wearables to Recognize Everyday Activities with Intelligent Sensor Fusions
Authors
Marian Haescher
John Trimpop
Denys J. C. Matthies
Gerald Bieber
Bodo Urban
Thomas Kirste
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-20916-6_68