Skip to main content
Erschienen in: Soft Computing 9/2015

01.09.2015 | Focus

Unsupervised template discovery in activity recognition using the Gamma Growing Neural Gas algorithm

verfasst von: Héctor F. Satizábal, Andres Perez-Uribe

Erschienen in: Soft Computing | Ausgabe 9/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Activity recognition is gaining a lot of interest given its direct use in applications like ambient assisted living and has been empowered by the increasing ubiquity of sensors (e.g., clothes, smartphones, watches). The machine learning approach to activity recognition consists on finding the signatures characterizing the activities to be recognized, with the hope of identifying them (pattern matching) within the stream of sensor data. The finding of those signatures can be very complex, thus many approaches deal with the streams of sensor data by segmenting them into sections or “time-windows”, before processing them by a feature extraction procedure. The problem then concerns the association of features to class labels. In this paper, we propose the use of the Gamma Growing Neural Gas algorithm to unsupervisely discover templates in a recording containing gestures performed by a person in a home environment. The system is able to do vector quantization from the time-series of data coming from one accelerometer, and finds salient patterns (e.g., templates) in the signal. These templates integrate information not only from single time-windows but do consider the recent history of the incoming signal (e.g., multiple time-windows). Those templates are then associated to activity classes by supervised learning. Our experiments show that the resulting performance is better than previous benchmarks of the same database.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
A collection of snapshots of the person or images of an avatar performing the activity.
 
2
Since a longer portion of the signal is available, no features characterizing the dynamics of the signal within long time-windows are needed.
 
3
The IMU includes a three-axial accelerometer and a three-axial gyroscope sampled at 102.4 Hz.
 
4
The dataset contains the execution of other strokes e.g., forehand and backhand topspin, forehand and backhand block.
 
5
See (Estévez and Hernández 2011) for the description of each parameter.
 
6
We computed the best matching unit (BMU) for each point in the dataset.
 
7
The performance of the detection of the null class was not evaluated since this class is much more frequent in the dataset. The performance of the system is overestimated if the null class is considered in the evaluation of the weighted \(F1\)-score.
 
Literatur
Zurück zum Zitat Baños O, Damas M, Pomares H, Rojas I, Tóth MA, Amft O (2012) A benchmark dataset to evaluate sensor displacement in activity recognition. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp ’12, New York, ACM, pp. 1026–1035. doi:10.1145/2370216.2370437 (ISBN 978-1-4503-1224-0) Baños O, Damas M, Pomares H, Rojas I, Tóth MA, Amft O (2012) A benchmark dataset to evaluate sensor displacement in activity recognition. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp ’12, New York, ACM, pp. 1026–1035. doi:10.​1145/​2370216.​2370437 (ISBN 978-1-4503-1224-0)
Zurück zum Zitat Baños O, Damas M, Pomares H, Rojas I (2013) Activity recognition based on a multi-sensor meta-classifier. In: Rojas I, Joya G, Cabestany J (eds) Advances in computational Intelligence, volume 7903 of Lecture Notes in Computer Science. Springer, Heidelberg, pp. 208–215. doi:10.1007/978-3-642-38682-4_24 (ISBN 978-3-642-38681-7) Baños O, Damas M, Pomares H, Rojas I (2013) Activity recognition based on a multi-sensor meta-classifier. In: Rojas I, Joya G, Cabestany J (eds) Advances in computational Intelligence, volume 7903 of Lecture Notes in Computer Science. Springer, Heidelberg, pp. 208–215. doi:10.​1007/​978-3-642-38682-4_​24 (ISBN 978-3-642-38681-7)
Zurück zum Zitat Browne G, Berry E, Narinder K, Hodges S, Smyth G, Watson P, Wood K (2011) Sensecam improves memory for recent events and quality of life in a patient with memory retrieval difficulties. Memory 19(7):713–722CrossRef Browne G, Berry E, Narinder K, Hodges S, Smyth G, Watson P, Wood K (2011) Sensecam improves memory for recent events and quality of life in a patient with memory retrieval difficulties. Memory 19(7):713–722CrossRef
Zurück zum Zitat Bulling A, Blanke U, Schiele B (2014) A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput Surv 46:1–33 Bulling A, Blanke U, Schiele B (2014) A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput Surv 46:1–33
Zurück zum Zitat Chavarriaga R, Bayati H, Del Millán J (2013) Unsupervised adaptation for acceleration-based activity recognition: Robustness to sensor displacement and rotation. Pers Ubiquitous Comput 17(3):479–490. doi:10.1007/s00779-011-0493-y (ISSN 1617–4909) Chavarriaga R, Bayati H, Del Millán J (2013) Unsupervised adaptation for acceleration-based activity recognition: Robustness to sensor displacement and rotation. Pers Ubiquitous Comput 17(3):479–490. doi:10.​1007/​s00779-011-0493-y (ISSN 1617–4909)
Zurück zum Zitat Delachaux B, Rebetez J, Perez-Uribe A, Satizábal HF (2013) Indoor activity recognition by combining one-vs-all neural network classifiers exploiting wearable and depth sensors. In: Proceedings of the International Work-Conference. on Artificial Neural Networks. Springer, Heidelberg, pp 216–223 Delachaux B, Rebetez J, Perez-Uribe A, Satizábal HF (2013) Indoor activity recognition by combining one-vs-all neural network classifiers exploiting wearable and depth sensors. In: Proceedings of the International Work-Conference. on Artificial Neural Networks. Springer, Heidelberg, pp 216–223
Zurück zum Zitat Estévez PA, Hernández R (2011) Gamma-filter self-organizing neural networks for time series analysis. In: Laaksonen J, Honkela T (eds) Advances in self-organizing maps, volume 6731 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pp 151–159. doi:10.1007/978-3-642-21566-7_15 (ISBN 978-3-642-21565-0) Estévez PA, Hernández R (2011) Gamma-filter self-organizing neural networks for time series analysis. In: Laaksonen J, Honkela T (eds) Advances in self-organizing maps, volume 6731 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pp 151–159. doi:10.​1007/​978-3-642-21566-7_​15 (ISBN 978-3-642-21565-0)
Zurück zum Zitat Fritzke B (1995) A growing neural gas network learns topologies. In: Tesauro G, Touretzky DS, Leen TK (eds) Advances in Neural Information Processing Systems 7. MIT Press, Cambridge, pp 625–632 Fritzke B (1995) A growing neural gas network learns topologies. In: Tesauro G, Touretzky DS, Leen TK (eds) Advances in Neural Information Processing Systems 7. MIT Press, Cambridge, pp 625–632
Zurück zum Zitat Hartmann B, Link N (2010) Gesture recognition with inertial sensors and optimized dtw prototypes. In: Systems Man and Cybernetics (SMC), 2010 IEEE International Conferenc. pp 2102–2109. doi:10.1109/ICSMC.2010.5641703 Hartmann B, Link N (2010) Gesture recognition with inertial sensors and optimized dtw prototypes. In: Systems Man and Cybernetics (SMC), 2010 IEEE International Conferenc. pp 2102–2109. doi:10.​1109/​ICSMC.​2010.​5641703
Zurück zum Zitat Hondori HM, Khademi M, Lopes CV (2012) Monitoring intake gestures using sensor fusion (microsoft kinect and inertial sensors) for smart home tele-rehab setting. In: IEEE HIC 2012 Engineering in Medicine and Biology Society Conference on Healthcare Innovation. Hondori HM, Khademi M, Lopes CV (2012) Monitoring intake gestures using sensor fusion (microsoft kinect and inertial sensors) for smart home tele-rehab setting. In: IEEE HIC 2012 Engineering in Medicine and Biology Society Conference on Healthcare Innovation.
Zurück zum Zitat Kasteren TLM, Englebienne G, Kröse BJA (2011) Human activity recognition from wireless sensor network data: Benchmark and software. In: Chen L, Nugent CD, Biswas J, Hoey J (eds) Activity recognition in pervasive intelligent environments, volume 4 of Atlantis Ambient and Pervasive Intelligence. Atlantis Press, pp. 165–186. doi:10.2991/978-94-91216-05-3_8 (ISBN 978-90-78677-42-0) Kasteren TLM, Englebienne G, Kröse BJA (2011) Human activity recognition from wireless sensor network data: Benchmark and software. In: Chen L, Nugent CD, Biswas J, Hoey J (eds) Activity recognition in pervasive intelligent environments, volume 4 of Atlantis Ambient and Pervasive Intelligence. Atlantis Press, pp. 165–186. doi:10.​2991/​978-94-91216-05-3_​8 (ISBN 978-90-78677-42-0)
Zurück zum Zitat Kepski M, Kwolek B (2012) Fall detection on embedded platform using kinect and wireless accelerometer. In: Proceedings of the 13th International Conference on Computers Helping People with Special Needs— Volume Part II, ICCHP’12. Springer, Heidelberg, pp. 407–414. doi:10.1007/978-3-642-31534-3_60 (ISBN 978-3-642-31533-6) Kepski M, Kwolek B (2012) Fall detection on embedded platform using kinect and wireless accelerometer. In: Proceedings of the 13th International Conference on Computers Helping People with Special Needs— Volume Part II, ICCHP’12. Springer, Heidelberg, pp. 407–414. doi:10.​1007/​978-3-642-31534-3_​60 (ISBN 978-3-642-31533-6)
Zurück zum Zitat Leppanen J, Eronen A (2013) Accelerometer-based activity recognition on a mobile phone using cepstral features and quantized gmms. In: Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference. pp 3487–3491. doi:10.1109/ICASSP.2013.6638306 Leppanen J, Eronen A (2013) Accelerometer-based activity recognition on a mobile phone using cepstral features and quantized gmms. In: Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference. pp 3487–3491. doi:10.​1109/​ICASSP.​2013.​6638306
Zurück zum Zitat Lukowicz P, Pirkl G, Bannach D, Wagner F, Calatroni A, Förster K, Holleczek T, Rossi M, Roggen D, Tröster G, Doppler J, Holzmann C, Riener A, Ferscha A, Chavarriaga R (2010) Recording a complex, multi modal activity data set for context recognition. In: ARCS Workshops, pp 161–166 Lukowicz P, Pirkl G, Bannach D, Wagner F, Calatroni A, Förster K, Holleczek T, Rossi M, Roggen D, Tröster G, Doppler J, Holzmann C, Riener A, Ferscha A, Chavarriaga R (2010) Recording a complex, multi modal activity data set for context recognition. In: ARCS Workshops, pp 161–166
Zurück zum Zitat Nguyen-Dinh L-V , Roggen D, Calatroni A, Troster G (2012) Improving online gesture recognition with template matching methods in accelerometer data. In: Intelligent Systems Design and Applications (ISDA), 2012 12th International Conference on, pp 831–836. doi:10.1109/ISDA.2012.6416645 Nguyen-Dinh L-V , Roggen D, Calatroni A, Troster G (2012) Improving online gesture recognition with template matching methods in accelerometer data. In: Intelligent Systems Design and Applications (ISDA), 2012 12th International Conference on, pp 831–836. doi:10.​1109/​ISDA.​2012.​6416645
Zurück zum Zitat Ni B, Wang G, Moulin P (2013) Rgbd-hudaact: A color-depth video database for human daily activity recognition. In: Fossati A, Gall J, Grabner H, Ren X, Konolige K (eds) Consumer depth cameras for computer vision, Advances in computer vision and pattern recognition. Springer, London, pp 193–208. doi:10.1007/978-1-4471-4640-7_10 (ISBN 978-1-4471-4639-1) Ni B, Wang G, Moulin P (2013) Rgbd-hudaact: A color-depth video database for human daily activity recognition. In: Fossati A, Gall J, Grabner H, Ren X, Konolige K (eds) Consumer depth cameras for computer vision, Advances in computer vision and pattern recognition. Springer, London, pp 193–208. doi:10.​1007/​978-1-4471-4640-7_​10 (ISBN 978-1-4471-4639-1)
Zurück zum Zitat Principe JC, de Vries B, de Oliveira PG (1993) The gamma-filter-a new class of adaptive iir filters with restricted feedback. Trans Sig Proc 41(2):649–656. doi:10.1109/78.193206 (ISSN 1053–587X) Principe JC, de Vries B, de Oliveira PG (1993) The gamma-filter-a new class of adaptive iir filters with restricted feedback. Trans Sig Proc 41(2):649–656. doi:10.​1109/​78.​193206 (ISSN 1053–587X)
Zurück zum Zitat Rawassizadeh R, Tomitsch M, Wac K, Min Tjoa A (2013) Ubiqlog: a generic mobile phone-based life-log framework. Personal and Ubiquitous Computing, 17(4):621–637. doi:10.1007/s00779-012-0511-8 (ISSN 1617–4909) Rawassizadeh R, Tomitsch M, Wac K, Min Tjoa A (2013) Ubiqlog: a generic mobile phone-based life-log framework. Personal and Ubiquitous Computing, 17(4):621–637. doi:10.​1007/​s00779-012-0511-8 (ISSN 1617–4909)
Zurück zum Zitat Rebetez J, Satizábal HF, Perez-Uribe A (2013) Reducing user intervention in incremental activityrecognition for assistive technologies. In: Proceedings of the 2013 International Symposium on Wearable Computers, ISWC ’13. New York. ACM. pp 29–32. doi:10.1145/2493988.2494350 (ISBN 978-1-4503-2127-3) Rebetez J, Satizábal HF, Perez-Uribe A (2013) Reducing user intervention in incremental activityrecognition for assistive technologies. In: Proceedings of the 2013 International Symposium on Wearable Computers, ISWC ’13. New York. ACM. pp 29–32. doi:10.​1145/​2493988.​2494350 (ISBN 978-1-4503-2127-3)
Zurück zum Zitat Van Rijsbergen CJ (1979) Information Retrieval. 2nd edn. Butterworth-Heinemann, Newton (ISBN 0408709294) Van Rijsbergen CJ (1979) Information Retrieval. 2nd edn. Butterworth-Heinemann, Newton (ISBN 0408709294)
Zurück zum Zitat Roggen D, Calatroni A, Rossi M, Holleczek T, Förster K, Tröster G, Lukowicz P, Bannach D, Pirkl G, Ferscha A, Doppler J, Holzmann C, Kurz M, Holl G, Chavarriaga R, Sagha H, Bayati H, Creatura M, Millán JR (2010) Collecting complex activity datasets in highly rich networked sensor environments. In: Networked Sensing Systems (INSS), 2010 Seventh International Conference on, pp 233–240. doi:10.1109/INSS.2010.5573462 Roggen D, Calatroni A, Rossi M, Holleczek T, Förster K, Tröster G, Lukowicz P, Bannach D, Pirkl G, Ferscha A, Doppler J, Holzmann C, Kurz M, Holl G, Chavarriaga R, Sagha H, Bayati H, Creatura M, Millán JR (2010) Collecting complex activity datasets in highly rich networked sensor environments. In: Networked Sensing Systems (INSS), 2010 Seventh International Conference on, pp 233–240. doi:10.​1109/​INSS.​2010.​5573462
Zurück zum Zitat Sagha H, Digumarti ST, Millán JR, Chavarriaga R, Calatroni A, Roggen D, Tröster G (2011) Benchmarking classification techniques using the Opportunity human activity dataset. In: 2011 Ieee International Conference On Systems, Man, And Cybernetics (Smc), IEEE International Conference on Systems Man and Cybernetics Conference Proceedings. IEEE service center, Piscataway, pp 36–40 Sagha H, Digumarti ST, Millán JR, Chavarriaga R, Calatroni A, Roggen D, Tröster G (2011) Benchmarking classification techniques using the Opportunity human activity dataset. In: 2011 Ieee International Conference On Systems, Man, And Cybernetics (Smc), IEEE International Conference on Systems Man and Cybernetics Conference Proceedings. IEEE service center, Piscataway, pp 36–40
Zurück zum Zitat Satizábal HF, Rebetez J , Perez-Uribe A (2013) Semi-supervised discovery of time-series templates for gesture spotting in activity recognition. In: Proceedings of the 2nd International Conference in Pattern Recognition Applications and Methods. pp 573–576 Satizábal HF, Rebetez J , Perez-Uribe A (2013) Semi-supervised discovery of time-series templates for gesture spotting in activity recognition. In: Proceedings of the 2nd International Conference in Pattern Recognition Applications and Methods. pp 573–576
Zurück zum Zitat Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R (2013) Real-time human pose recognition in parts from single depth images. Commun ACM 56(1):116–124. doi:10.1145/2398356.2398381 (ISSN 0001–0782) Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R (2013) Real-time human pose recognition in parts from single depth images. Commun ACM 56(1):116–124. doi:10.​1145/​2398356.​2398381 (ISSN 0001–0782)
Zurück zum Zitat Stiefmeier T, Roggen D, Ogris G, Lukowicz P, Lukowicz P (2008) Wearable activity tracking in car manufacturing. Pervasive Comput IEEE 7(2):42–50. doi:10.1109/MPRV.2008.40 (ISSN 1536–1268) Stiefmeier T, Roggen D, Ogris G, Lukowicz P, Lukowicz P (2008) Wearable activity tracking in car manufacturing. Pervasive Comput IEEE 7(2):42–50. doi:10.​1109/​MPRV.​2008.​40 (ISSN 1536–1268)
Zurück zum Zitat van Kasteren TLM, Englebienne G, Kröse BJA (2011) Hierarchical activity recognition using automatically clustered actions. In: Proceedings of the Second international conference on Ambient Intelligence, Am I’11. Springer, Heidelberg, pp 82–91. doi:10.1007/978-3-642-25167-2_9 (ISBN 978-3-642-25166-5) van Kasteren TLM, Englebienne G, Kröse BJA (2011) Hierarchical activity recognition using automatically clustered actions. In: Proceedings of the Second international conference on Ambient Intelligence, Am I’11. Springer, Heidelberg, pp 82–91. doi:10.​1007/​978-3-642-25167-2_​9 (ISBN 978-3-642-25166-5)
Zurück zum Zitat Xue Y, Jin L (2010) A naturalistic 3d acceleration-based activity dataset amp; benchmark evaluations. In: Systems Man and Cybernetics (SMC), 2010 IEEE International Conference. pp 4081–4085. doi:10.1109/ICSMC.2010.5641790 Xue Y, Jin L (2010) A naturalistic 3d acceleration-based activity dataset amp; benchmark evaluations. In: Systems Man and Cybernetics (SMC), 2010 IEEE International Conference. pp 4081–4085. doi:10.​1109/​ICSMC.​2010.​5641790
Metadaten
Titel
Unsupervised template discovery in activity recognition using the Gamma Growing Neural Gas algorithm
verfasst von
Héctor F. Satizábal
Andres Perez-Uribe
Publikationsdatum
01.09.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 9/2015
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-014-1499-y

Weitere Artikel der Ausgabe 9/2015

Soft Computing 9/2015 Zur Ausgabe