Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Ball Course Detection Function for the Blind Bowling Support System Using a Depth Sensor Read chapter Read first chapter

2016 | OriginalPaper | Chapter

Multimodal Sequential Modeling and Recognition of Human Activities

Authors : Mouna Selmi, Mounîm A. El-Yacoubi

Published in: Computers Helping People with Special Needs

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Video-based recognition of activities of daily living (ADLs) is being used in ambient assisted living systems in order to support independent living of old people. In this work, we propose a new multimodal ADL recognition method by modeling the correlation between motion and object information. We encode motion using dense interest point trajectories which are robust to occlusion and speed variability. We formulate the learning problem using a two-layer SVM hidden conditional random field (HCRF) recognition model that is particularly relevant for multimodal sequence recognition. This hierarchical classifier optimally combines the discriminative power of SVM and the long-range feature dependencies modeling by the HCRF.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Personal Mobility Vehicle for Assisting Short-Range Transportation
next chapter Android Games for Developing Fine Coordination of Movement Skills
Literature
1.
Suzuki, T., Murase, S., Tanaka, T., Okazawa, T.: New approach for the early detection of dementia by recording in-house activities. Telemed. J. E Health 13, 41–44 (2007)CrossRef
2.
Cardinaux, F., Bhowmik, D., Abhayaratne, C., Hawley, M.S.: Video based technology for ambient assisted living: a review of the literature. J. Ambient Intell. Smart Environ. 3, 253–269 (2011)
3.
Chaaraoui, A.A., Padilla-López, J.R., Ferrández-Pastor, F.J., Nieto-Hidalgo, M., Flórez-Revuelta, F.: A vision-based system for intelligent monitoring: human behaviour analysis and privacy by context. Sensors 14, 8895–8925 (2014)CrossRef
4.
Fathi, A., Farhadi, A., Rehg, J.M.: Understanding egocentric activities. In: ICCV, Barcelona, pp. 407–414, 6–13 November 2011
5.
Kjellström, H., Romero, J., Kragic, D.: Visual object-action recognition: inferring object affordances from human demonstration. CVIU 115(1), 81–90 (2011)
6.
Gupta, A., Kembhavi, A., Davis, L.: Observing human-object interactions: using spatial and functional compatibility for recognition. IEEE T-PAMI 31(10), 1775–1789 (2009)CrossRef
7.
Koppula, H., Gupta, R., Saxena, A.: Learning human activities and object affordances from RGB-D videos. IJRR 32(8), 951–970 (2013)
8.
Blank, M., Gorelick, L., Schechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: ICCV, pp. 1395–1402 (2005)
9.
Laptev, I.: On space-time interest points. Int. J. Comput. Vis. 64(2/3), 107–123 (2005)CrossRef
10.
Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: ICPR (2004)
11.
Wang, H., Klaser, A., Schmid, C., Liu, C.-L.: Action recognition by dense trajectories. In: CVPR (2011)
12.
Quattoni, A., Wang, S., Morency, L.-P., Collins, M., Darrell, T.: Hidden conditional random fields. In: TPAMI (2007)
13.
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: ICML, pp. 282–289 (2001)
14.
Koppula, H., Saxena, A.: Learning spatio-temporal structure from RGB-D videos for human activity detection and anticipation. ICML 28, 792–800 (2013)
15.
Fleury, A., Vacher, M., Portet, F., Chahuara, P., et Noury N.: A multimodal corpus recorded in a health smart home. In: Proceedings of the Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality in conjunction with LREC 2010, Valetta, pp. 99–105, 17–23 May 2010
16.
Boucenna, S., Anzalone, S., Tilmont, E., Cohen, D., Chetouani, M.: Learning of social signatures through imitation game between a robot and a human partner. IEEE Trans. Auton. Mental Dev. 6(3), 213–225 (2014)CrossRef
Metadata
Title
Multimodal Sequential Modeling and Recognition of Human Activities
Authors
Mouna Selmi
Mounîm A. El-Yacoubi
Copyright Year
2016
Book
Computers Helping People with Special Needs

Print ISBN: 978-3-319-41266-5

Electronic ISBN: 978-3-319-41267-2

Copyright Year: 2016

DOI
https://doi.org/10.1007/978-3-319-41267-2_76