Skip to main content
Erschienen in: Cognitive Computation 2/2016

01.04.2016

Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult

verfasst von: José Carlos Castillo, Álvaro Castro-González, Antonio Fernández-Caballero, José Miguel Latorre, José Manuel Pastor, Alicia Fernández-Sotos, Miguel A. Salichs

Erschienen in: Cognitive Computation | Ausgabe 2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces the architecture of an emotion-aware ambient intelligent and gerontechnological project named “Improvement of the Elderly Quality of Life and Care through Smart Emotion Regulation”. The objective of the proposal is to find solutions for improving the quality of life and care of the elderly who can or want to continue living at home by using emotion regulation techniques. A series of sensors is used for monitoring the elderlies’ facial and gestural expression, activity and behaviour, as well as relevant physiological data. This way the older people’s emotions are inferred and recognized. Music, colour and light are the stimulating means to regulate their emotions towards a positive and pleasant mood. Then, the paper proposes a gerontechnological software architecture that enables real-time, continuous monitoring of the elderly and provides the best-tailored reactions of the ambience in order to regulate the older person’s emotions towards a positive mood. After describing the benefits of the approach for emotion recognition and regulation in the elderly, the eight levels that compose the architecture are described.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bachorik JP, Bangert M, Loui P, Larke K, Berger J, Roew R, et al. Emotion in motion: investigating the time-course of emotional judgments of musical stimuli. Music Percept. 2009;26:355–64.CrossRef Bachorik JP, Bangert M, Loui P, Larke K, Berger J, Roew R, et al. Emotion in motion: investigating the time-course of emotional judgments of musical stimuli. Music Percept. 2009;26:355–64.CrossRef
3.
4.
Zurück zum Zitat Castillo JC, Fernández-Caballero A, Castro-González Á, Salichs MA, López MT. A framework for recognizing and regulating emotions in the elderly. Lect Notes Comput Sci. 2014;8868:320–7.CrossRef Castillo JC, Fernández-Caballero A, Castro-González Á, Salichs MA, López MT. A framework for recognizing and regulating emotions in the elderly. Lect Notes Comput Sci. 2014;8868:320–7.CrossRef
5.
Zurück zum Zitat Chen M, Gonzalez S, Vasilakos A, Cao H, Leung VCM. Body area networks: a survey. Mob Netw Appl. 2011;16:171–93.CrossRef Chen M, Gonzalez S, Vasilakos A, Cao H, Leung VCM. Body area networks: a survey. Mob Netw Appl. 2011;16:171–93.CrossRef
6.
Zurück zum Zitat Devillers L, Lamel L. Emotion detection in a task-oriented dialogs. In: Proceedings of IEEE international conference on multimedia & expo, Baltimore, MD, USA; July 2003, vol 3, pp 549–552. Devillers L, Lamel L. Emotion detection in a task-oriented dialogs. In: Proceedings of IEEE international conference on multimedia & expo, Baltimore, MD, USA; July 2003, vol 3, pp 549–552.
7.
Zurück zum Zitat Ekman P, Friesen WV, Hager JC. Facial action coding system [e-book]. Salt Lake City: Research Nexus; 2002. Ekman P, Friesen WV, Hager JC. Facial action coding system [e-book]. Salt Lake City: Research Nexus; 2002.
8.
Zurück zum Zitat Elliot AJ, Maier MA. Color and psychological functioning. Curr Dir Psychol Sci. 2007;16:250–4.CrossRef Elliot AJ, Maier MA. Color and psychological functioning. Curr Dir Psychol Sci. 2007;16:250–4.CrossRef
9.
Zurück zum Zitat Esposito A, Fortunati L, Lugano G. Modeling emotion, behavior and context in socially believable robots and ICT interfaces. Cogn Comput. 2014;6:623–7.CrossRef Esposito A, Fortunati L, Lugano G. Modeling emotion, behavior and context in socially believable robots and ICT interfaces. Cogn Comput. 2014;6:623–7.CrossRef
11.
Zurück zum Zitat Fernández-Caballero A, López MT, Saiz-Valverde S. Dynamic stereoscopic selective visual attention (DSSVA): integrating motion and shape with depth in video segmentation. Expert Syst Appl. 2008;34:1394–402.CrossRef Fernández-Caballero A, López MT, Saiz-Valverde S. Dynamic stereoscopic selective visual attention (DSSVA): integrating motion and shape with depth in video segmentation. Expert Syst Appl. 2008;34:1394–402.CrossRef
12.
Zurück zum Zitat Fernández-Caballero A, Latorre JM, Pastor JM, Fernández-Sotos A. Improvement of the elderly quality of life and care through smart emotion regulation. Lect Notes Comput Sci. 2014;8868:348–55.CrossRef Fernández-Caballero A, Latorre JM, Pastor JM, Fernández-Sotos A. Improvement of the elderly quality of life and care through smart emotion regulation. Lect Notes Comput Sci. 2014;8868:348–55.CrossRef
13.
Zurück zum Zitat Fernández-Caballero A, Castillo JC, López MT, Serrano-Cuerda J, Sokolova MV. INT3-Horus framework for multispectrum activity interpretation in intelligent environments. Expert Syst Appl. 2013;40:6715–27.CrossRef Fernández-Caballero A, Castillo JC, López MT, Serrano-Cuerda J, Sokolova MV. INT3-Horus framework for multispectrum activity interpretation in intelligent environments. Expert Syst Appl. 2013;40:6715–27.CrossRef
14.
Zurück zum Zitat Fernández-Sotos A, Fernández-Caballero A, Latorre JM. Elicitation of emotions through music: the influence of note value. Artif Comput Biol Med 2015;9107:488–497.CrossRef Fernández-Sotos A, Fernández-Caballero A, Latorre JM. Elicitation of emotions through music: the influence of note value. Artif Comput Biol Med 2015;9107:488–497.CrossRef
15.
Zurück zum Zitat García-Rodríguez C, Martínez-Tomás R, Cuadra-Troncoso JM, Rincón M, Fernández-Caballero A. A simulation tool for monitoring elderly who suffer from disorientation in a smart home. Expert Syst. 2015;32:676–87.CrossRef García-Rodríguez C, Martínez-Tomás R, Cuadra-Troncoso JM, Rincón M, Fernández-Caballero A. A simulation tool for monitoring elderly who suffer from disorientation in a smart home. Expert Syst. 2015;32:676–87.CrossRef
16.
Zurück zum Zitat Gascueña JM, Fernández-Caballero A. On the use of agent technology in intelligent, multi-sensory and distributed surveillance. Knowl Eng Rev. 2011;26:191–208.CrossRef Gascueña JM, Fernández-Caballero A. On the use of agent technology in intelligent, multi-sensory and distributed surveillance. Knowl Eng Rev. 2011;26:191–208.CrossRef
17.
Zurück zum Zitat Gehrig T, Ekenel HK. A common framework for real-time emotion recognition and facial action unit detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshops, Colorado Springs, USA, June 2011; pp. 1–6. Gehrig T, Ekenel HK. A common framework for real-time emotion recognition and facial action unit detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshops, Colorado Springs, USA, June 2011; pp. 1–6.
19.
Zurück zum Zitat Gross JJ, Levenson RW. Emotion elicitation using films. Cogn Emot. 1995;9:87–108.CrossRef Gross JJ, Levenson RW. Emotion elicitation using films. Cogn Emot. 1995;9:87–108.CrossRef
20.
Zurück zum Zitat Jovanov E, Milenkovic A. Body area networks for ubiquitous healthcare applications: opportunities and challenges. J Med Syst. 2011;35:1245–54.CrossRefPubMed Jovanov E, Milenkovic A. Body area networks for ubiquitous healthcare applications: opportunities and challenges. J Med Syst. 2011;35:1245–54.CrossRefPubMed
21.
Zurück zum Zitat Kim JB, ParkJS OhYW. Speaker-characterized emotion recognition using online and iterative speaker adaptation. Cogn Comput. 2012;4:398–408.CrossRef Kim JB, ParkJS OhYW. Speaker-characterized emotion recognition using online and iterative speaker adaptation. Cogn Comput. 2012;4:398–408.CrossRef
22.
Zurück zum Zitat Kim J, André E. Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell. 2008;30:2067–83.CrossRefPubMed Kim J, André E. Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell. 2008;30:2067–83.CrossRefPubMed
23.
Zurück zum Zitat Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report A–8, University of Florida, USA, 2009. Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report A–8, University of Florida, USA, 2009.
24.
Zurück zum Zitat Lee H, Choi YS, Lee S, Park IP. Towards unobtrusive emotion recognition for affective social communication. In: Proceedings of IEEE consumer communications and networking conference, Las Vegas, NV, USA, January 2012; pp. 260–264. Lee H, Choi YS, Lee S, Park IP. Towards unobtrusive emotion recognition for affective social communication. In: Proceedings of IEEE consumer communications and networking conference, Las Vegas, NV, USA, January 2012; pp. 260–264.
25.
Zurück zum Zitat Livingstone SR, Palmer C, Schubert E. Emotion response to musical repetition. Emotion. 2012;12:552–67.CrossRefPubMed Livingstone SR, Palmer C, Schubert E. Emotion response to musical repetition. Emotion. 2012;12:552–67.CrossRefPubMed
26.
Zurück zum Zitat Livingstone RS, Thompson WF. The emergence of music from the theory of mind. Musicae Scientiae. 2009;17:83–115.CrossRef Livingstone RS, Thompson WF. The emergence of music from the theory of mind. Musicae Scientiae. 2009;17:83–115.CrossRef
27.
Zurück zum Zitat López JM, Gil R, García R, Cearreta I, Garay N. Towards an ontology for describing emotions. Lect Notes Comput Sci. 2008;5288:96–104.CrossRef López JM, Gil R, García R, Cearreta I, Garay N. Towards an ontology for describing emotions. Lect Notes Comput Sci. 2008;5288:96–104.CrossRef
28.
Zurück zum Zitat Lozano-Monasor E, López MT, Fernández-Caballero A, Vigo-Bustos F. Facial expression recognition from webcam based on active shape models and support vector machines. Ambient Assist Living Daily Act 2014;8868:147–154. Lozano-Monasor E, López MT, Fernández-Caballero A, Vigo-Bustos F. Facial expression recognition from webcam based on active shape models and support vector machines. Ambient Assist Living Daily Act 2014;8868:147–154.
29.
Zurück zum Zitat Martínez-Rodrigo A, Zangróniz R, Pastor JM, Latorre JM, Fernández-Caballero A. Emotion detection in ageing adults from physiological sensors. Ambient Intell Softw Appl 2015;376:253–261. Martínez-Rodrigo A, Zangróniz R, Pastor JM, Latorre JM, Fernández-Caballero A. Emotion detection in ageing adults from physiological sensors. Ambient Intell Softw Appl 2015;376:253–261.
30.
Zurück zum Zitat McRae K, Misra S, Prasad AK, Pereira SC, Gross JJ. Bottom-up and top-down emotion generation: implications for emotion regulation. Soc Cogn Affect Neurosci. 2012;7:253–62.CrossRefPubMedPubMedCentral McRae K, Misra S, Prasad AK, Pereira SC, Gross JJ. Bottom-up and top-down emotion generation: implications for emotion regulation. Soc Cogn Affect Neurosci. 2012;7:253–62.CrossRefPubMedPubMedCentral
31.
Zurück zum Zitat Medjahed H, Istrate D, Boudy J, Baldinger JL. A pervasive multi-sensor data fusion for smart home healthcare monitoring. In: Proceedings of IEEE international conference in fuzzy systems, Taipei, Taiwan, June 2011; pp. 1466–1473. Medjahed H, Istrate D, Boudy J, Baldinger JL. A pervasive multi-sensor data fusion for smart home healthcare monitoring. In: Proceedings of IEEE international conference in fuzzy systems, Taipei, Taiwan, June 2011; pp. 1466–1473.
32.
Zurück zum Zitat Niedenthal PM, Halberstadt JB, Setterlund MC. Being happy and seing happy: emotional state mediates visual word recognition. Cogn Emot. 1997;11:403–32.CrossRef Niedenthal PM, Halberstadt JB, Setterlund MC. Being happy and seing happy: emotional state mediates visual word recognition. Cogn Emot. 1997;11:403–32.CrossRef
33.
Zurück zum Zitat Ortiz-García-Cervigón V, Sokolova MV, García-Muñoz RM, Fernández-Caballero A. Led strips for color- and illumination-based emotion regulation at home. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:277–287. Ortiz-García-Cervigón V, Sokolova MV, García-Muñoz RM, Fernández-Caballero A. Led strips for color- and illumination-based emotion regulation at home. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:277–287.
34.
Zurück zum Zitat Pail G, Huf W, Pjrek E, Winkler D, Willeit M, Praschak-Rieder N, et al. Bright-light therapy in the treatment of mood disorders. Neuropsychobiology. 2011;64:152–62.CrossRefPubMed Pail G, Huf W, Pjrek E, Winkler D, Willeit M, Praschak-Rieder N, et al. Bright-light therapy in the treatment of mood disorders. Neuropsychobiology. 2011;64:152–62.CrossRefPubMed
35.
Zurück zum Zitat Pavón J, Gómez-Sanz JJ, Fernández-Caballero A, Valencia-Jiménez JJ. Development of intelligent multi-sensor surveillance systems with agents. Robot Auton Syst. 2008;55:892–903.CrossRef Pavón J, Gómez-Sanz JJ, Fernández-Caballero A, Valencia-Jiménez JJ. Development of intelligent multi-sensor surveillance systems with agents. Robot Auton Syst. 2008;55:892–903.CrossRef
36.
Zurück zum Zitat Picard RW, Vyzas E, Healey J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Patterns Anal Mach Intell. 2001;23:1175–91.CrossRef Picard RW, Vyzas E, Healey J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Patterns Anal Mach Intell. 2001;23:1175–91.CrossRef
37.
Zurück zum Zitat Sadri F. Ambient intelligence: a survey. ACM Comput Surv (CSUR). 2011;43(4):36.CrossRef Sadri F. Ambient intelligence: a survey. ACM Comput Surv (CSUR). 2011;43(4):36.CrossRef
38.
Zurück zum Zitat Salovey P, Rothman AJ, Detweiler JB, Steward WT. Emotional states and physical health. Am Psychol. 2000;55:110–21.CrossRefPubMed Salovey P, Rothman AJ, Detweiler JB, Steward WT. Emotional states and physical health. Am Psychol. 2000;55:110–21.CrossRefPubMed
39.
Zurück zum Zitat de Santos A, Sánchez C, Guerra J, Bailador G. A stress-detection system based on physiological signals and fuzzy logic. IEEE Trans Industr Electron. 2011;58:4857–65.CrossRef de Santos A, Sánchez C, Guerra J, Bailador G. A stress-detection system based on physiological signals and fuzzy logic. IEEE Trans Industr Electron. 2011;58:4857–65.CrossRef
40.
Zurück zum Zitat Schachter S, Singer JE. Cognitive, social and physiological determinants of emotional state. Psychol Rev. 1962;69:379–99.CrossRefPubMed Schachter S, Singer JE. Cognitive, social and physiological determinants of emotional state. Psychol Rev. 1962;69:379–99.CrossRefPubMed
41.
Zurück zum Zitat Scherer K. What are emotions? And how can they be measured? Soc Sci Inf. 2005;44:695–729.CrossRef Scherer K. What are emotions? And how can they be measured? Soc Sci Inf. 2005;44:695–729.CrossRef
42.
Zurück zum Zitat Silva PRD, Osano M, Marasinghe A, Madurapperuma AP. Towards recognizing emotion with affective dimensions through body gestures. In: Proceedings of 7th IEEE international conference on automatic face and gesture recognition, Southampton, United Kingdom, April 2006; pp. 269–274. Silva PRD, Osano M, Marasinghe A, Madurapperuma AP. Towards recognizing emotion with affective dimensions through body gestures. In: Proceedings of 7th IEEE international conference on automatic face and gesture recognition, Southampton, United Kingdom, April 2006; pp. 269–274.
43.
Zurück zum Zitat Sokolova MV, Fernández-Caballero A, López MT, Martínez-Rodrigo A, Zangróniz R, Pastor JM. A distributed architecture for multimodal emotion identification. Trends Pract Appl Agents Multi Agent Syst Sustain 2015;372:125–132.CrossRef Sokolova MV, Fernández-Caballero A, López MT, Martínez-Rodrigo A, Zangróniz R, Pastor JM. A distributed architecture for multimodal emotion identification. Trends Pract Appl Agents Multi Agent Syst Sustain 2015;372:125–132.CrossRef
44.
Zurück zum Zitat Sokolova MV, Fernández-Caballero A, Ros L, Fernández-Aguilar L, Latorre JM. Experimentation on emotion regulation with single-colored images. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:265–276. Sokolova MV, Fernández-Caballero A, Ros L, Fernández-Aguilar L, Latorre JM. Experimentation on emotion regulation with single-colored images. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:265–276.
45.
Zurück zum Zitat Soleymani M, Lichtenauer J, Pun T, Pantic M. A multi-modal affective database for affect recognition and implicit tagging. IEEE Trans Affect Comput. 2012;3:42–55.CrossRef Soleymani M, Lichtenauer J, Pun T, Pantic M. A multi-modal affective database for affect recognition and implicit tagging. IEEE Trans Affect Comput. 2012;3:42–55.CrossRef
46.
Zurück zum Zitat Susskind JM, Littlewort G, Bartlett MS, Movellan J, Anderson AK. Human and computer recognition of facial expressions of emotion. Neuropsychologia. 2007;45:152–62.CrossRefPubMed Susskind JM, Littlewort G, Bartlett MS, Movellan J, Anderson AK. Human and computer recognition of facial expressions of emotion. Neuropsychologia. 2007;45:152–62.CrossRefPubMed
47.
48.
Zurück zum Zitat Vogt T, André E, Wagner J. Automatic recognition of emotions from speech: a review of the literature and recommendations for practical realisation. Lect Notes Comput Sci. 2008;4868:75–91.CrossRef Vogt T, André E, Wagner J. Automatic recognition of emotions from speech: a review of the literature and recommendations for practical realisation. Lect Notes Comput Sci. 2008;4868:75–91.CrossRef
49.
Zurück zum Zitat Wagner J, André E, Jung F. Smart sensor integration: a framework for multimodal emotion recognition in real-time. In: Proceedings of 3rd international conference on affective computing and intelligent interaction and workshops, Amsterdam, The Netherlands, September 2009; pp. 1–8. Wagner J, André E, Jung F. Smart sensor integration: a framework for multimodal emotion recognition in real-time. In: Proceedings of 3rd international conference on affective computing and intelligent interaction and workshops, Amsterdam, The Netherlands, September 2009; pp. 1–8.
50.
Zurück zum Zitat Zhou J, Yu C, Riekki J, Kärkkäinen E. AmE framework: a model for emotion aware ambient intelligence. In: Proceedings of the second international conference on affective computing and intelligent interaction (ACII2007): Doctoral Consortium, September 2007. Zhou J, Yu C, Riekki J, Kärkkäinen E. AmE framework: a model for emotion aware ambient intelligence. In: Proceedings of the second international conference on affective computing and intelligent interaction (ACII2007): Doctoral Consortium, September 2007.
Metadaten
Titel
Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult
verfasst von
José Carlos Castillo
Álvaro Castro-González
Antonio Fernández-Caballero
José Miguel Latorre
José Manuel Pastor
Alicia Fernández-Sotos
Miguel A. Salichs
Publikationsdatum
01.04.2016
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 2/2016
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-016-9383-y

Weitere Artikel der Ausgabe 2/2016

Cognitive Computation 2/2016 Zur Ausgabe