Skip to main content
Top
Published in: Cognitive Computation 2/2016

01-04-2016

Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult

Authors: José Carlos Castillo, Álvaro Castro-González, Antonio Fernández-Caballero, José Miguel Latorre, José Manuel Pastor, Alicia Fernández-Sotos, Miguel A. Salichs

Published in: Cognitive Computation | Issue 2/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces the architecture of an emotion-aware ambient intelligent and gerontechnological project named “Improvement of the Elderly Quality of Life and Care through Smart Emotion Regulation”. The objective of the proposal is to find solutions for improving the quality of life and care of the elderly who can or want to continue living at home by using emotion regulation techniques. A series of sensors is used for monitoring the elderlies’ facial and gestural expression, activity and behaviour, as well as relevant physiological data. This way the older people’s emotions are inferred and recognized. Music, colour and light are the stimulating means to regulate their emotions towards a positive and pleasant mood. Then, the paper proposes a gerontechnological software architecture that enables real-time, continuous monitoring of the elderly and provides the best-tailored reactions of the ambience in order to regulate the older person’s emotions towards a positive mood. After describing the benefits of the approach for emotion recognition and regulation in the elderly, the eight levels that compose the architecture are described.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bachorik JP, Bangert M, Loui P, Larke K, Berger J, Roew R, et al. Emotion in motion: investigating the time-course of emotional judgments of musical stimuli. Music Percept. 2009;26:355–64.CrossRef Bachorik JP, Bangert M, Loui P, Larke K, Berger J, Roew R, et al. Emotion in motion: investigating the time-course of emotional judgments of musical stimuli. Music Percept. 2009;26:355–64.CrossRef
3.
4.
go back to reference Castillo JC, Fernández-Caballero A, Castro-González Á, Salichs MA, López MT. A framework for recognizing and regulating emotions in the elderly. Lect Notes Comput Sci. 2014;8868:320–7.CrossRef Castillo JC, Fernández-Caballero A, Castro-González Á, Salichs MA, López MT. A framework for recognizing and regulating emotions in the elderly. Lect Notes Comput Sci. 2014;8868:320–7.CrossRef
5.
go back to reference Chen M, Gonzalez S, Vasilakos A, Cao H, Leung VCM. Body area networks: a survey. Mob Netw Appl. 2011;16:171–93.CrossRef Chen M, Gonzalez S, Vasilakos A, Cao H, Leung VCM. Body area networks: a survey. Mob Netw Appl. 2011;16:171–93.CrossRef
6.
go back to reference Devillers L, Lamel L. Emotion detection in a task-oriented dialogs. In: Proceedings of IEEE international conference on multimedia & expo, Baltimore, MD, USA; July 2003, vol 3, pp 549–552. Devillers L, Lamel L. Emotion detection in a task-oriented dialogs. In: Proceedings of IEEE international conference on multimedia & expo, Baltimore, MD, USA; July 2003, vol 3, pp 549–552.
7.
go back to reference Ekman P, Friesen WV, Hager JC. Facial action coding system [e-book]. Salt Lake City: Research Nexus; 2002. Ekman P, Friesen WV, Hager JC. Facial action coding system [e-book]. Salt Lake City: Research Nexus; 2002.
8.
go back to reference Elliot AJ, Maier MA. Color and psychological functioning. Curr Dir Psychol Sci. 2007;16:250–4.CrossRef Elliot AJ, Maier MA. Color and psychological functioning. Curr Dir Psychol Sci. 2007;16:250–4.CrossRef
9.
go back to reference Esposito A, Fortunati L, Lugano G. Modeling emotion, behavior and context in socially believable robots and ICT interfaces. Cogn Comput. 2014;6:623–7.CrossRef Esposito A, Fortunati L, Lugano G. Modeling emotion, behavior and context in socially believable robots and ICT interfaces. Cogn Comput. 2014;6:623–7.CrossRef
11.
go back to reference Fernández-Caballero A, López MT, Saiz-Valverde S. Dynamic stereoscopic selective visual attention (DSSVA): integrating motion and shape with depth in video segmentation. Expert Syst Appl. 2008;34:1394–402.CrossRef Fernández-Caballero A, López MT, Saiz-Valverde S. Dynamic stereoscopic selective visual attention (DSSVA): integrating motion and shape with depth in video segmentation. Expert Syst Appl. 2008;34:1394–402.CrossRef
12.
go back to reference Fernández-Caballero A, Latorre JM, Pastor JM, Fernández-Sotos A. Improvement of the elderly quality of life and care through smart emotion regulation. Lect Notes Comput Sci. 2014;8868:348–55.CrossRef Fernández-Caballero A, Latorre JM, Pastor JM, Fernández-Sotos A. Improvement of the elderly quality of life and care through smart emotion regulation. Lect Notes Comput Sci. 2014;8868:348–55.CrossRef
13.
go back to reference Fernández-Caballero A, Castillo JC, López MT, Serrano-Cuerda J, Sokolova MV. INT3-Horus framework for multispectrum activity interpretation in intelligent environments. Expert Syst Appl. 2013;40:6715–27.CrossRef Fernández-Caballero A, Castillo JC, López MT, Serrano-Cuerda J, Sokolova MV. INT3-Horus framework for multispectrum activity interpretation in intelligent environments. Expert Syst Appl. 2013;40:6715–27.CrossRef
14.
go back to reference Fernández-Sotos A, Fernández-Caballero A, Latorre JM. Elicitation of emotions through music: the influence of note value. Artif Comput Biol Med 2015;9107:488–497.CrossRef Fernández-Sotos A, Fernández-Caballero A, Latorre JM. Elicitation of emotions through music: the influence of note value. Artif Comput Biol Med 2015;9107:488–497.CrossRef
15.
go back to reference García-Rodríguez C, Martínez-Tomás R, Cuadra-Troncoso JM, Rincón M, Fernández-Caballero A. A simulation tool for monitoring elderly who suffer from disorientation in a smart home. Expert Syst. 2015;32:676–87.CrossRef García-Rodríguez C, Martínez-Tomás R, Cuadra-Troncoso JM, Rincón M, Fernández-Caballero A. A simulation tool for monitoring elderly who suffer from disorientation in a smart home. Expert Syst. 2015;32:676–87.CrossRef
16.
go back to reference Gascueña JM, Fernández-Caballero A. On the use of agent technology in intelligent, multi-sensory and distributed surveillance. Knowl Eng Rev. 2011;26:191–208.CrossRef Gascueña JM, Fernández-Caballero A. On the use of agent technology in intelligent, multi-sensory and distributed surveillance. Knowl Eng Rev. 2011;26:191–208.CrossRef
17.
go back to reference Gehrig T, Ekenel HK. A common framework for real-time emotion recognition and facial action unit detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshops, Colorado Springs, USA, June 2011; pp. 1–6. Gehrig T, Ekenel HK. A common framework for real-time emotion recognition and facial action unit detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshops, Colorado Springs, USA, June 2011; pp. 1–6.
19.
go back to reference Gross JJ, Levenson RW. Emotion elicitation using films. Cogn Emot. 1995;9:87–108.CrossRef Gross JJ, Levenson RW. Emotion elicitation using films. Cogn Emot. 1995;9:87–108.CrossRef
20.
go back to reference Jovanov E, Milenkovic A. Body area networks for ubiquitous healthcare applications: opportunities and challenges. J Med Syst. 2011;35:1245–54.CrossRefPubMed Jovanov E, Milenkovic A. Body area networks for ubiquitous healthcare applications: opportunities and challenges. J Med Syst. 2011;35:1245–54.CrossRefPubMed
21.
go back to reference Kim JB, ParkJS OhYW. Speaker-characterized emotion recognition using online and iterative speaker adaptation. Cogn Comput. 2012;4:398–408.CrossRef Kim JB, ParkJS OhYW. Speaker-characterized emotion recognition using online and iterative speaker adaptation. Cogn Comput. 2012;4:398–408.CrossRef
22.
go back to reference Kim J, André E. Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell. 2008;30:2067–83.CrossRefPubMed Kim J, André E. Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell. 2008;30:2067–83.CrossRefPubMed
23.
go back to reference Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report A–8, University of Florida, USA, 2009. Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report A–8, University of Florida, USA, 2009.
24.
go back to reference Lee H, Choi YS, Lee S, Park IP. Towards unobtrusive emotion recognition for affective social communication. In: Proceedings of IEEE consumer communications and networking conference, Las Vegas, NV, USA, January 2012; pp. 260–264. Lee H, Choi YS, Lee S, Park IP. Towards unobtrusive emotion recognition for affective social communication. In: Proceedings of IEEE consumer communications and networking conference, Las Vegas, NV, USA, January 2012; pp. 260–264.
25.
go back to reference Livingstone SR, Palmer C, Schubert E. Emotion response to musical repetition. Emotion. 2012;12:552–67.CrossRefPubMed Livingstone SR, Palmer C, Schubert E. Emotion response to musical repetition. Emotion. 2012;12:552–67.CrossRefPubMed
26.
go back to reference Livingstone RS, Thompson WF. The emergence of music from the theory of mind. Musicae Scientiae. 2009;17:83–115.CrossRef Livingstone RS, Thompson WF. The emergence of music from the theory of mind. Musicae Scientiae. 2009;17:83–115.CrossRef
27.
go back to reference López JM, Gil R, García R, Cearreta I, Garay N. Towards an ontology for describing emotions. Lect Notes Comput Sci. 2008;5288:96–104.CrossRef López JM, Gil R, García R, Cearreta I, Garay N. Towards an ontology for describing emotions. Lect Notes Comput Sci. 2008;5288:96–104.CrossRef
28.
go back to reference Lozano-Monasor E, López MT, Fernández-Caballero A, Vigo-Bustos F. Facial expression recognition from webcam based on active shape models and support vector machines. Ambient Assist Living Daily Act 2014;8868:147–154. Lozano-Monasor E, López MT, Fernández-Caballero A, Vigo-Bustos F. Facial expression recognition from webcam based on active shape models and support vector machines. Ambient Assist Living Daily Act 2014;8868:147–154.
29.
go back to reference Martínez-Rodrigo A, Zangróniz R, Pastor JM, Latorre JM, Fernández-Caballero A. Emotion detection in ageing adults from physiological sensors. Ambient Intell Softw Appl 2015;376:253–261. Martínez-Rodrigo A, Zangróniz R, Pastor JM, Latorre JM, Fernández-Caballero A. Emotion detection in ageing adults from physiological sensors. Ambient Intell Softw Appl 2015;376:253–261.
30.
go back to reference McRae K, Misra S, Prasad AK, Pereira SC, Gross JJ. Bottom-up and top-down emotion generation: implications for emotion regulation. Soc Cogn Affect Neurosci. 2012;7:253–62.CrossRefPubMedPubMedCentral McRae K, Misra S, Prasad AK, Pereira SC, Gross JJ. Bottom-up and top-down emotion generation: implications for emotion regulation. Soc Cogn Affect Neurosci. 2012;7:253–62.CrossRefPubMedPubMedCentral
31.
go back to reference Medjahed H, Istrate D, Boudy J, Baldinger JL. A pervasive multi-sensor data fusion for smart home healthcare monitoring. In: Proceedings of IEEE international conference in fuzzy systems, Taipei, Taiwan, June 2011; pp. 1466–1473. Medjahed H, Istrate D, Boudy J, Baldinger JL. A pervasive multi-sensor data fusion for smart home healthcare monitoring. In: Proceedings of IEEE international conference in fuzzy systems, Taipei, Taiwan, June 2011; pp. 1466–1473.
32.
go back to reference Niedenthal PM, Halberstadt JB, Setterlund MC. Being happy and seing happy: emotional state mediates visual word recognition. Cogn Emot. 1997;11:403–32.CrossRef Niedenthal PM, Halberstadt JB, Setterlund MC. Being happy and seing happy: emotional state mediates visual word recognition. Cogn Emot. 1997;11:403–32.CrossRef
33.
go back to reference Ortiz-García-Cervigón V, Sokolova MV, García-Muñoz RM, Fernández-Caballero A. Led strips for color- and illumination-based emotion regulation at home. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:277–287. Ortiz-García-Cervigón V, Sokolova MV, García-Muñoz RM, Fernández-Caballero A. Led strips for color- and illumination-based emotion regulation at home. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:277–287.
34.
go back to reference Pail G, Huf W, Pjrek E, Winkler D, Willeit M, Praschak-Rieder N, et al. Bright-light therapy in the treatment of mood disorders. Neuropsychobiology. 2011;64:152–62.CrossRefPubMed Pail G, Huf W, Pjrek E, Winkler D, Willeit M, Praschak-Rieder N, et al. Bright-light therapy in the treatment of mood disorders. Neuropsychobiology. 2011;64:152–62.CrossRefPubMed
35.
go back to reference Pavón J, Gómez-Sanz JJ, Fernández-Caballero A, Valencia-Jiménez JJ. Development of intelligent multi-sensor surveillance systems with agents. Robot Auton Syst. 2008;55:892–903.CrossRef Pavón J, Gómez-Sanz JJ, Fernández-Caballero A, Valencia-Jiménez JJ. Development of intelligent multi-sensor surveillance systems with agents. Robot Auton Syst. 2008;55:892–903.CrossRef
36.
go back to reference Picard RW, Vyzas E, Healey J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Patterns Anal Mach Intell. 2001;23:1175–91.CrossRef Picard RW, Vyzas E, Healey J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Patterns Anal Mach Intell. 2001;23:1175–91.CrossRef
37.
go back to reference Sadri F. Ambient intelligence: a survey. ACM Comput Surv (CSUR). 2011;43(4):36.CrossRef Sadri F. Ambient intelligence: a survey. ACM Comput Surv (CSUR). 2011;43(4):36.CrossRef
38.
go back to reference Salovey P, Rothman AJ, Detweiler JB, Steward WT. Emotional states and physical health. Am Psychol. 2000;55:110–21.CrossRefPubMed Salovey P, Rothman AJ, Detweiler JB, Steward WT. Emotional states and physical health. Am Psychol. 2000;55:110–21.CrossRefPubMed
39.
go back to reference de Santos A, Sánchez C, Guerra J, Bailador G. A stress-detection system based on physiological signals and fuzzy logic. IEEE Trans Industr Electron. 2011;58:4857–65.CrossRef de Santos A, Sánchez C, Guerra J, Bailador G. A stress-detection system based on physiological signals and fuzzy logic. IEEE Trans Industr Electron. 2011;58:4857–65.CrossRef
40.
go back to reference Schachter S, Singer JE. Cognitive, social and physiological determinants of emotional state. Psychol Rev. 1962;69:379–99.CrossRefPubMed Schachter S, Singer JE. Cognitive, social and physiological determinants of emotional state. Psychol Rev. 1962;69:379–99.CrossRefPubMed
41.
go back to reference Scherer K. What are emotions? And how can they be measured? Soc Sci Inf. 2005;44:695–729.CrossRef Scherer K. What are emotions? And how can they be measured? Soc Sci Inf. 2005;44:695–729.CrossRef
42.
go back to reference Silva PRD, Osano M, Marasinghe A, Madurapperuma AP. Towards recognizing emotion with affective dimensions through body gestures. In: Proceedings of 7th IEEE international conference on automatic face and gesture recognition, Southampton, United Kingdom, April 2006; pp. 269–274. Silva PRD, Osano M, Marasinghe A, Madurapperuma AP. Towards recognizing emotion with affective dimensions through body gestures. In: Proceedings of 7th IEEE international conference on automatic face and gesture recognition, Southampton, United Kingdom, April 2006; pp. 269–274.
43.
go back to reference Sokolova MV, Fernández-Caballero A, López MT, Martínez-Rodrigo A, Zangróniz R, Pastor JM. A distributed architecture for multimodal emotion identification. Trends Pract Appl Agents Multi Agent Syst Sustain 2015;372:125–132.CrossRef Sokolova MV, Fernández-Caballero A, López MT, Martínez-Rodrigo A, Zangróniz R, Pastor JM. A distributed architecture for multimodal emotion identification. Trends Pract Appl Agents Multi Agent Syst Sustain 2015;372:125–132.CrossRef
44.
go back to reference Sokolova MV, Fernández-Caballero A, Ros L, Fernández-Aguilar L, Latorre JM. Experimentation on emotion regulation with single-colored images. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:265–276. Sokolova MV, Fernández-Caballero A, Ros L, Fernández-Aguilar L, Latorre JM. Experimentation on emotion regulation with single-colored images. Ambient assisted living. Development and testing of ICT-based solutions in real life situations 2015;9455:265–276.
45.
go back to reference Soleymani M, Lichtenauer J, Pun T, Pantic M. A multi-modal affective database for affect recognition and implicit tagging. IEEE Trans Affect Comput. 2012;3:42–55.CrossRef Soleymani M, Lichtenauer J, Pun T, Pantic M. A multi-modal affective database for affect recognition and implicit tagging. IEEE Trans Affect Comput. 2012;3:42–55.CrossRef
46.
go back to reference Susskind JM, Littlewort G, Bartlett MS, Movellan J, Anderson AK. Human and computer recognition of facial expressions of emotion. Neuropsychologia. 2007;45:152–62.CrossRefPubMed Susskind JM, Littlewort G, Bartlett MS, Movellan J, Anderson AK. Human and computer recognition of facial expressions of emotion. Neuropsychologia. 2007;45:152–62.CrossRefPubMed
47.
48.
go back to reference Vogt T, André E, Wagner J. Automatic recognition of emotions from speech: a review of the literature and recommendations for practical realisation. Lect Notes Comput Sci. 2008;4868:75–91.CrossRef Vogt T, André E, Wagner J. Automatic recognition of emotions from speech: a review of the literature and recommendations for practical realisation. Lect Notes Comput Sci. 2008;4868:75–91.CrossRef
49.
go back to reference Wagner J, André E, Jung F. Smart sensor integration: a framework for multimodal emotion recognition in real-time. In: Proceedings of 3rd international conference on affective computing and intelligent interaction and workshops, Amsterdam, The Netherlands, September 2009; pp. 1–8. Wagner J, André E, Jung F. Smart sensor integration: a framework for multimodal emotion recognition in real-time. In: Proceedings of 3rd international conference on affective computing and intelligent interaction and workshops, Amsterdam, The Netherlands, September 2009; pp. 1–8.
50.
go back to reference Zhou J, Yu C, Riekki J, Kärkkäinen E. AmE framework: a model for emotion aware ambient intelligence. In: Proceedings of the second international conference on affective computing and intelligent interaction (ACII2007): Doctoral Consortium, September 2007. Zhou J, Yu C, Riekki J, Kärkkäinen E. AmE framework: a model for emotion aware ambient intelligence. In: Proceedings of the second international conference on affective computing and intelligent interaction (ACII2007): Doctoral Consortium, September 2007.
Metadata
Title
Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult
Authors
José Carlos Castillo
Álvaro Castro-González
Antonio Fernández-Caballero
José Miguel Latorre
José Manuel Pastor
Alicia Fernández-Sotos
Miguel A. Salichs
Publication date
01-04-2016
Publisher
Springer US
Published in
Cognitive Computation / Issue 2/2016
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-016-9383-y

Other articles of this Issue 2/2016

Cognitive Computation 2/2016 Go to the issue

Premium Partner