Skip to main content
Top

2020 | OriginalPaper | Chapter

Enabling Multimodal Emotionally-Aware Ecosystems Through a W3C-Aligned Generic Interaction Modality

Authors : David Ferreira, Nuno Almeida, Susana Brás, Sandra C. Soares, António Teixeira, Samuel Silva

Published in: Wireless Mobile Communication and Healthcare

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Emotions play a key role in our life experiences. In interactive systems, the user’s emotional state can be relevant to provide increased levels of adaptation to the user, but can also be paramount in scenarios where such information might enable us to help users manage and express their emotions (e.g., anxiety), with a positive impact on their daily life and on how they interact with others. However, although there is a clear potential for emotionally-aware applications, they still have a long road to travel to reach the desired potential and availability. This is mostly due to the still low translational nature of the research in affective computing, and to the lack of straightforward, off-the-shelf methods for easy integration of emotion in applications without the need for developers to master the different concepts and technologies involved. In light of these challenges, we advance our previous work and propose an extended conceptual vision for supporting emotionally-aware interactive ecosystems and a fast track to ensure the desired translational nature of the research in affective computing. This vision then leads to the proposal of an improved iteration of a generic affective modality, a key resource to the accomplishment of the proposed vision, enabling off-the-shelf support for emotionally-aware applications in multimodal interactive contexts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alavi, H.S., Verma, H., Papinutto, M., Lalanne, D.: Comfort: a coordinate of user experience in interactive built environments. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., ONeill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10515, pp. 247–257. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67687-6_16CrossRef Alavi, H.S., Verma, H., Papinutto, M., Lalanne, D.: Comfort: a coordinate of user experience in interactive built environments. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., ONeill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10515, pp. 247–257. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-67687-6_​16CrossRef
4.
go back to reference Almeida, N., Teixeira, A., Silva, S., Ketsmur, M.: The am4i architecture and framework for multimodal interaction and its application to smart environments. Sensors 19(11), 2587 (2019)CrossRef Almeida, N., Teixeira, A., Silva, S., Ketsmur, M.: The am4i architecture and framework for multimodal interaction and its application to smart environments. Sensors 19(11), 2587 (2019)CrossRef
5.
go back to reference Barrett, L.F.: How Emotions are Made: The Secret Life of the Brain. Houghton Mifflin Harcourt, Boston (2017) Barrett, L.F.: How Emotions are Made: The Secret Life of the Brain. Houghton Mifflin Harcourt, Boston (2017)
6.
go back to reference Brigham, T.J.: Merging technology and emotions: introduction to affective computing. Med. Reference Serv. Q. 36(4), 399–407 (2017)MathSciNetCrossRef Brigham, T.J.: Merging technology and emotions: introduction to affective computing. Med. Reference Serv. Q. 36(4), 399–407 (2017)MathSciNetCrossRef
9.
go back to reference Gay, V., Leijdekkers, P., Agcanas, J., Wong, F., Wu, Q.: CaptureMyEmotion: helping autistic children understand their emotions using facial expression recognition and mobile technologies. Stud. Health Technol. Inform. 189, 71–76 (2013) Gay, V., Leijdekkers, P., Agcanas, J., Wong, F., Wu, Q.: CaptureMyEmotion: helping autistic children understand their emotions using facial expression recognition and mobile technologies. Stud. Health Technol. Inform. 189, 71–76 (2013)
10.
go back to reference Henriques, T., Soares, S.C., Silva, S., Almeida, N., Brás, S., Teixeira, A.: Emotionally-aware multimodal interfaces: preliminary work on a generic affective modality. DSAI 2018, 20–22 June 2018, Thessaloniki, Greece (2018) Henriques, T., Soares, S.C., Silva, S., Almeida, N., Brás, S., Teixeira, A.: Emotionally-aware multimodal interfaces: preliminary work on a generic affective modality. DSAI 2018, 20–22 June 2018, Thessaloniki, Greece (2018)
12.
go back to reference Picard, R.W.: Emotion research by the people, for the people. Emotion Rev. 2(3), 250–254 (2010)CrossRef Picard, R.W.: Emotion research by the people, for the people. Emotion Rev. 2(3), 250–254 (2010)CrossRef
13.
go back to reference Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fus. 37, 98–125 (2017)CrossRef Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fus. 37, 98–125 (2017)CrossRef
14.
go back to reference Schmidt, A.: Implicit human computer interaction through context. Personal Technol. 4(2–3), 191–199 (2000)CrossRef Schmidt, A.: Implicit human computer interaction through context. Personal Technol. 4(2–3), 191–199 (2000)CrossRef
15.
go back to reference Serrano, M., Nigay, L., Lawson, J.Y.L., Ramsay, A., Murray-Smith, R., Denef, S.: The openinterface framework: a tool for multimodal interaction. In: Proceeding of the Twenty-Sixth Annual CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI 2008, p. 3501. ACM Press, New York, April 2008. https://doi.org/10.1145/1358628.1358881 Serrano, M., Nigay, L., Lawson, J.Y.L., Ramsay, A., Murray-Smith, R., Denef, S.: The openinterface framework: a tool for multimodal interaction. In: Proceeding of the Twenty-Sixth Annual CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI 2008, p. 3501. ACM Press, New York, April 2008. https://​doi.​org/​10.​1145/​1358628.​1358881
16.
go back to reference Sucala, M., et al.: Anxiety: there is an app for that. a systematic review of anxiety apps. Depression and Anxiety 34, 518–525 (2017)CrossRef Sucala, M., et al.: Anxiety: there is an app for that. a systematic review of anxiety apps. Depression and Anxiety 34, 518–525 (2017)CrossRef
17.
go back to reference Solovey, E.T., Afergan, D., Peck, E.M., Hincks, S.W., Jacob, R.J.K.: Designing implicit interfaces for physiological computing (2015) Solovey, E.T., Afergan, D., Peck, E.M., Hincks, S.W., Jacob, R.J.K.: Designing implicit interfaces for physiological computing (2015)
19.
go back to reference Tyng, C.M., Amin, H.U., Saad, M., Malik, A.S.: The influences of emotion on learning and memory. Front. Psychol. 8, 1454 (2017)CrossRef Tyng, C.M., Amin, H.U., Saad, M., Malik, A.S.: The influences of emotion on learning and memory. Front. Psychol. 8, 1454 (2017)CrossRef
Metadata
Title
Enabling Multimodal Emotionally-Aware Ecosystems Through a W3C-Aligned Generic Interaction Modality
Authors
David Ferreira
Nuno Almeida
Susana Brás
Sandra C. Soares
António Teixeira
Samuel Silva
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-49289-2_11

Premium Partner