Skip to main content
Top

2015 | OriginalPaper | Chapter

HCI and Natural Progression of Context-Related Questions

Authors : Aggeliki Vlachostergiou, George Caridakis, Amaryllis Raouzaiou, Stefanos Kollias

Published in: Human-Computer Interaction: Design and Evaluation

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The ability of humans to effectively interact socially relies heavily on their awareness of the context the interaction takes place. In order for computer systems to accordingly possess the same ability, it is crucial they are also context-aware in terms of a formalization of context based on the W5+ framework aspects of Who, What, Why, Where, What and How. Research work presented in this paper contributes towards this goal by bridging the conceptual gap and exploiting semantics and cognitive and affective information of non verbal behavior and investigating whether and how this information could be incorporated in automatic analysis of affective behavior. A semantic concept extraction methodology is proposed and its application to indicative examples from the SEMAINE corpus is presented that validates the proposed approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The window length corresponds to 16 conversational turns and is displayed on figures for future visualization purposes.
 
Literature
2.
go back to reference Bock, R., Wendemuth, A., Gluge, S., Siegert, I.: Annotation and classification of changes of involvement in group conversation. In: Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 803–808. IEEE (2013) Bock, R., Wendemuth, A., Gluge, S., Siegert, I.: Annotation and classification of changes of involvement in group conversation. In: Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 803–808. IEEE (2013)
3.
go back to reference Bradley, M.M., Lang, P.J.: Affective norms for english words (anew): instruction manual and affective ratings. Technical report C-1, The Center for Research in Psychophysiology, University of Florida (1999) Bradley, M.M., Lang, P.J.: Affective norms for english words (anew): instruction manual and affective ratings. Technical report C-1, The Center for Research in Psychophysiology, University of Florida (1999)
4.
go back to reference Brown, P.J., Bovey, J.D., Chen, X.: Context-aware applications: from the laboratory to the marketplace. Pers. Commun. 4(5), 58–64 (1997)CrossRef Brown, P.J., Bovey, J.D., Chen, X.: Context-aware applications: from the laboratory to the marketplace. Pers. Commun. 4(5), 58–64 (1997)CrossRef
5.
go back to reference Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)CrossRef Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)CrossRef
6.
go back to reference Cambria, E., Hussain, A., Havasi, C., Eckl, C.: SenticSpace: visualizing opinions and sentiments in a multi-dimensional vector space. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds.) KES 2010, Part IV. LNCS, vol. 6279, pp. 385–393. Springer, Heidelberg (2010) CrossRef Cambria, E., Hussain, A., Havasi, C., Eckl, C.: SenticSpace: visualizing opinions and sentiments in a multi-dimensional vector space. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds.) KES 2010, Part IV. LNCS, vol. 6279, pp. 385–393. Springer, Heidelberg (2010) CrossRef
7.
go back to reference Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? judging emotion from the face in context. J. Pers. Soc. Psychol. 70(2), 205 (1996)CrossRef Carroll, J.M., Russell, J.A.: Do facial expressions signal specific emotions? judging emotion from the face in context. J. Pers. Soc. Psychol. 70(2), 205 (1996)CrossRef
8.
go back to reference Castellano, G., Caridakis, G., Camurri, A., Karpouzis, K., Volpe, G., Kollias, S.: Body gesture and facial expression analysis for automatic affect recognition. In: Scherer, K.R., Bänziger, T., Roesch, E.B. (eds.) Blueprint for Affective Computing: A Sourcebook, pp. 245–255. Oxford University Press, New York (2010) Castellano, G., Caridakis, G., Camurri, A., Karpouzis, K., Volpe, G., Kollias, S.: Body gesture and facial expression analysis for automatic affect recognition. In: Scherer, K.R., Bänziger, T., Roesch, E.B. (eds.) Blueprint for Affective Computing: A Sourcebook, pp. 245–255. Oxford University Press, New York (2010)
9.
go back to reference Duric, Z., Gray, W.D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M.J., Schunn, C., Wechsler, H.: Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. Proc. IEEE 90(7), 1272–1289 (2002)CrossRef Duric, Z., Gray, W.D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M.J., Schunn, C., Wechsler, H.: Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. Proc. IEEE 90(7), 1272–1289 (2002)CrossRef
10.
go back to reference El Kaliouby, R., Robinson, P., Keates, S.: Temporal context and the recognition of emotion from facial expression. In: Proceedings of the HCI International Conference, pp. 631–635. American Psychological Association (2003) El Kaliouby, R., Robinson, P., Keates, S.: Temporal context and the recognition of emotion from facial expression. In: Proceedings of the HCI International Conference, pp. 631–635. American Psychological Association (2003)
11.
go back to reference Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of the 5th Conference on Language Resources and Evaluation, LREC 2006, vol. 6, pp. 417–422 (2006) Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of the 5th Conference on Language Resources and Evaluation, LREC 2006, vol. 6, pp. 417–422 (2006)
12.
go back to reference Gunes, H., Schuller, B.: Categorical and dimensional affect analysis in continuous input: current trends and future directions. Image Vis. Comput. 31(2), 120–136 (2013)CrossRef Gunes, H., Schuller, B.: Categorical and dimensional affect analysis in continuous input: current trends and future directions. Image Vis. Comput. 31(2), 120–136 (2013)CrossRef
13.
go back to reference Knudsen, H.R., Muzekari, L.H.: The effects of verbal statements of context on facial expressions of emotion. J. Nonverbal Behav. 7(4), 202–212 (1983)CrossRef Knudsen, H.R., Muzekari, L.H.: The effects of verbal statements of context on facial expressions of emotion. J. Nonverbal Behav. 7(4), 202–212 (1983)CrossRef
14.
go back to reference Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRef Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRef
15.
go back to reference Masuda, T., Ellsworth, P.C., Mesquita, B., Leu, J., Tanida, S., Van de Veerdonk, E.: Placing the face in context: cultural differences in the perception of facial emotion. J. Pers. Soc. Psychol. 94(3), 365 (2008)CrossRef Masuda, T., Ellsworth, P.C., Mesquita, B., Leu, J., Tanida, S., Van de Veerdonk, E.: Placing the face in context: cultural differences in the perception of facial emotion. J. Pers. Soc. Psychol. 94(3), 365 (2008)CrossRef
16.
go back to reference McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.: The semaine database: annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans. Affect. Comput. 3(1), 5–17 (2012)CrossRef McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.: The semaine database: annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans. Affect. Comput. 3(1), 5–17 (2012)CrossRef
17.
go back to reference Miller, G.A.: Wordnet: a lexical database for english. Commun. ACM 38(11), 39–41 (1995)CrossRef Miller, G.A.: Wordnet: a lexical database for english. Commun. ACM 38(11), 39–41 (1995)CrossRef
18.
go back to reference Mortillaro, M., Meuleman, B., Scherer, K.R.: Advocating a componential appraisal model to guide emotion recognition. Int. J. Synth. Emot. (IJSE) 3(1), 18–32 (2012)CrossRef Mortillaro, M., Meuleman, B., Scherer, K.R.: Advocating a componential appraisal model to guide emotion recognition. Int. J. Synth. Emot. (IJSE) 3(1), 18–32 (2012)CrossRef
19.
go back to reference Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inform. Retrieval 2(1–2), 1–135 (2008)CrossRef Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inform. Retrieval 2(1–2), 1–135 (2008)CrossRef
20.
go back to reference Plutchik, R.: The nature of emotions human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am. Sci. 89(4), 344–350 (2001)CrossRef Plutchik, R.: The nature of emotions human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am. Sci. 89(4), 344–350 (2001)CrossRef
21.
go back to reference Russell, J.A.: Affective space is bipolar. J. Pers. Soc. Psychol. 37(3), 345 (1979)CrossRef Russell, J.A.: Affective space is bipolar. J. Pers. Soc. Psychol. 37(3), 345 (1979)CrossRef
22.
go back to reference Strapparava, C., Valitutti, A., et al.: Wordnet affect: an affective extension of wordnet. In: LREC, vol. 4, pp. 1083–1086 (2004) Strapparava, C., Valitutti, A., et al.: Wordnet affect: an affective extension of wordnet. In: LREC, vol. 4, pp. 1083–1086 (2004)
23.
go back to reference Tsai, A.C.R., Wu, C.E., Tsai, R.T.H., Hsu, J.Y., et al.: Building a concept-level sentiment dictionary based on commonsense knowledge. IEEE Intell. Syst. 28(2), 22–30 (2013)CrossRef Tsai, A.C.R., Wu, C.E., Tsai, R.T.H., Hsu, J.Y., et al.: Building a concept-level sentiment dictionary based on commonsense knowledge. IEEE Intell. Syst. 28(2), 22–30 (2013)CrossRef
24.
go back to reference Vinciarelli, A., Pantic, M., Bourlard, H.: Social signal processing: survey of an emerging domain. Image Vis. Comput. 27, 1743–1759 (2009)CrossRef Vinciarelli, A., Pantic, M., Bourlard, H.: Social signal processing: survey of an emerging domain. Image Vis. Comput. 27, 1743–1759 (2009)CrossRef
25.
go back to reference Vlachostergiou, A., Caridakis, G., Kollias, S.: Context in affective multiparty and multimodal interaction: why, which, how and where? In: Workshop on Understanding and Modeling Multiparty, Multimodal Interactions (UMMMI 2014), pp. 3–8 (2014) Vlachostergiou, A., Caridakis, G., Kollias, S.: Context in affective multiparty and multimodal interaction: why, which, how and where? In: Workshop on Understanding and Modeling Multiparty, Multimodal Interactions (UMMMI 2014), pp. 3–8 (2014)
26.
go back to reference Vlachostergiou, A., Caridakis, G., Kollias, S.: Investigating context awareness of affective computing systems: a critical approach. In: 6th International Conference on Intelligence Human Computer Interaction (IHCI 2014) (2014) Vlachostergiou, A., Caridakis, G., Kollias, S.: Investigating context awareness of affective computing systems: a critical approach. In: 6th International Conference on Intelligence Human Computer Interaction (IHCI 2014) (2014)
27.
go back to reference Whissell, C.: The dictionary of affect in language. Emot. Theory, Res. Experience 4, 113–131, 94 (1989) Whissell, C.: The dictionary of affect in language. Emot. Theory, Res. Experience 4, 113–131, 94 (1989)
28.
go back to reference Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)CrossRef Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)CrossRef
Metadata
Title
HCI and Natural Progression of Context-Related Questions
Authors
Aggeliki Vlachostergiou
George Caridakis
Amaryllis Raouzaiou
Stefanos Kollias
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-20901-2_50