Skip to main content

2019 | OriginalPaper | Buchkapitel

Perso2U: Exploration of User Emotional States to Drive Interface Adaptation

verfasst von : Julián Andrés Galindo

Erschienen in: Technology Trends

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Taking into account dynamic user properties such as emotions for interfaces adaptation at runtime is a challenging task. To deal with this issue, we propose to personalize user interfaces at runtime based on user’s emotions. This approach depends on emotion recognition tools to allow an Inferring Engine to deduce user emotions during the interaction. However, this inference releases many emotions without aggregating them. It makes more difficult the interpretation of user experience. Thus, we explore the feasibility of inferring similar emotional states (negative, positive and neutral) by grouping individual emotions. To achieve our goal, this paper reports on the results of an experiment to compare detected emotional states from different face recognition tools in web interaction. It evidences that it is feasible to infer similar emotion states (positive, negative, and neutral) from different emotion recognition tools, and the level of this similarity is still premature to have a robust categorization.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003) Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003)
2.
Zurück zum Zitat Reeves, B., Nass, C.: How people treat computers, television, and new media like real people and places. CSLI Publications and Cambridge University Press Cambridge, UK (1996) Reeves, B., Nass, C.: How people treat computers, television, and new media like real people and places. CSLI Publications and Cambridge University Press Cambridge, UK (1996)
3.
Zurück zum Zitat Carberry, S., de Rosis, F.: Introduction to special Issue on ‘affective modeling and adaptation’. User Model. User-Adapt. Interact. 18(1–2), 1–9 (2008) Carberry, S., de Rosis, F.: Introduction to special Issue on ‘affective modeling and adaptation’. User Model. User-Adapt. Interact. 18(1–2), 1–9 (2008)
4.
Zurück zum Zitat Cyr, D.: Emotion and website design. In: Soegaard, M., Dam, R.F. (eds.) The Encyclopedia of Human-Computer Interaction. The Interaction-Design Foundation, Aarhus (2013) Cyr, D.: Emotion and website design. In: Soegaard, M., Dam, R.F. (eds.) The Encyclopedia of Human-Computer Interaction. The Interaction-Design Foundation, Aarhus (2013)
5.
Zurück zum Zitat Nasoz, F.: Adaptive Intelligent User Interfaces With Emotion Recognition. University of Central Florida Orlando, Florida (2004) Nasoz, F.: Adaptive Intelligent User Interfaces With Emotion Recognition. University of Central Florida Orlando, Florida (2004)
6.
Zurück zum Zitat Hudlicka, E., McNeese, M.D.: Assessment of user affective and belief states for interface adaptation: application to an air force pilot task. User Model. User-Adapt. Interact. 12(1), 1–47 (2002) Hudlicka, E., McNeese, M.D.: Assessment of user affective and belief states for interface adaptation: application to an air force pilot task. User Model. User-Adapt. Interact. 12(1), 1–47 (2002)
7.
Zurück zum Zitat Martins, C., Faria, L., De Carvalho, C.V., Carrapatoso, E.: User modeling in adaptive hypermedia educational systems. Educ. Technol. Soc. 11(1), 194–207 (2008) Martins, C., Faria, L., De Carvalho, C.V., Carrapatoso, E.: User modeling in adaptive hypermedia educational systems. Educ. Technol. Soc. 11(1), 194–207 (2008)
8.
Zurück zum Zitat de Rosis, F., Novielli, N., Carofiglio, V., Cavalluzzi, A., Carolis, B.D.: User modeling and adaptation in health promotion dialogs with an animated character. J. Biomed. Inform. 39(5), 514–531 (2006) de Rosis, F., Novielli, N., Carofiglio, V., Cavalluzzi, A., Carolis, B.D.: User modeling and adaptation in health promotion dialogs with an animated character. J. Biomed. Inform. 39(5), 514–531 (2006)
9.
Zurück zum Zitat Rowe, J., Mott, B., McQuiggan, S., Robison, J., Lee, S., Lester, J.: Crystal island: a narrative-centered learning environment for eighth grade microbiology. In: Workshop on Intelligent Educational Games at the 14th International Conference on Artificial Intelligence in Education, pp. 11–20, Brighton, UK (2009) Rowe, J., Mott, B., McQuiggan, S., Robison, J., Lee, S., Lester, J.: Crystal island: a narrative-centered learning environment for eighth grade microbiology. In: Workshop on Intelligent Educational Games at the 14th International Conference on Artificial Intelligence in Education, pp. 11–20, Brighton, UK (2009)
10.
Zurück zum Zitat Forbes-Riley, K., Litman, D.: Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system. Comput. Speech Lang. 25(1), 105–126 (2011) Forbes-Riley, K., Litman, D.: Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system. Comput. Speech Lang. 25(1), 105–126 (2011)
11.
Zurück zum Zitat Porayska-Pomsta, K., Mavrikis, M., Pain, H.: Diagnosing and acting on student affect: the tutor’s perspective. User Model. User-Adapt. Interact. 18(1–2), 125–173 (2008) Porayska-Pomsta, K., Mavrikis, M., Pain, H.: Diagnosing and acting on student affect: the tutor’s perspective. User Model. User-Adapt. Interact. 18(1–2), 125–173 (2008)
12.
Zurück zum Zitat Graesser, A.C., et al.: The relationship between affective states and dialog patterns during interactions with AutoTutor. J. Interact. Learn. Res. 19(2), 293 (2008) Graesser, A.C., et al.: The relationship between affective states and dialog patterns during interactions with AutoTutor. J. Interact. Learn. Res. 19(2), 293 (2008)
13.
Zurück zum Zitat Meudt, S., et al.: Going further in affective computing: how emotion recognition can improve adaptive user interaction. In: Esposito, A., Jain, L.C. (eds.) Toward Robotic Socially Believable Behaving Systems, vol. 105, pp. 73–103. Springer International Publishing, Cham (2016) Meudt, S., et al.: Going further in affective computing: how emotion recognition can improve adaptive user interaction. In: Esposito, A., Jain, L.C. (eds.) Toward Robotic Socially Believable Behaving Systems, vol. 105, pp. 73–103. Springer International Publishing, Cham (2016)
14.
Zurück zum Zitat Märtin, C., Rashid, S., Herdin, C.: Designing responsive interactive applications by emotion-tracking and pattern-based dynamic user interface adaptation. In: Kurosu, M. (ed.) HCI 2016, Part III. LNCS, vol. 9733, pp. 28–36. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39513-5_3 Märtin, C., Rashid, S., Herdin, C.: Designing responsive interactive applications by emotion-tracking and pattern-based dynamic user interface adaptation. In: Kurosu, M. (ed.) HCI 2016, Part III. LNCS, vol. 9733, pp. 28–36. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-39513-5_​3
15.
Zurück zum Zitat Hudlicka, E.: Increaing sia architecture realism by modeling and adapting to affect and personality. In: Dautenhahn, K., Bond, A., Cañamero, L., Edmonds, B. (eds.) Socially Intelligent Agents. Multiagent Systems, Artificial Societies, and Simulated Organizations, pp. 53–60. Springer, Boston (2002). https://doi.org/10.1007/0-306-47373-9_6 Hudlicka, E.: Increaing sia architecture realism by modeling and adapting to affect and personality. In: Dautenhahn, K., Bond, A., Cañamero, L., Edmonds, B. (eds.) Socially Intelligent Agents. Multiagent Systems, Artificial Societies, and Simulated Organizations, pp. 53–60. Springer, Boston (2002). https://​doi.​org/​10.​1007/​0-306-47373-9_​6
16.
Zurück zum Zitat Plutchik, R., Kellerman, H.: Theories of Emotion, vol. 1 of Emotion: Theory, Research, and Experience. Academic Press, New York (1980) Plutchik, R., Kellerman, H.: Theories of Emotion, vol. 1 of Emotion: Theory, Research, and Experience. Academic Press, New York (1980)
17.
Zurück zum Zitat Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44(4), 695–729 (2005) Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44(4), 695–729 (2005)
18.
Zurück zum Zitat Fischer, G.: User modeling in human–computer interaction. User Model. User-Adapt. Interact. 11(1–2), 65–86 (2001) Fischer, G.: User modeling in human–computer interaction. User Model. User-Adapt. Interact. 11(1–2), 65–86 (2001)
19.
Zurück zum Zitat Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. J. Res. Pers. 11(3), 273–294 (1977) Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. J. Res. Pers. 11(3), 273–294 (1977)
20.
Zurück zum Zitat Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994) Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)
21.
Zurück zum Zitat Märtin, C., Herdin, C., Engel, J.: Model-based user-interface adaptation by exploiting situations, emotions and software patterns. In: International Conference on Computer-Human Interaction Research and Applications (2017) Märtin, C., Herdin, C., Engel, J.: Model-based user-interface adaptation by exploiting situations, emotions and software patterns. In: International Conference on Computer-Human Interaction Research and Applications (2017)
22.
Zurück zum Zitat Galindo, J., Dupuy-Chessa, S., Céret, E.: Toward a UI adaptation approach driven by user emotions. In: Presented at the ACHI07, Nice, France (2017) Galindo, J., Dupuy-Chessa, S., Céret, E.: Toward a UI adaptation approach driven by user emotions. In: Presented at the ACHI07, Nice, France (2017)
23.
Zurück zum Zitat Céret, E., Dupuy-Chessa, S., Calvary, G., Bittar, M.: System and method for magnetic adaptation of a user interface. TPI2015053 déposé via France INPI le 7 juillet 2015, 2ème dépôt le 7 juillet (2016) Céret, E., Dupuy-Chessa, S., Calvary, G., Bittar, M.: System and method for magnetic adaptation of a user interface. TPI2015053 déposé via France INPI le 7 juillet 2015, 2ème dépôt le 7 juillet (2016)
24.
Zurück zum Zitat Dupuy-Chessa, S., Laurillau, Y., Céret, E.: Considering aesthetics and usability temporalities in a model based development process. In: Actes de la 28ième conférence francophone sur l’Interaction Homme-Machine, pp. 25–35 (2016) Dupuy-Chessa, S., Laurillau, Y., Céret, E.: Considering aesthetics and usability temporalities in a model based development process. In: Actes de la 28ième conférence francophone sur l’Interaction Homme-Machine, pp. 25–35 (2016)
25.
Zurück zum Zitat Posner, J., Russell, J.A., Peterson, B.S.: The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17(3), 715–734 (2005) Posner, J., Russell, J.A., Peterson, B.S.: The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17(3), 715–734 (2005)
26.
Zurück zum Zitat Steunebrink, B.R., et al.: The Logical structure of emotions (2010) Steunebrink, B.R., et al.: The Logical structure of emotions (2010)
27.
Zurück zum Zitat Pearson, K.X.: On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Lond. Edinb. Dublin Philos. Mag. J. Sci. 50(302), 157–175 (1900) Pearson, K.X.: On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Lond. Edinb. Dublin Philos. Mag. J. Sci. 50(302), 157–175 (1900)
28.
Zurück zum Zitat Karl Pearson, F.R.S.: Mathematical Contributions to the Theory of Evolution. Dulau Co, London (1904) Karl Pearson, F.R.S.: Mathematical Contributions to the Theory of Evolution. Dulau Co, London (1904)
29.
Zurück zum Zitat Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20(1), 37–46 (1960) Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20(1), 37–46 (1960)
30.
Zurück zum Zitat Hume, D.: Emotions and moods. In: Robbins, S.P., Judge, T.A. (eds.) Organizational Behavior, pp. 258–297. Pearson Prentice Hall, Upper Saddle River (2012) Hume, D.: Emotions and moods. In: Robbins, S.P., Judge, T.A. (eds.) Organizational Behavior, pp. 258–297. Pearson Prentice Hall, Upper Saddle River (2012)
31.
Zurück zum Zitat Larsen, R.J., Diener, E.: Affect intensity as an individual difference characteristic: a review. J. Res. Pers. 21(1), 1–39 (1987) Larsen, R.J., Diener, E.: Affect intensity as an individual difference characteristic: a review. J. Res. Pers. 21(1), 1–39 (1987)
32.
Zurück zum Zitat Diener, E., Sandvik, E., Larsen, R.J.: Age and sex effects for emotional intensity. Dev. Psychol. 21(3), 542 (1985) Diener, E., Sandvik, E., Larsen, R.J.: Age and sex effects for emotional intensity. Dev. Psychol. 21(3), 542 (1985)
33.
Zurück zum Zitat Watson, D.: Mood and Temperament. Guilford Press, New York (2000) Watson, D.: Mood and Temperament. Guilford Press, New York (2000)
Metadaten
Titel
Perso2U: Exploration of User Emotional States to Drive Interface Adaptation
verfasst von
Julián Andrés Galindo
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-05532-5_21