Skip to main content

2021 | OriginalPaper | Buchkapitel

Emotion Detection Based on Smartphone Using User Memory Tasks and Videos

verfasst von : Nicolas Simonazzi, Jean-Marc Salotti, Caroline Dubois, Dominique Seminel

Erschienen in: Human Interaction, Emerging Technologies and Future Applications III

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a research study on the classification of emotions, through data gathered on a smartphone. To this end, we have developed a mobile application to elicit emotions in participants using memory tasks with success – failure manipulation and also using video clips. Interactions were recorded with accelerometer and gyroscope sensors records and keystroke on the device. We trained supervised classification models, with the records, to predict the nature of emotion elicited on two dimensions (pleasure and activation) and the success or failure related tasks memory tasks. In order to evaluate the emotion induction we have proposed a self-assessment procedure. We achieved interesting results on the pleasure dimension, by proposing a protocol with natural interactions on smartphone.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Picard, R.: Affective computing. Perceptual Computing Section, Media Laboratory, Massachusetts Institute of Technology (1995) Picard, R.: Affective computing. Perceptual Computing Section, Media Laboratory, Massachusetts Institute of Technology (1995)
2.
Zurück zum Zitat Hudlicka, E.: Guidelines for designing computational models of emotions. Int. J. Synth. Emot. (IJSE) 2, 26–79 (2011)CrossRef Hudlicka, E.: Guidelines for designing computational models of emotions. Int. J. Synth. Emot. (IJSE) 2, 26–79 (2011)CrossRef
3.
Zurück zum Zitat Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992)CrossRef Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992)CrossRef
4.
Zurück zum Zitat Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161 (1980)CrossRef Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161 (1980)CrossRef
5.
Zurück zum Zitat Poria, S., Cambria, E., Bajpai, R.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)CrossRef Poria, S., Cambria, E., Bajpai, R.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)CrossRef
6.
Zurück zum Zitat Olsen, A.: Smartphone accelerometer data used for detecting human emotions, pp. 410–415 (2016) Olsen, A.: Smartphone accelerometer data used for detecting human emotions, pp. 410–415 (2016)
7.
Zurück zum Zitat Coutrix, C.: Identifying emotions expressed by mobile users through 2D surface and 3D motion gestures, pp. 311–320 (2012) Coutrix, C.: Identifying emotions expressed by mobile users through 2D surface and 3D motion gestures, pp. 311–320 (2012)
8.
Zurück zum Zitat Ghosh, S., Ganguly, N., Mitra, B.: TapSense: combining self-report patterns and typing characteristics for smartphone based emotion detection (2017) Ghosh, S., Ganguly, N., Mitra, B.: TapSense: combining self-report patterns and typing characteristics for smartphone based emotion detection (2017)
9.
Zurück zum Zitat Cui, L., Li, S.: Emotion detection from natural walking, pp. 23–33 (2016) Cui, L., Li, S.: Emotion detection from natural walking, pp. 23–33 (2016)
10.
Zurück zum Zitat Epp, C., Lippold, M.: Identifying emotional states using keystroke dynamics, pp. 715–724 (2011) Epp, C., Lippold, M.: Identifying emotional states using keystroke dynamics, pp. 715–724 (2011)
11.
Zurück zum Zitat Ferrer, R.A., Grenen, E.G., Taber, J.M.: Effectiveness of internet-based affect induction procedures: a systematic review and meta-analysis. Emotion 15(6), 752 (2015)CrossRef Ferrer, R.A., Grenen, E.G., Taber, J.M.: Effectiveness of internet-based affect induction procedures: a systematic review and meta-analysis. Emotion 15(6), 752 (2015)CrossRef
12.
Zurück zum Zitat Nummenmaa, L., Niemi, P.: Inducing affective states with success-failure manipulations: a meta-analysis. Emotion 4(2), 207 (2004)CrossRef Nummenmaa, L., Niemi, P.: Inducing affective states with success-failure manipulations: a meta-analysis. Emotion 4(2), 207 (2004)CrossRef
13.
Zurück zum Zitat Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994) Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)
14.
Zurück zum Zitat Anguita, D., Ghio, A., Oneto, L., Parra, X.: A public domain dataset for human activity recognition using smartphones (2013) Anguita, D., Ghio, A., Oneto, L., Parra, X.: A public domain dataset for human activity recognition using smartphones (2013)
15.
Zurück zum Zitat Khan, A., Lee, Y.-K., Lee, S.-Y.: Human activity recognition via an accelerometer-enabled-smartphone using kernel discriminant analysis, pp. 1–6 (2010) Khan, A., Lee, Y.-K., Lee, S.-Y.: Human activity recognition via an accelerometer-enabled-smartphone using kernel discriminant analysis, pp. 1–6 (2010)
Metadaten
Titel
Emotion Detection Based on Smartphone Using User Memory Tasks and Videos
verfasst von
Nicolas Simonazzi
Jean-Marc Salotti
Caroline Dubois
Dominique Seminel
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-55307-4_37