Skip to main content

2016 | OriginalPaper | Buchkapitel

MuDERI: Multimodal Database for Emotion Recognition Among Intellectually Disabled Individuals

verfasst von : Jainendra Shukla, Miguel Barreda-Ángeles, Joan Oliver, Domènec Puig

Erschienen in: Social Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Social robots with empathic interaction is a crucial requirement towards deliverance of an effective cognitive stimulation among individuals with Intellectual Disability (ID) and has been challenged by absence of any particular database. Project REHABIBOTICS presents a first ever multimodal database of individuals with ID, recorded in a nearly real world settings for analysis of human affective states. MuDERI is an annotated multimodal database of audiovisual recordings, RGB-D videos and physiological signals of 12 participants in actual settings, which were recorded as participants were elicited using personalized real world objects and/or activities. The database is publicly available.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rabbitt, S.M., Kazdin, A.E., Scassellati, B.: Integrating socially assistive robotics into mental healthcare interventions: Applications and recommendations for expanded use. Clin. Psychol. Rev. 35, 35–46 (2015)CrossRef Rabbitt, S.M., Kazdin, A.E., Scassellati, B.: Integrating socially assistive robotics into mental healthcare interventions: Applications and recommendations for expanded use. Clin. Psychol. Rev. 35, 35–46 (2015)CrossRef
2.
Zurück zum Zitat Shukla, J., Cristiano, J., Amela, D., Anguera, L., Vergés-Llahí, J., Puig, D.: A case study of robot interaction among individuals with profound and multiple learning disabilities. In: Tapus, A., André, E., Martin, J.-C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 613–622. Springer, Heidelberg (2015). doi:10.1007/978-3-319-25554-5_61 CrossRef Shukla, J., Cristiano, J., Amela, D., Anguera, L., Vergés-Llahí, J., Puig, D.: A case study of robot interaction among individuals with profound and multiple learning disabilities. In: Tapus, A., André, E., Martin, J.-C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 613–622. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-25554-5_​61 CrossRef
3.
Zurück zum Zitat Shukla, J., Cristiano, J., Anguera, L., Vergés-Llahí, J., Puig, D.: A comparison of robot interaction with tactile gaming console stimulation in clinical applications. In: Reis, L.P., Moreira, A.P., Lima, P.U., Montano, L., Muñoz-Martinez, V. (eds.) Robot 2015: Second Iberian Robotics Conference. AISC, vol. 418, pp. 435–445. Springer, Heidelberg (2016). doi:10.1007/978-3-319-27149-1_34 CrossRef Shukla, J., Cristiano, J., Anguera, L., Vergés-Llahí, J., Puig, D.: A comparison of robot interaction with tactile gaming console stimulation in clinical applications. In: Reis, L.P., Moreira, A.P., Lima, P.U., Montano, L., Muñoz-Martinez, V. (eds.) Robot 2015: Second Iberian Robotics Conference. AISC, vol. 418, pp. 435–445. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-27149-1_​34 CrossRef
4.
Zurück zum Zitat Soleymani, M., Lichtenauer, J., Pun, T., et al.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3, 42–55 (2012)CrossRef Soleymani, M., Lichtenauer, J., Pun, T., et al.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3, 42–55 (2012)CrossRef
5.
Zurück zum Zitat Koelstra, S., Muhl, C., Soleymani, M., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3, 18–31 (2012)CrossRef Koelstra, S., Muhl, C., Soleymani, M., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3, 18–31 (2012)CrossRef
6.
Zurück zum Zitat McKeown, G., Valstar, M., Cowie, R., et al.: The SEMAINE database: annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans. Affect. Comput. 3, 5–17 (2012)CrossRef McKeown, G., Valstar, M., Cowie, R., et al.: The SEMAINE database: annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Trans. Affect. Comput. 3, 5–17 (2012)CrossRef
7.
Zurück zum Zitat Sneddon, I., McRorie, M., McKeown, G., Hanratty, J.: The belfast induced natural emotion database. IEEE Trans. Affect. Comput. 3, 32–41 (2012)CrossRef Sneddon, I., McRorie, M., McKeown, G., Hanratty, J.: The belfast induced natural emotion database. IEEE Trans. Affect. Comput. 3, 32–41 (2012)CrossRef
8.
Zurück zum Zitat Ünal, Ö., Özcan, Ö., Öner, Ö., et al.: EEG and MRI findings and their relation with intellectual disability in pervasive developmental disorders. World J. Pediatr. 5, 196–200 (2009)CrossRef Ünal, Ö., Özcan, Ö., Öner, Ö., et al.: EEG and MRI findings and their relation with intellectual disability in pervasive developmental disorders. World J. Pediatr. 5, 196–200 (2009)CrossRef
9.
Zurück zum Zitat Bradley, M.M., Lang, P.J.: Emotion and Motivation. Handbook of Psychophysiology. Cambridge University Press, New York (2007)CrossRef Bradley, M.M., Lang, P.J.: Emotion and Motivation. Handbook of Psychophysiology. Cambridge University Press, New York (2007)CrossRef
10.
Zurück zum Zitat Ekman, P.: An argument for basic emotions. Cogn. Emotion. 6, 169–200 (1992)CrossRef Ekman, P.: An argument for basic emotions. Cogn. Emotion. 6, 169–200 (1992)CrossRef
11.
Zurück zum Zitat Mauss, I.B., Robinson, M.D.: Measures of emotion: A review. Cogn Emot. 23, 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: A review. Cogn Emot. 23, 209–237 (2009)CrossRef
12.
Zurück zum Zitat Barreda-Ángeles, M., Pépion, R., Bosc, E., et al.: Exploring the effects of 3D visual discomfort on viewers emotions. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 753–757 (2014) Barreda-Ángeles, M., Pépion, R., Bosc, E., et al.: Exploring the effects of 3D visual discomfort on viewers emotions. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 753–757 (2014)
13.
Zurück zum Zitat Barreda-Ángeles, M., Arapakis, I., Bai, X., et al.: Unconscious physiological effects of search latency on users and their click behaviour. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 203–212 (2015) Barreda-Ángeles, M., Arapakis, I., Bai, X., et al.: Unconscious physiological effects of search latency on users and their click behaviour. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 203–212 (2015)
14.
Zurück zum Zitat Swangnetr, M., Kaber, D.B.: Emotional state classification in patient robot interaction using wavelet analysis and statistics-based feature selection. IEEE Trans. Hum. Mach. Syst. 43, 63–75 (2013)CrossRef Swangnetr, M., Kaber, D.B.: Emotional state classification in patient robot interaction using wavelet analysis and statistics-based feature selection. IEEE Trans. Hum. Mach. Syst. 43, 63–75 (2013)CrossRef
15.
Zurück zum Zitat Karg, M., Samadani, A.A., Gorbet, R., et al.: Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. Affect. Computing. 4, 341–359 (2013)CrossRef Karg, M., Samadani, A.A., Gorbet, R., et al.: Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. Affect. Computing. 4, 341–359 (2013)CrossRef
16.
Zurück zum Zitat Morris, J.D.: OBSERVATIONS: SAM: the self-assessment manikin-an efficient cross-cultural measurement of emotional response. J. Advertising Res. 35, 38–63 (1995) Morris, J.D.: OBSERVATIONS: SAM: the self-assessment manikin-an efficient cross-cultural measurement of emotional response. J. Advertising Res. 35, 38–63 (1995)
17.
Zurück zum Zitat Bowling, A.: Research Methods in Health: Investigating Health and Health Services. Open University Press, Buckingham (2009) Bowling, A.: Research Methods in Health: Investigating Health and Health Services. Open University Press, Buckingham (2009)
18.
Zurück zum Zitat Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods. 134, 9–21 (2004)CrossRef Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods. 134, 9–21 (2004)CrossRef
19.
Zurück zum Zitat Gomez-Herrero, G., Clercq, W.D., Anwar, H., et al.: Automatic removal of ocular artifacts in the EEG without an EOG reference channel. In: Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006, pp. 130–133 (2006) Gomez-Herrero, G., Clercq, W.D., Anwar, H., et al.: Automatic removal of ocular artifacts in the EEG without an EOG reference channel. In: Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006, pp. 130–133 (2006)
20.
Zurück zum Zitat Benedek, M., Kaernbach, C.: A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190, 80–91 (2010)CrossRef Benedek, M., Kaernbach, C.: A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190, 80–91 (2010)CrossRef
Metadaten
Titel
MuDERI: Multimodal Database for Emotion Recognition Among Intellectually Disabled Individuals
verfasst von
Jainendra Shukla
Miguel Barreda-Ángeles
Joan Oliver
Domènec Puig
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47437-3_26