Skip to main content

2018 | OriginalPaper | Buchkapitel

Using Emotion Recognition in Intelligent Interface Design for Elderly Care

verfasst von : Salik Khanal, Arsénio Reis, João Barroso, Vitor Filipe

Erschienen in: Trends and Advances in Information Systems and Technologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the later stages of the aging process, an elderly person might need the help of a family member or a caregiver. Technology can be used to help to take care of elderly persons. Autonomous systems, using special interfaces, can collect information from elderly people, which might be useful to predict and recognize health related problems or physical security problems in real time. The emerging technology of image processing, in particular, the emotion recognition, can be a good option to use in elderly care support systems. In this article, we implemented a Microsoft Azure – Emotion SDK to recognize emotion of elderly that able to detect faces and recognize emotions in real time and to be used for elderly care support. The analysis is done with an online video stream, which analyzes facial expression, so that in case of a critical emotion, e.g., if an elderly is very sad or crying, it will inform a caregiver or related entity. From the experiment, we concluded that emotion recognition is a reliable technology to be implemented in real time elderly care.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hertog, S.: World Population Ageing 2017. United Nations Department of Economic and Social Affairs, Population Division, New York, USA (2017) Hertog, S.: World Population Ageing 2017. United Nations Department of Economic and Social Affairs, Population Division, New York, USA (2017)
2.
Zurück zum Zitat Carvalho, A.C.: Sensos 2011. Resultados Provisorious, Lisbon (2011) Carvalho, A.C.: Sensos 2011. Resultados Provisorious, Lisbon (2011)
3.
Zurück zum Zitat Reis, A., Paredes, H., Barroso, I., Monteiro, M., Rodrigues, V., Khanal, S.R., Barroso, J.: Autonomous systems to support social activity of elderly people - a prospective approach to a system design. In: International Conference on Technology and Innovation on Sports, Health and Wellbeing, TISHW 2016, 1–3 December, 2016. UTAD, Vila Real (2016). https://doi.org/10.1109/tishw.2016.7847773 Reis, A., Paredes, H., Barroso, I., Monteiro, M., Rodrigues, V., Khanal, S.R., Barroso, J.: Autonomous systems to support social activity of elderly people - a prospective approach to a system design. In: International Conference on Technology and Innovation on Sports, Health and Wellbeing, TISHW 2016, 1–3 December, 2016. UTAD, Vila Real (2016). https://​doi.​org/​10.​1109/​tishw.​2016.​7847773
4.
Zurück zum Zitat He, D., Li, Z., Gao, X., Li, M., Yin, Y., Lu, K.: The research of elderly care system based on video image processing system. IEEE, Santa Clara, CA, USA, pp. 254–258 (2016) He, D., Li, Z., Gao, X., Li, M., Yin, Y., Lu, K.: The research of elderly care system based on video image processing system. IEEE, Santa Clara, CA, USA, pp. 254–258 (2016)
5.
Zurück zum Zitat Reis, A., Paulino, D., Paredes, H., Barroso, J.: Using intelligent personal assistants to strengthen the elderlies’ social bonds. In: Universal Access in Human–Computer Interaction. Human and Technological Environments, January 2017, pp. 593–602 (2017). https://doi.org/10.1007/978-3-319-58700-4_48. ISBN 978-3-319-58699-1CrossRef Reis, A., Paulino, D., Paredes, H., Barroso, J.: Using intelligent personal assistants to strengthen the elderlies’ social bonds. In: Universal Access in Human–Computer Interaction. Human and Technological Environments, January 2017, pp. 593–602 (2017). https://​doi.​org/​10.​1007/​978-3-319-58700-4_​48. ISBN 978-3-319-58699-1CrossRef
6.
Zurück zum Zitat Reis A., Barroso, I., Monteiro, M., Khanal, S.R., Rodrigues, V., Filipe, V., Paredes, H., Barroso, J.: Designing autonomous systems interactions with elderly people. In: Universal Access in Human–Computer Interaction. Human and Technological Environments, January 2017, pp. 603–611 (2017). https://doi.org/10.1007/978-3-319-58700-4_49. ISBN 978-3-319-58699-1CrossRef Reis A., Barroso, I., Monteiro, M., Khanal, S.R., Rodrigues, V., Filipe, V., Paredes, H., Barroso, J.: Designing autonomous systems interactions with elderly people. In: Universal Access in Human–Computer Interaction. Human and Technological Environments, January 2017, pp. 603–611 (2017). https://​doi.​org/​10.​1007/​978-3-319-58700-4_​49. ISBN 978-3-319-58699-1CrossRef
7.
Zurück zum Zitat Gnanavel, R., Anjana, P., Nappinnai, K.S., Sahari, N.P.: Smart home system using a wireless sensor network for elderly care. IEEE, Chennai, India (2016) Gnanavel, R., Anjana, P., Nappinnai, K.S., Sahari, N.P.: Smart home system using a wireless sensor network for elderly care. IEEE, Chennai, India (2016)
9.
Zurück zum Zitat Faulkner, J., Eston, R.J.: Perceived exertion research in the 21st century: developments, reflections and questions for the future. J. Exerc. Sci. Fitness 6(1), 1–12 (2008) Faulkner, J., Eston, R.J.: Perceived exertion research in the 21st century: developments, reflections and questions for the future. J. Exerc. Sci. Fitness 6(1), 1–12 (2008)
10.
Zurück zum Zitat Huanga, D.H., Chioua, W.K., Chenb, B.H.: Judgment of perceived exertion by static and dynamic facial expression. In: Triennial Congress of the IEA, Melbourne, pp. 1–7 (2015) Huanga, D.H., Chioua, W.K., Chenb, B.H.: Judgment of perceived exertion by static and dynamic facial expression. In: Triennial Congress of the IEA, Melbourne, pp. 1–7 (2015)
11.
Zurück zum Zitat Leat, M., Mei, S.J.: Quantitative assessment of perceived visibility enhancement with image processing for single face images: a preliminary study. Invest. Ophthalmol. Vis. Sci. 50, 4502–4508 (2008) Leat, M., Mei, S.J.: Quantitative assessment of perceived visibility enhancement with image processing for single face images: a preliminary study. Invest. Ophthalmol. Vis. Sci. 50, 4502–4508 (2008)
12.
Zurück zum Zitat Chaudhuri, S., Thompson, H., Demiris, G.: Fall detection devices and their use with older adults: a systematic review. J. Geriatr. Phys. Ther. 34(4), 178–196 (2014)CrossRef Chaudhuri, S., Thompson, H., Demiris, G.: Fall detection devices and their use with older adults: a systematic review. J. Geriatr. Phys. Ther. 34(4), 178–196 (2014)CrossRef
13.
Zurück zum Zitat Yu, X.: Approaches and principles of fall detection for elderly and patient. IEEE, Singapore (2008) Yu, X.: Approaches and principles of fall detection for elderly and patient. IEEE, Singapore (2008)
14.
Zurück zum Zitat Docampo, G.N.: Heart rate estimation using facial video information, Pontevedra (2012) Docampo, G.N.: Heart rate estimation using facial video information, Pontevedra (2012)
15.
Zurück zum Zitat Liukkonen, T.N., Tuomas, M., Hanna, A., Toni, H., Reetta, R., Paula, P.: Motion tracking exergames for elderly users. IADIS Int. J. Comput. Sci. Inf. Syst. 10(2), 52–64 (2015) Liukkonen, T.N., Tuomas, M., Hanna, A., Toni, H., Reetta, R., Paula, P.: Motion tracking exergames for elderly users. IADIS Int. J. Comput. Sci. Inf. Syst. 10(2), 52–64 (2015)
16.
Zurück zum Zitat Abreu, J., Rebelo, S., Paredes, H., Barroso, J., Martins, P., Reis, A., Filipe, V.: Assessment of microsoft kinect in the monitoring and rehabilitation of stroke patients. In: Rocha, Á., Correia, A.M., Adeli, H., Reis, L.P., Costanzo, S. (eds.) Recent Advances in Information Systems and Technologies, vol. 2, pp. 167–174. Springer International Publishing, Cham (2017). https://doi.org/10.1007/978-3-319-56538-5_18. ISBN 978-3-319-56537-8 Abreu, J., Rebelo, S., Paredes, H., Barroso, J., Martins, P., Reis, A., Filipe, V.: Assessment of microsoft kinect in the monitoring and rehabilitation of stroke patients. In: Rocha, Á., Correia, A.M., Adeli, H., Reis, L.P., Costanzo, S. (eds.) Recent Advances in Information Systems and Technologies, vol. 2, pp. 167–174. Springer International Publishing, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-56538-5_​18. ISBN 978-3-319-56537-8
17.
Zurück zum Zitat Ekman, P., Friensen, W.V., Ancoli, S.: Facial signs of emotion experiences. J. Pers. Soc. Psychol. 39, 1125–1134 (1980)CrossRef Ekman, P., Friensen, W.V., Ancoli, S.: Facial signs of emotion experiences. J. Pers. Soc. Psychol. 39, 1125–1134 (1980)CrossRef
18.
Zurück zum Zitat Tivatansakul, S., Ohkura, M., Puangpontip, S., Achalakul, T.: Emotional healthcare system: emotion detection by facial expressions using Japanese database. IEEE, Colchester, UK, pp. 41–47 (2014) Tivatansakul, S., Ohkura, M., Puangpontip, S., Achalakul, T.: Emotional healthcare system: emotion detection by facial expressions using Japanese database. IEEE, Colchester, UK, pp. 41–47 (2014)
19.
Zurück zum Zitat Santos, C., Santos, V., Tavares, A., Varajão, J.: Project management success in health–the need of additional research in public health projects. Procedia Technol. 16, 1080–1085 (2014)CrossRef Santos, C., Santos, V., Tavares, A., Varajão, J.: Project management success in health–the need of additional research in public health projects. Procedia Technol. 16, 1080–1085 (2014)CrossRef
20.
Zurück zum Zitat Liu, M., Li, S., Shan, S., Chen, X.: AU-inspired deep networks for facial expression feature learning. Neurocomputing 159, 126–136 (2015)CrossRef Liu, M., Li, S., Shan, S., Chen, X.: AU-inspired deep networks for facial expression feature learning. Neurocomputing 159, 126–136 (2015)CrossRef
21.
Zurück zum Zitat Ng, H.W., Nguyen, V.D., Vonikakis, V., Winkler, S.: Deep learning for emotion recognition on small datasets using transfer learning. In: International Conference on Multimodal Interaction, Seattle, Washington, pp. 443–449 (2015) Ng, H.W., Nguyen, V.D., Vonikakis, V., Winkler, S.: Deep learning for emotion recognition on small datasets using transfer learning. In: International Conference on Multimodal Interaction, Seattle, Washington, pp. 443–449 (2015)
22.
Zurück zum Zitat Nugroho, L.E., Kurnianingsih, Lazuardi, L., Widyawan, Ferdiana, R., Selo: Contempo: a home care model to enhance the wellbeing of elderly people. In: IEEE-EMBS International Conference 2014 on Biomedical and Health Informatics (BHI) (2014) Nugroho, L.E., Kurnianingsih, Lazuardi, L., Widyawan, Ferdiana, R., Selo: Contempo: a home care model to enhance the wellbeing of elderly people. In: IEEE-EMBS International Conference 2014 on Biomedical and Health Informatics (BHI) (2014)
23.
Zurück zum Zitat Shaukat, A., Ahsan, M., Hassan, A., Riaz, F.: Daily sound recognition for elderly people using ensemble methods. IEEE, Xiamen, China, pp. 418–424 (2014) Shaukat, A., Ahsan, M., Hassan, A., Riaz, F.: Daily sound recognition for elderly people using ensemble methods. IEEE, Xiamen, China, pp. 418–424 (2014)
24.
Zurück zum Zitat Reis, A., Lains, J., Paredes, H., Filipe, V., Abrantes, C., Ferreira, F., Mendes, R., Amorim, P., Barroso, J.: Developing a system for post-stroke rehabilitation: an exergames approach. In: Antona, M., Stephanidis, C. (eds.) Universal Access in Human-Computer Interaction. Users and Context Diversity, July 2016, pp. 403–413. Springer International Publishing (2016). https://doi.org/10.1007/978-3-319-40238-3_39. ISBN 978-3-319-40237-6CrossRef Reis, A., Lains, J., Paredes, H., Filipe, V., Abrantes, C., Ferreira, F., Mendes, R., Amorim, P., Barroso, J.: Developing a system for post-stroke rehabilitation: an exergames approach. In: Antona, M., Stephanidis, C. (eds.) Universal Access in Human-Computer Interaction. Users and Context Diversity, July 2016, pp. 403–413. Springer International Publishing (2016). https://​doi.​org/​10.​1007/​978-3-319-40238-3_​39. ISBN 978-3-319-40237-6CrossRef
25.
Zurück zum Zitat Ebner, N.C., Riediger, M., Linderberger, U.: FACES—a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav. Res. Methods 42(1), 351–362 (2010)CrossRef Ebner, N.C., Riediger, M., Linderberger, U.: FACES—a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav. Res. Methods 42(1), 351–362 (2010)CrossRef
27.
Zurück zum Zitat Viola, P., Jones, M.J.: Robust real-time object detection. Int. J. Comput. Vis., 1–25, July 2001 Viola, P., Jones, M.J.: Robust real-time object detection. Int. J. Comput. Vis., 1–25, July 2001
28.
Zurück zum Zitat Felisberto, F., Laza, R., Fdez-Riverola, F., Pereira, A.: A distributed multiagent system architecture for body area networks applied to healthcare monitoring. In: BioMed Research International (2015)CrossRef Felisberto, F., Laza, R., Fdez-Riverola, F., Pereira, A.: A distributed multiagent system architecture for body area networks applied to healthcare monitoring. In: BioMed Research International (2015)CrossRef
29.
Zurück zum Zitat Marcelino, I., Pereira, A.: Elder care modular solution. In: Second International Conference on Advances in Human-Oriented and Personalized Mechanisms, Technologies, and Services, CENTRIC 2009, pp. 1–6. IEEE, September 2009 Marcelino, I., Pereira, A.: Elder care modular solution. In: Second International Conference on Advances in Human-Oriented and Personalized Mechanisms, Technologies, and Services, CENTRIC 2009, pp. 1–6. IEEE, September 2009
30.
Metadaten
Titel
Using Emotion Recognition in Intelligent Interface Design for Elderly Care
verfasst von
Salik Khanal
Arsénio Reis
João Barroso
Vitor Filipe
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-77712-2_23