Skip to main content
Top
Published in: International Journal of Speech Technology 2/2022

08-02-2022

RETRACTED ARTICLE: Computer vision for facial analysis using human–computer interaction models

Authors: Zitian Liao, R. Dinesh Jackson Samuel, Sujatha Krishnamoorthy

Published in: International Journal of Speech Technology | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Currently, a facial analysis system for human–computer interfaces is presented and employed extensively. The increasing computer and digital speed, accuracy, and low-cost webcams that users can use bring computer vision systems more and more popular. These systems can assist people with alternative, hand-free communication to computers with human–computer interfaces. Hence, in this paper, computer vision-based face analysis model (CVFAM) has been suggested for human–computer interaction. This paper can determine the mouth and eyes position and use the facial centre to estimate the head's pose. In the suggested model, the face location is extracted from the central image by a cascade and skin detector and then is sent to the recognition phase. In the recognition phase, the threshold condition is examined, and the extracted face and gaze will be predictable. To learn about computer systems that automatically analyzes images, this paper CVFAM mode has suggested recognizing the user's face sitting in front of the system and recognizing user hand gestures and facial expressions, therefore providing interfaces for users HCI. The simulation results show that the suggested CVFAM model enhances the accuracy ratio of 93.5%, the detection rate of 94.2, the location analysis ratio of 94.5%, the recognition rate of 83.2, and the average delay ratio of 22.1% to other existing models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Ahmed, T. U., Hossain, S., Hossain, M. S., ul Islam, R., & Andersson, K. (2019). Facial expression recognition using convolutional neural network with data augmentation. In: Proceedings of the 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR) (pp. 336–341). IEEE. Ahmed, T. U., Hossain, S., Hossain, M. S., ul Islam, R., & Andersson, K. (2019). Facial expression recognition using convolutional neural network with data augmentation. In: Proceedings of the 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR) (pp. 336–341). IEEE.
go back to reference Al-Khawand, W., Kadry, S., Bozzo, R., & Smaili, K. (2016). 8-neighborhood variant for a better Container Code Extraction and Recognition. International Journal of Computer Science and Information Security, 14(4), 182. Al-Khawand, W., Kadry, S., Bozzo, R., & Smaili, K. (2016). 8-neighborhood variant for a better Container Code Extraction and Recognition. International Journal of Computer Science and Information Security, 14(4), 182.
go back to reference Chen, W., Chang, B., Zhang, Y., Yang, P., & Liu, L. (2015). Rhein promotes the expression of SIRT1 in kidney tissues of type 2 diabetic rat. Xi bao yu fen zi mian yi xue za zhi [Chinese Journal of Cellular and Molecular Immunology], 31(5), 615–619. Chen, W., Chang, B., Zhang, Y., Yang, P., & Liu, L. (2015). Rhein promotes the expression of SIRT1 in kidney tissues of type 2 diabetic rat. Xi bao yu fen zi mian yi xue za zhi [Chinese Journal of Cellular and Molecular Immunology], 31(5), 615–619.
go back to reference Ekundayo, O., & Viriri, S. (2019, March). Facial expression recognition: a review of methods, performances and limitations. In: Proceedings of the 2019 Conference on Information Communications Technology and Society (ICTAS) (pp. 1–6). IEEE. Ekundayo, O., & Viriri, S. (2019, March). Facial expression recognition: a review of methods, performances and limitations. In: Proceedings of the 2019 Conference on Information Communications Technology and Society (ICTAS) (pp. 1–6). IEEE.
go back to reference Goceri, E., & Gunay, M. (2018). Automated Detection of Facial Disorders (ADFD): A novel approach based-on digital photographs. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 6(6), 607–617. Goceri, E., & Gunay, M. (2018). Automated Detection of Facial Disorders (ADFD): A novel approach based-on digital photographs. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 6(6), 607–617.
go back to reference Haines, N., Bell, Z., Crowell, S., Hahn, H., Kamara, D., McDonough-Caplan, H., Shader, T., & Beauchaine, T. P. (2019). Using automated computer vision and machine learning to code facial expressions of affect and arousal: Implications for emotion dysregulation research. Development and Psychopathology, 31(3), 871–886. Haines, N., Bell, Z., Crowell, S., Hahn, H., Kamara, D., McDonough-Caplan, H., Shader, T., & Beauchaine, T. P. (2019). Using automated computer vision and machine learning to code facial expressions of affect and arousal: Implications for emotion dysregulation research. Development and Psychopathology, 31(3), 871–886.
go back to reference He, J., Yu, X., Yu, L., & Sun, B. (2019). Facial Emotion and Action Unit Recognition based on Bayesian Network. In: Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition (pp. 363–368). He, J., Yu, X., Yu, L., & Sun, B. (2019). Facial Emotion and Action Unit Recognition based on Bayesian Network. In: Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition (pp. 363–368).
go back to reference Jain, R., Bhardwaj, V., Tyagi, V., Lamba, P. S., Chaudhary, G., & Al-Turjman, F. (2020). 4 IoT-based micro-expression recognition for nervousness detection in COVID-like condition. In F. Al-Turjman (Ed.), AI-powered IoT for COVID-19 (pp. 93–104). Boca Raton: CRC Press. Jain, R., Bhardwaj, V., Tyagi, V., Lamba, P. S., Chaudhary, G., & Al-Turjman, F. (2020). 4 IoT-based micro-expression recognition for nervousness detection in COVID-like condition. In F. Al-Turjman (Ed.), AI-powered IoT for COVID-19 (pp. 93–104). Boca Raton: CRC Press.
go back to reference Javed, A. R., Sarwar, M. U., Khan, S., Iwendi, C., Mittal, M., & Kumar, N. (2020). Analyzing the effectiveness and contribution of each axis of tri-axial accelerometer sensor for accurate activity recognition. Sensors, 20(8), 2216. Javed, A. R., Sarwar, M. U., Khan, S., Iwendi, C., Mittal, M., & Kumar, N. (2020). Analyzing the effectiveness and contribution of each axis of tri-axial accelerometer sensor for accurate activity recognition. Sensors, 20(8), 2216.
go back to reference Kaur, M., Kaur, G., Sharma, P. K., Jolfaei, A., & Singh, D. (2020). Binary cuckoo search metaheuristic-based supercomputing framework for human behavior analysis in smart home. The Journal of Supercomputing, 76(4), 2479–2502. Kaur, M., Kaur, G., Sharma, P. K., Jolfaei, A., & Singh, D. (2020). Binary cuckoo search metaheuristic-based supercomputing framework for human behavior analysis in smart home. The Journal of Supercomputing, 76(4), 2479–2502.
go back to reference Manogaran, G., Rawal, B. S., Saravanan, V., Kumar, P. M., Martínez, O. S., Crespo, R. G., Montenegro-Marin, C. E., & Krishnamoorthy, S. (2020). Blockchain based integrated security measure for reliable service delegation in 6G communication environment. Computer Communications, 161, 248–256. Manogaran, G., Rawal, B. S., Saravanan, V., Kumar, P. M., Martínez, O. S., Crespo, R. G., Montenegro-Marin, C. E., & Krishnamoorthy, S. (2020). Blockchain based integrated security measure for reliable service delegation in 6G communication environment. Computer Communications, 161, 248–256.
go back to reference Ming-Hao, Y., & Jian-Hua, T. (2019). Data fusion methods in multimodal human computer dialog. Virtual Reality & Intelligent Hardware, 1(1), 21–38. Ming-Hao, Y., & Jian-Hua, T. (2019). Data fusion methods in multimodal human computer dialog. Virtual Reality & Intelligent Hardware, 1(1), 21–38.
go back to reference Nguyen, T. N., Dakpé, S., Tho, M. C. H. B., & Dao, T. T. (2020). Real-time computer vision system for tracking simultaneously subject-specific rigid head and non-rigid facial mimic movements using a contactless sensor and system of systems approach. Computer Methods and Programs in Biomedicine, 191, 105410. Nguyen, T. N., Dakpé, S., Tho, M. C. H. B., & Dao, T. T. (2020). Real-time computer vision system for tracking simultaneously subject-specific rigid head and non-rigid facial mimic movements using a contactless sensor and system of systems approach. Computer Methods and Programs in Biomedicine, 191, 105410.
go back to reference Rathi, P., Sharma, R., Singal, P., Lamba, P. S., Chaudhary, G., & Al-Turjman, F. (2020). Micro-expression recognition using 3D-CNN layering. In F. Al-Turjman (Ed.), AI-powered IoT for COVID-19 (pp. 123–140). Boca Raton: CRC Press. Rathi, P., Sharma, R., Singal, P., Lamba, P. S., Chaudhary, G., & Al-Turjman, F. (2020). Micro-expression recognition using 3D-CNN layering. In F. Al-Turjman (Ed.), AI-powered IoT for COVID-19 (pp. 123–140). Boca Raton: CRC Press.
go back to reference Shakeel, P. M., & Baskar, S. (2020). Automatic human emotion classification in web document using fuzzy inference system (FIS): Human emotion classification. International Journal of Technology and Human Interaction (IJTHI), 16(1), 94–104. Shakeel, P. M., & Baskar, S. (2020). Automatic human emotion classification in web document using fuzzy inference system (FIS): Human emotion classification. International Journal of Technology and Human Interaction (IJTHI), 16(1), 94–104.
go back to reference Sheron, P. F., Sridhar, K. P., Baskar, S., & Shakeel, P. M. (2021). Projection-dependent input processing for 3D object recognition in human robot interaction systems. Image and Vision Computing, 106, 104089. Sheron, P. F., Sridhar, K. P., Baskar, S., & Shakeel, P. M. (2021). Projection-dependent input processing for 3D object recognition in human robot interaction systems. Image and Vision Computing, 106, 104089.
go back to reference Shi, Y., Zhang, Z., Huang, K., Ma, W., & Tu, S. (2020). Human–computer interaction based on face feature localization. Journal of Visual Communication and Image Representation, 70, 102740. Shi, Y., Zhang, Z., Huang, K., Ma, W., & Tu, S. (2020). Human–computer interaction based on face feature localization. Journal of Visual Communication and Image Representation, 70, 102740.
go back to reference Sridhar, K. P., Baskar, S., Shakeel, P. M., & Dhulipala, V. S. (2019). Developing brain abnormality recognize system using multi-objective pattern producing neural network. Journal of Ambient Intelligence and Humanized Computing, 10(8), 3287–3295. Sridhar, K. P., Baskar, S., Shakeel, P. M., & Dhulipala, V. S. (2019). Developing brain abnormality recognize system using multi-objective pattern producing neural network. Journal of Ambient Intelligence and Humanized Computing, 10(8), 3287–3295.
go back to reference Tanwar, S., Vora, J., Kaneriya, S., Tyagi, S., Kumar, N., Sharma, V., & You, I. (2019). Human arthritis analysis in fog computing environment using Bayesian network classifier and thread protocol. IEEE Consumer Electronics Magazine, 9(1), 88–94. Tanwar, S., Vora, J., Kaneriya, S., Tyagi, S., Kumar, N., Sharma, V., & You, I. (2019). Human arthritis analysis in fog computing environment using Bayesian network classifier and thread protocol. IEEE Consumer Electronics Magazine, 9(1), 88–94.
go back to reference Vo, T. H., Lee, G. S., Yang, H. J., & Kim, S. H. (2020). Pyramid with super resolution for in-the-wild facial expression recognition. IEEE Access, 8, 131988–132001. Vo, T. H., Lee, G. S., Yang, H. J., & Kim, S. H. (2020). Pyramid with super resolution for in-the-wild facial expression recognition. IEEE Access, 8, 131988–132001.
go back to reference Zhang, H., Jolfaei, A., & Alazab, M. (2019). A face emotion recognition method using convolutional neural network and image edge computing. IEEE Access, 7, 159081–159089. Zhang, H., Jolfaei, A., & Alazab, M. (2019). A face emotion recognition method using convolutional neural network and image edge computing. IEEE Access, 7, 159081–159089.
Metadata
Title
RETRACTED ARTICLE: Computer vision for facial analysis using human–computer interaction models
Authors
Zitian Liao
R. Dinesh Jackson Samuel
Sujatha Krishnamoorthy
Publication date
08-02-2022
Publisher
Springer US
Published in
International Journal of Speech Technology / Issue 2/2022
Print ISSN: 1381-2416
Electronic ISSN: 1572-8110
DOI
https://doi.org/10.1007/s10772-021-09953-6

Other articles of this Issue 2/2022

International Journal of Speech Technology 2/2022 Go to the issue