Skip to main content
Top
Published in: Wireless Personal Communications 2/2021

29-01-2021

Unconstrained Face Detection of Multiple Humans Present in the Video

Authors: Ranbeer Tyagi, Geetam Singh Tomar, Laxmi Shrivastava

Published in: Wireless Personal Communications | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To capture a stable picture through the digital camera is a challenging task in computer vision. The While identifying facial features such as misalignment, a parasitic light effect and a change in object position are the errors found in image processing. These errors get aggregated with images and cumulatively create distortion in the output video, which makes facial feature recognition more complicated in the video. In this paper, a solutions for unconstrained facial detection from digital image processing has been proposed, which fulfilled two requirements; first is a reliable method to extract the facial feature of the humans from a video and second is the estimation of 3D-image of human from the motion video. To meet these requirements, we develop a hybrid estimation method that combines the feature selection and extraction of facial features of the human from the video. Here we have extended the estimation of 2D to 3D unconstrained facial feature recognition. In the results, we found that the object in images is detected and we are able to develop the 3D sketch of human from the video. Further to validate the robustness of the proposed method, we have performed comprehensive testing on the huge dataset. The output of testing shows that the proposed method would be better to identify multiple facial features.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60, 91–110.CrossRef Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60, 91–110.CrossRef
2.
go back to reference Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient based learning applied to document recognition. Proceedings of IEEE, 86(11), 2278–2324.CrossRef Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient based learning applied to document recognition. Proceedings of IEEE, 86(11), 2278–2324.CrossRef
3.
go back to reference Lagorce, X., Orchard, G., Galluppi, F., Shi, B. E., & Benosman, R. B. (2017). HOTS: A hierarchy of event-based time-surfaces for pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(7), 1346–1359.CrossRef Lagorce, X., Orchard, G., Galluppi, F., Shi, B. E., & Benosman, R. B. (2017). HOTS: A hierarchy of event-based time-surfaces for pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(7), 1346–1359.CrossRef
4.
go back to reference Mead, C., & Mahowald, M. (1991). The silicon retina. Science America, 264, 76–82. Mead, C., & Mahowald, M. (1991). The silicon retina. Science America, 264, 76–82.
5.
go back to reference Boahen, K. A. (2000). Point-to-point connectivity between neuromorphic chips using address-events. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 47(5), 416–434.CrossRef Boahen, K. A. (2000). Point-to-point connectivity between neuromorphic chips using address-events. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 47(5), 416–434.CrossRef
6.
go back to reference Kafai, M., An, L., & Bhanu, B. (2014). Reference face graph for face recognition. IEEE Transactions on Information Forensics and Security, 9(12), 2132–2143.CrossRef Kafai, M., An, L., & Bhanu, B. (2014). Reference face graph for face recognition. IEEE Transactions on Information Forensics and Security, 9(12), 2132–2143.CrossRef
7.
go back to reference Punnappurath, A., Rajagopalan, A. N., Taheri, S., Chellappa, R., & Seetharaman, G. (2015). Face recognition across non-uniform motion blur, illumination, and pose. IEEE Transactions on Image Processing, 24(7), 2067–2082.MathSciNetCrossRef Punnappurath, A., Rajagopalan, A. N., Taheri, S., Chellappa, R., & Seetharaman, G. (2015). Face recognition across non-uniform motion blur, illumination, and pose. IEEE Transactions on Image Processing, 24(7), 2067–2082.MathSciNetCrossRef
8.
go back to reference An, L., Kafai, M., Yang, S., & Bhanu, B. (2016). Person reidentification with reference descriptor. IEEE Transaction on Circuits and System for Video Technology, 26(4), 776–787.CrossRef An, L., Kafai, M., Yang, S., & Bhanu, B. (2016). Person reidentification with reference descriptor. IEEE Transaction on Circuits and System for Video Technology, 26(4), 776–787.CrossRef
9.
go back to reference Tyagi, R., Tomar, G. S., & Shirvastava, L. (2016). Unconstrained face recognition quality: A review. International Journal of Signal Processing, Image Processing and Pattern Recognition, 9(11), 199–210.CrossRef Tyagi, R., Tomar, G. S., & Shirvastava, L. (2016). Unconstrained face recognition quality: A review. International Journal of Signal Processing, Image Processing and Pattern Recognition, 9(11), 199–210.CrossRef
10.
go back to reference Tyagi, R., Tomar, G. S., & Baik, N. (2016). A survey of unconstrained face recogition algorithms and its application. International Journal of Security and its Application, 10(12), 369–376.CrossRef Tyagi, R., Tomar, G. S., & Baik, N. (2016). A survey of unconstrained face recogition algorithms and its application. International Journal of Security and its Application, 10(12), 369–376.CrossRef
11.
go back to reference Tyagi, R., & Tomar, G. S. (2016). Tranformation of image from color to gray scale using contrast among DPCM and LMS method. Internation Journal of Signal Processing, Image Processing and Pattern Recognition, 9(8), 11–24.CrossRef Tyagi, R., & Tomar, G. S. (2016). Tranformation of image from color to gray scale using contrast among DPCM and LMS method. Internation Journal of Signal Processing, Image Processing and Pattern Recognition, 9(8), 11–24.CrossRef
12.
go back to reference Tyagi, R., & Tomar, G. S. (2016). Unfamiliar sides, video, image enhancement in face recognition. International Journal of Hybrid Information Technology, 9(11), 255–266.CrossRef Tyagi, R., & Tomar, G. S. (2016). Unfamiliar sides, video, image enhancement in face recognition. International Journal of Hybrid Information Technology, 9(11), 255–266.CrossRef
13.
go back to reference Yuan, X., Tang, D., Liu, Y., Ling, Q., & Fang, L. (2017). Magic glasses: From 2D to 3D. IEEE Transactions on Circuits and Systems for Video Technology, 27(4), 843–854.CrossRef Yuan, X., Tang, D., Liu, Y., Ling, Q., & Fang, L. (2017). Magic glasses: From 2D to 3D. IEEE Transactions on Circuits and Systems for Video Technology, 27(4), 843–854.CrossRef
14.
go back to reference Tirunagari, S., Poh, N., Windridge, D., Iorliam, A., Suki, N., & Ho, A. T. S. (2015). Detection of face spoofing using visual dynamics. IEEE Transactions on Information Forensics and Security, 10(4), 762–777.CrossRef Tirunagari, S., Poh, N., Windridge, D., Iorliam, A., Suki, N., & Ho, A. T. S. (2015). Detection of face spoofing using visual dynamics. IEEE Transactions on Information Forensics and Security, 10(4), 762–777.CrossRef
15.
go back to reference Hsu, S. B., Han, C. C., Wen, M. G., Wu, Y. C., & Fan, K. C. (2016). Extraction of visual facial features for health management. IEEE Systems Journal, 10(3), 992–1002.CrossRef Hsu, S. B., Han, C. C., Wen, M. G., Wu, Y. C., & Fan, K. C. (2016). Extraction of visual facial features for health management. IEEE Systems Journal, 10(3), 992–1002.CrossRef
16.
go back to reference Kamarol, S. K. A., Jaward, M. H., Parkkinen, J., & Parthiban, R. (2016). Spatiotemporal feature extraction for facial expression recognition. IET Image Processing, 10(7), 534–541.CrossRef Kamarol, S. K. A., Jaward, M. H., Parkkinen, J., & Parthiban, R. (2016). Spatiotemporal feature extraction for facial expression recognition. IET Image Processing, 10(7), 534–541.CrossRef
17.
go back to reference Jung, J. Y., Kim, S. W., Yoo, C. H., Park, W. J., & Ko, S. J. (2016). LBP-ferns-based feature extraction for robust facial recognition. IEEE Transactions on Consumer Electronics, 62(4), 446–453.CrossRef Jung, J. Y., Kim, S. W., Yoo, C. H., Park, W. J., & Ko, S. J. (2016). LBP-ferns-based feature extraction for robust facial recognition. IEEE Transactions on Consumer Electronics, 62(4), 446–453.CrossRef
18.
go back to reference Nguyen, H. T., & Caplier, A. (2015). Local patterns of gradients for face recognition. IEEE Transactions on Information Forensics and Security, 10(8), 1739–1751.CrossRef Nguyen, H. T., & Caplier, A. (2015). Local patterns of gradients for face recognition. IEEE Transactions on Information Forensics and Security, 10(8), 1739–1751.CrossRef
19.
go back to reference Tordoff, B., Murray, D. W.: Guided Sampling and Consensus for Motion Estimation. In European Conference on Computer Vision ECCV 2002 Lecture Notes in Computer Science book series (LNCS), 2350 (pp. 82–96). Tordoff, B., Murray, D. W.: Guided Sampling and Consensus for Motion Estimation. In European Conference on Computer Vision ECCV 2002 Lecture Notes in Computer Science book series (LNCS), 2350 (pp. 82–96).
20.
go back to reference Jeon, S., Yoon, I., Jang, J., Yang, S., Kim, J., & Paik, J. (2017). Robust video stabilization using particle keypoint update and l1-optimized camera path. MDPI Sensors, 2017, 1–18. Jeon, S., Yoon, I., Jang, J., Yang, S., Kim, J., & Paik, J. (2017). Robust video stabilization using particle keypoint update and l1-optimized camera path. MDPI Sensors, 2017, 1–18.
21.
go back to reference Litvin, A., Konrad, J., & Karl, C. W. (2003). Probabilistic video stabilization using Kalman filtering and mosaicking. Image and Video Communication and Processing, 2003, 663–674. Litvin, A., Konrad, J., & Karl, C. W. (2003). Probabilistic video stabilization using Kalman filtering and mosaicking. Image and Video Communication and Processing, 2003, 663–674.
22.
go back to reference Alahi, A., Ortiz, R., Vandergheynst, P. (2012). FREAK: Fast Retina Keypoint. In IEEE Conference on Computer Vision and Pattern Recognition, Rhode Island, Providence, USA, June 2012 (pp.16–21). Alahi, A., Ortiz, R., Vandergheynst, P. (2012). FREAK: Fast Retina Keypoint. In IEEE Conference on Computer Vision and Pattern Recognition, Rhode Island, Providence, USA, June 2012 (pp.16–21).
24.
go back to reference Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: paradigm for model fitting with applications to image analysis and automated cartography. Magazine Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: paradigm for model fitting with applications to image analysis and automated cartography. Magazine Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef
25.
go back to reference Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (2011). Computer Aided Systems Theory—EUROCAST 2011, LNCS6928 Springer, 2011. Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (2011). Computer Aided Systems Theory—EUROCAST 2011, LNCS6928 Springer, 2011.
26.
go back to reference Kanatani, K., Sugaya, Y., & Kanazawa, Y. (2016). Ellipse fitting for computer vision: Implementation and applications. Morgan and Claypool Publishers, 6(1), 1–141. Kanatani, K., Sugaya, Y., & Kanazawa, Y. (2016). Ellipse fitting for computer vision: Implementation and applications. Morgan and Claypool Publishers, 6(1), 1–141.
28.
go back to reference Viola, P. A., Jones, M. J. (2001). Rapid Object Detection using a Boosted Cascade of Simple Features, IEEE CVPR, 2001. Viola, P. A., Jones, M. J. (2001). Rapid Object Detection using a Boosted Cascade of Simple Features, IEEE CVPR, 2001.
29.
go back to reference Bradski, G. R. (1998). Real Time Face and Object Tracking as a Component of a Perceptual User Interface. In Proceedings of the 4th IEEE Workshop on Applications of Computer Vision, 1998. Bradski, G. R. (1998). Real Time Face and Object Tracking as a Component of a Perceptual User Interface. In Proceedings of the 4th IEEE Workshop on Applications of Computer Vision, 1998.
30.
go back to reference Torr, P. H. S., & Zisserman, A. (2000). MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 78(1), 138–156.CrossRef Torr, P. H. S., & Zisserman, A. (2000). MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 78(1), 138–156.CrossRef
31.
go back to reference Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.CrossRef Viola, P., & Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.CrossRef
Metadata
Title
Unconstrained Face Detection of Multiple Humans Present in the Video
Authors
Ranbeer Tyagi
Geetam Singh Tomar
Laxmi Shrivastava
Publication date
29-01-2021
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 2/2021
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-020-08050-2

Other articles of this Issue 2/2021

Wireless Personal Communications 2/2021 Go to the issue