Skip to main content

2016 | OriginalPaper | Buchkapitel

Ultrafast Facial Tracker Using Generic Cameras with Applications in Intelligent Lifestyle

verfasst von : Yung-Hui Li, Yuan-Ting Hu, Jethro Shen, Mihai Preda, Andrei Drexler, Carmen Sosoiu, Dragos Florin Stanculescu, Paul Liu, Joe Ye

Erschienen in: Virtual, Augmented and Mixed Reality

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The core of Human-Computer Interaction (HCI) is to analyze and understand the user’s intension, which can be mostly manifested from the facial movement and expression of the user. Hence, the stage facial detection and tracking is extremely important in an user-friendly interface between human and computer. In ULSee, we developed an ultrafast markerless facial tracking system which is robust to variation in environmental lighting, pose and occlusion. It can be run at a speed of 10 ms/frame on an iPhone 6S system. With such accuracy and speed, it can be used to support many intelligent HCI applications. In this work, we envision an intelligent lifestyle in the future that can be built upon the basis of the ULSee’s ultrafast markerless facial tracker, ranging from virtual reality, augmented reality, real-time facial recognition and driver drowsiness detection. We believe, that through the joint force between ULSee’s world-class tracker and our clients, more user-awareness HCI application will be invented and a new lifestyle will arise.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Saxena, V.; Grover, S.; Joshi, S.: A real time face tracking system using rank deficient face detection and motion estimation. In: 7th IEEE International Conference on Cybernetic Intelligent Systems, 2008 (CIS 2008), pp. 1–6, 9–10 September 2008. doi:10.1109/UKRICIS.2008.4798956 Saxena, V.; Grover, S.; Joshi, S.: A real time face tracking system using rank deficient face detection and motion estimation. In: 7th IEEE International Conference on Cybernetic Intelligent Systems, 2008 (CIS 2008), pp. 1–6, 9–10 September 2008. doi:10.​1109/​UKRICIS.​2008.​4798956
2.
Zurück zum Zitat Harguess, J.; Changbo Hu; Aggarwal, J.K.: Occlusion robust multi-camera face tracking. In: 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 31–38, 20–25 June 2011. doi:10.1109/CVPRW.2011.5981790 Harguess, J.; Changbo Hu; Aggarwal, J.K.: Occlusion robust multi-camera face tracking. In: 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 31–38, 20–25 June 2011. doi:10.​1109/​CVPRW.​2011.​5981790
4.
Zurück zum Zitat Faux, F., Luthon, F.: Robust face tracking using colour Dempster-Shafer fusion and particle filter. In: 2006 9th International Conference on Information Fusion, pp. 1–7, 10–13 July 2006. doi:10.1109/ICIF.2006.301713 Faux, F., Luthon, F.: Robust face tracking using colour Dempster-Shafer fusion and particle filter. In: 2006 9th International Conference on Information Fusion, pp. 1–7, 10–13 July 2006. doi:10.​1109/​ICIF.​2006.​301713
6.
Zurück zum Zitat Painkras, E., Charoensak, C.: FaceProcessor: a framework for hardware design and implementation of a dynamic face tracking system. In: 2005 Fifth International Conference on Information, Communications and Signal Processing, pp. 172–176 (2005). doi:10.1109/ICICS.2005.1689028 Painkras, E., Charoensak, C.: FaceProcessor: a framework for hardware design and implementation of a dynamic face tracking system. In: 2005 Fifth International Conference on Information, Communications and Signal Processing, pp. 172–176 (2005). doi:10.​1109/​ICICS.​2005.​1689028
7.
Zurück zum Zitat Shi, L., Zhu, Y.: Robust face tracking-by-detection via sparse representation. In: 2015 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), pp. 1–4, 19–22 September 2015. doi:10.1109/ICSPCC.2015.7338846 Shi, L., Zhu, Y.: Robust face tracking-by-detection via sparse representation. In: 2015 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), pp. 1–4, 19–22 September 2015. doi:10.​1109/​ICSPCC.​2015.​7338846
8.
Zurück zum Zitat Cootes, T.F., Taylor, C.J.: Using grey-level models to improve active shape model search. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, 1994. Vol. 1 - Conference A: Computer Vision & Image Processing, pp. 63–67, 9–13 October 1994. doi:10.1109/ICPR.1994.576227 Cootes, T.F., Taylor, C.J.: Using grey-level models to improve active shape model search. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, 1994. Vol. 1 - Conference A: Computer Vision & Image Processing, pp. 63–67, 9–13 October 1994. doi:10.​1109/​ICPR.​1994.​576227
9.
Zurück zum Zitat Sugawara, Y., Lee, D.S., Kawanaka, A.: 3-D shape model retrieval using multi range image phase correlation method. In: 2012 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 000061–000066, 12–15 December 2012. doi:10.1109/ISSPIT.2012.6621261 Sugawara, Y., Lee, D.S., Kawanaka, A.: 3-D shape model retrieval using multi range image phase correlation method. In: 2012 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 000061–000066, 12–15 December 2012. doi:10.​1109/​ISSPIT.​2012.​6621261
11.
Zurück zum Zitat Luo, S., Li,: Accurate object segmentation using novel active shape and appearance models based on support vector machine learning. In: 2014 International Conference on Audio, Language and Image Processing (ICALIP), pp. 347–351, 7–9 July 2014. doi:10.1109/ICALIP.2014.7009813 Luo, S., Li,: Accurate object segmentation using novel active shape and appearance models based on support vector machine learning. In: 2014 International Conference on Audio, Language and Image Processing (ICALIP), pp. 347–351, 7–9 July 2014. doi:10.​1109/​ICALIP.​2014.​7009813
12.
Zurück zum Zitat Cootes, T.F., Taylor, C.J., Lanitis, A.: Multi-resolution search with active shape models. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, 1994. Vol. 1 - Conference A: Computer Vision & Image Processing, pp. 610–612, 9–13 October 1994. doi:10.1109/ICPR.1994.576375 Cootes, T.F., Taylor, C.J., Lanitis, A.: Multi-resolution search with active shape models. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, 1994. Vol. 1 - Conference A: Computer Vision & Image Processing, pp. 610–612, 9–13 October 1994. doi:10.​1109/​ICPR.​1994.​576375
15.
Zurück zum Zitat Huang, H., Makedon, F., McColl, R.: High dimensional statistical shape model for medical image analysis. In: 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2008. ISBI 2008, pp. 1541–1544, 14–17 May 2008. doi:10.1109/ISBI.2008.4541303 Huang, H., Makedon, F., McColl, R.: High dimensional statistical shape model for medical image analysis. In: 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2008. ISBI 2008, pp. 1541–1544, 14–17 May 2008. doi:10.​1109/​ISBI.​2008.​4541303
16.
Zurück zum Zitat Igual, L., De la Torre, F.: Continuous procrustes analysis to learn 2D shape models from 3D objects. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 17–22, 13–18 June 2010. doi:10.1109/CVPRW.2010.5543280 Igual, L., De la Torre, F.: Continuous procrustes analysis to learn 2D shape models from 3D objects. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 17–22, 13–18 June 2010. doi:10.​1109/​CVPRW.​2010.​5543280
17.
Zurück zum Zitat Giovanni, S., Choi, Y.C., Huang, J., Khoo, E.T., Yin, K.: Virtual try-on using kinect and HD camera. In: Kallmann, M., Bekris, K. (eds.) MIG 2012. LNCS, vol. 7660, pp. 55–65. Springer, Heidelberg (2012)CrossRef Giovanni, S., Choi, Y.C., Huang, J., Khoo, E.T., Yin, K.: Virtual try-on using kinect and HD camera. In: Kallmann, M., Bekris, K. (eds.) MIG 2012. LNCS, vol. 7660, pp. 55–65. Springer, Heidelberg (2012)CrossRef
18.
Zurück zum Zitat Huang, S.H., Yang, Y.I., Chu, C.H.: Human-centric design personalization of 3D glasses frame in markerless augmented reality. Adv. Eng. Inf. 26(1), 35–45 (2012)CrossRef Huang, S.H., Yang, Y.I., Chu, C.H.: Human-centric design personalization of 3D glasses frame in markerless augmented reality. Adv. Eng. Inf. 26(1), 35–45 (2012)CrossRef
19.
Zurück zum Zitat Saragih, J.M., Lucey, S., Cohn, J.F.: Real-time avatar animation from a single image. In: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops (2011) Saragih, J.M., Lucey, S., Cohn, J.F.: Real-time avatar animation from a single image. In: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops (2011)
20.
Zurück zum Zitat Tang, D., Zhang, J., Tang, K., Xu, L., Fang, L.: Making 3D eyeglasses try-on practical. In: IEEE International Conference on Multimedia and Expo Workshops (2014) Tang, D., Zhang, J., Tang, K., Xu, L., Fang, L.: Making 3D eyeglasses try-on practical. In: IEEE International Conference on Multimedia and Expo Workshops (2014)
21.
Zurück zum Zitat Yuan, M., Khan, I.R., Farbiz, F., Niswar, A., Huang, Z.: A mixed reality system for virtual glasses try-on. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry (2011) Yuan, M., Khan, I.R., Farbiz, F., Niswar, A., Huang, Z.: A mixed reality system for virtual glasses try-on. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry (2011)
22.
Zurück zum Zitat Zhu, X., Qin, S., Yu, H., Ge, S., Yang, Y., Jiang, Y.: Interactive virtual try-on based on real-time motion capture. In: Advances in Multimedia Information Processing (2012) Zhu, X., Qin, S., Yu, H., Ge, S., Yang, Y., Jiang, Y.: Interactive virtual try-on based on real-time motion capture. In: Advances in Multimedia Information Processing (2012)
23.
Zurück zum Zitat Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: Computer Vision and Pattern Recognition (CVPR) (2013) Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: Computer Vision and Pattern Recognition (CVPR) (2013)
24.
Zurück zum Zitat Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Computer Vision and Pattern Recognition (CVPR) (2015) Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Computer Vision and Pattern Recognition (CVPR) (2015)
26.
Zurück zum Zitat Huang, G.B., Learned-Miller, E.: Labeled Faces in the Wild: Updates and New Reporting Procedures. Technical Report UM-CS-2014-003, University of Massachusetts, Amherst, May 2014 Huang, G.B., Learned-Miller, E.: Labeled Faces in the Wild: Updates and New Reporting Procedures. Technical Report UM-CS-2014-003, University of Massachusetts, Amherst, May 2014
Metadaten
Titel
Ultrafast Facial Tracker Using Generic Cameras with Applications in Intelligent Lifestyle
verfasst von
Yung-Hui Li
Yuan-Ting Hu
Jethro Shen
Mihai Preda
Andrei Drexler
Carmen Sosoiu
Dragos Florin Stanculescu
Paul Liu
Joe Ye
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-39907-2_23

Neuer Inhalt