Skip to main content

2017 | OriginalPaper | Buchkapitel

Mouth Features Extraction for Emotion Analysis

verfasst von : Robert Staniucha, Adam Wojciechowski

Erschienen in: Hard and Soft Computing for Artificial Intelligence, Multimedia and Security

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face emotions analysis is one of the fundamental techniques that might be exploited in a natural human-computer interaction process and thus is, one of the most studied topics in current computer vision literature. In consequence face features extraction is an indispensable element of the face emotion analysis as it influences decision making performance. The paper concentrates on mouth features extraction, which next to eye region features becomes one of the most representative face regions in the context of emotions retrieval. In the paper original, gradient based, mouth features extraction method was presented. Its high performance (exceeding 90 \(\%\) for selected features) was also verified for a subset of the Yale images database.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection 19(7), 711–720 (1997) Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection 19(7), 711–720 (1997)
3.
Zurück zum Zitat Brunelli, R., Poggio, T.: Face recognition: features versus templates. IEEE Trans. Pattern Anal. Mach. Intell. 10, 1042–1052 (1993)CrossRef Brunelli, R., Poggio, T.: Face recognition: features versus templates. IEEE Trans. Pattern Anal. Mach. Intell. 10, 1042–1052 (1993)CrossRef
4.
Zurück zum Zitat Castrilln, M., Dniz, O., Hernndez, D., Lorenzo, J.: A comparison of face and facial feature detectors based on the violajones general object detection framework. Mach. Vis. Appl. 22(3), 481–494 (2011) Castrilln, M., Dniz, O., Hernndez, D., Lorenzo, J.: A comparison of face and facial feature detectors based on the violajones general object detection framework. Mach. Vis. Appl. 22(3), 481–494 (2011)
5.
Zurück zum Zitat Castrillón-Santana, M., Hernández-Sosa, D., Lorenzo-Navarro, J.: Combining face and facial feature detectors for face detection performance improvement. In: Alvarez, L., Mejail, M., Gomez, L., Jacobo, J. (eds.) CIARP 2012. LNCS, vol. 7441, pp. 82–89. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33275-3_10 CrossRef Castrillón-Santana, M., Hernández-Sosa, D., Lorenzo-Navarro, J.: Combining face and facial feature detectors for face detection performance improvement. In: Alvarez, L., Mejail, M., Gomez, L., Jacobo, J. (eds.) CIARP 2012. LNCS, vol. 7441, pp. 82–89. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33275-3_​10 CrossRef
6.
Zurück zum Zitat Chien, S.-I., Choi, I.: Face and facial landmarks location based on log-polar mapping. In: Lee, S.-W., Bülthoff, H.H., Poggio, T. (eds.) BMCV 2000. LNCS, vol. 1811, pp. 379–386. Springer, Heidelberg (2000). doi:10.1007/3-540-45482-9_38 CrossRef Chien, S.-I., Choi, I.: Face and facial landmarks location based on log-polar mapping. In: Lee, S.-W., Bülthoff, H.H., Poggio, T. (eds.) BMCV 2000. LNCS, vol. 1811, pp. 379–386. Springer, Heidelberg (2000). doi:10.​1007/​3-540-45482-9_​38 CrossRef
7.
Zurück zum Zitat He, C., Mao, H., Jin, L.: Realistic smile expression recognition using biologically inspired features. In: Wang, D., Reynolds, M. (eds.) AI 2011. LNCS (LNAI), vol. 7106, pp. 590–599. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25832-9_60 CrossRef He, C., Mao, H., Jin, L.: Realistic smile expression recognition using biologically inspired features. In: Wang, D., Reynolds, M. (eds.) AI 2011. LNCS (LNAI), vol. 7106, pp. 590–599. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-25832-9_​60 CrossRef
8.
Zurück zum Zitat Hjelmås, E., Low, B.K.: Face detection: a survey. Computer Vis. Image Underst. 83(3), 236–274 (2001)CrossRefMATH Hjelmås, E., Low, B.K.: Face detection: a survey. Computer Vis. Image Underst. 83(3), 236–274 (2001)CrossRefMATH
9.
Zurück zum Zitat Hussain, A., Khan, M.S., Nazir, M., Iqbal, M.A.: Survey of various feature extraction and classification techniques for facial expression recognition. In: Proceedings of the 11th WSEAS International Conference on Electronics, Hardware, Wireless and Optical Communications, and Proceedings of the 11th WSEAS International Conference on Signal Processing, Robotics and Automation, and Proceedings of the 4th WSEAS International Conference on Nanotechnology, pp. 138–142 (2012) Hussain, A., Khan, M.S., Nazir, M., Iqbal, M.A.: Survey of various feature extraction and classification techniques for facial expression recognition. In: Proceedings of the 11th WSEAS International Conference on Electronics, Hardware, Wireless and Optical Communications, and Proceedings of the 11th WSEAS International Conference on Signal Processing, Robotics and Automation, and Proceedings of the 4th WSEAS International Conference on Nanotechnology, pp. 138–142 (2012)
10.
Zurück zum Zitat Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)CrossRef Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)CrossRef
11.
Zurück zum Zitat Kanade, T.: Computer Recognition of Human Faces, vol. 47. Birkhäuser, Basel (1977)CrossRef Kanade, T.: Computer Recognition of Human Faces, vol. 47. Birkhäuser, Basel (1977)CrossRef
12.
Zurück zum Zitat Kass, M., Witkin, A., Terzepulos, D.: Snakes: active contour models. In: First IEEE International Conference on Computer Vision, pp. 259–268 (1987) Kass, M., Witkin, A., Terzepulos, D.: Snakes: active contour models. In: First IEEE International Conference on Computer Vision, pp. 259–268 (1987)
14.
Zurück zum Zitat Lee, Y.H., Kim, C.G., Kim, Y., Whangbo, T.K.: Facial landmarks detection using improved active shape model on android platform. Multimedia Tools Appl. 74(20), 8821–8830 (2013). doi:10.1007/s11042-013-1565-y CrossRef Lee, Y.H., Kim, C.G., Kim, Y., Whangbo, T.K.: Facial landmarks detection using improved active shape model on android platform. Multimedia Tools Appl. 74(20), 8821–8830 (2013). doi:10.​1007/​s11042-013-1565-y CrossRef
16.
Zurück zum Zitat Liang, S., Wu, J., Weinberg, S.M., Shapiro, L.G.: Improved detection of landmarks on 3d human face data. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6482–6485, July 2013. doi:10.1109/EMBC.2013.6611039 Liang, S., Wu, J., Weinberg, S.M., Shapiro, L.G.: Improved detection of landmarks on 3d human face data. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6482–6485, July 2013. doi:10.​1109/​EMBC.​2013.​6611039
17.
Zurück zum Zitat Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of the 2002 International Conference on Image Processing, vol. 1, p. I-900 (2002) Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of the 2002 International Conference on Image Processing, vol. 1, p. I-900 (2002)
18.
Zurück zum Zitat Matthews, I., Cootes, T., Bangham, J., Cox, S., Harvey, R.: Extraction of visual features for lipreading. IEEE Trans. Pattern Anal. Machine Intell. 24(2), 198–213 (2002). doi:10.1109/34.982900 CrossRef Matthews, I., Cootes, T., Bangham, J., Cox, S., Harvey, R.: Extraction of visual features for lipreading. IEEE Trans. Pattern Anal. Machine Intell. 24(2), 198–213 (2002). doi:10.​1109/​34.​982900 CrossRef
19.
Zurück zum Zitat Mishra, S., Dhole, A.: A survey on facial expression recognition techniques. Int. J. Sci. Res. 4(4), 1247–1250 (2015) Mishra, S., Dhole, A.: A survey on facial expression recognition techniques. Int. J. Sci. Res. 4(4), 1247–1250 (2015)
20.
Zurück zum Zitat Pali, V., Goswami, S., Bhaiya, L.: An extensive survey on feature extraction techniques for facial image processing. In: Sixth International Conference on Computational Intelligence and Communication Networks, pp. 142–148 (2014) Pali, V., Goswami, S., Bhaiya, L.: An extensive survey on feature extraction techniques for facial image processing. In: Sixth International Conference on Computational Intelligence and Communication Networks, pp. 142–148 (2014)
21.
Zurück zum Zitat Panning, A., Al-Hamadi, A.K., Niese, R., Michaelis, B.: Facial expression recognition based on haar-like feature detection. Pattern Recogn. Image Anal. 18(3), 447–452 (2008)CrossRef Panning, A., Al-Hamadi, A.K., Niese, R., Michaelis, B.: Facial expression recognition based on haar-like feature detection. Pattern Recogn. Image Anal. 18(3), 447–452 (2008)CrossRef
22.
Zurück zum Zitat Pentland, A., Moghaddam, B., Starner, T.: View-based and modular eigenspaces for face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, Seattle, NA, USA, pp. 84–91 (1994) Pentland, A., Moghaddam, B., Starner, T.: View-based and modular eigenspaces for face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, Seattle, NA, USA, pp. 84–91 (1994)
23.
Zurück zum Zitat Schneiderman, H., Kanade, T.: A statistical method for 3d object detection applied to faces and cars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 746–751. IEEE (2000) Schneiderman, H., Kanade, T.: A statistical method for 3d object detection applied to faces and cars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 746–751. IEEE (2000)
25.
Zurück zum Zitat Sobottka, K., Pitas, I.: A novel method for automatic face segmentation, facial feature extraction and tracking. Sig. Process. Image Commun. 12(3), 263–281 (1998)CrossRef Sobottka, K., Pitas, I.: A novel method for automatic face segmentation, facial feature extraction and tracking. Sig. Process. Image Commun. 12(3), 263–281 (1998)CrossRef
26.
Zurück zum Zitat Su, C., Deng, J., Yang, Y., Wang, G.: Expression recognition methods based on feature fusion. In: Yao, Y., Sun, R., Poggio, T., Liu, J., Zhong, N., Huang, J. (eds.) BI 2010. LNCS (LNAI), vol. 6334, pp. 346–356. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15314-3_33 CrossRef Su, C., Deng, J., Yang, Y., Wang, G.: Expression recognition methods based on feature fusion. In: Yao, Y., Sun, R., Poggio, T., Liu, J., Zhong, N., Huang, J. (eds.) BI 2010. LNCS (LNAI), vol. 6334, pp. 346–356. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15314-3_​33 CrossRef
27.
Zurück zum Zitat Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef
28.
Zurück zum Zitat Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57, 137–154 (2004)CrossRef Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57, 137–154 (2004)CrossRef
29.
Zurück zum Zitat Wang, Q., Zhao, C., Yang, J.: Robust facial feature location on gray intensity face. In: Wada, T., Huang, F., Lin, S. (eds.) PSIVT 2009. LNCS, vol. 5414, pp. 542–549. Springer, Heidelberg (2009). doi:10.1007/978-3-540-92957-4_47 CrossRef Wang, Q., Zhao, C., Yang, J.: Robust facial feature location on gray intensity face. In: Wada, T., Huang, F., Lin, S. (eds.) PSIVT 2009. LNCS, vol. 5414, pp. 542–549. Springer, Heidelberg (2009). doi:10.​1007/​978-3-540-92957-4_​47 CrossRef
30.
Zurück zum Zitat Yan, S., Shan, S., Chen, X., Gao, W.: Locally assembled binary (lab) feature with feature-centric cascade for fast and accurate face detection. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–7 (2008) Yan, S., Shan, S., Chen, X., Gao, W.: Locally assembled binary (lab) feature with feature-centric cascade for fast and accurate face detection. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–7 (2008)
33.
Zurück zum Zitat Zhang, C., Zhang, Z.: A survey of recent advances in face detection. Technical report, Microsoft Research (2010) Zhang, C., Zhang, Z.: A survey of recent advances in face detection. Technical report, Microsoft Research (2010)
Metadaten
Titel
Mouth Features Extraction for Emotion Analysis
verfasst von
Robert Staniucha
Adam Wojciechowski
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-48429-7_21

Premium Partner