Abstract
Visual perception is probably the most important sensing ability for humans to enable social interactions and general communication. As a consequence, face recognition is a fundamental skill that humans acquire early in life and which remains an integral part of our perceptual and social abilities throughout our life span (Allison et al. 2000; Bruce and Young 1986).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
A description of the project can be found under the “Screening Technologies to detect intentions of humans” on the web page http://www.dhs.gov/xabout/structure/gc_1224537081868.shtm
References
Adolphs, R., D. Tranel, H. Damsio, and A.R. Damasio. 1994. Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala. Nature 372: 669–672.
Allison, T., A. Puce, and G. McCarthy. 2000. Social perception from visual cues: Role of the STS region. Trends in Cognitive Sciences 4: 267–278.
Arandjelovic, O., and R. Cipolla. 2004. Face recognition from face motion manifolds using Robust Kernel resistor-average distance. In Proceedings of FaceVideo04, 88.
Bicego, M., E. Grosso, and M. Tistarelli. 2006. Person authentication from video of faces: A behavioral and physiological approach using Pseudo Hierarchical Hidden Markov Models. In Proceedings first International Conference on Biometrics 2006, Lectures Notes in Computer Science, vol. 3832, 113–120. Hong Kong, January 2006.
Bodamer, J. 1947. Die prosopagnosie. Archiv fur Psychiatrie und Nervenkrankheiten 179: 6–54.
Braje, W.L., D.J. Kersten, M.J. Tarr, and N.F. Troje. 1999. Illumination effects in face recognition. Psychobiology 26: 371–380.
Bruce, V., and A.W. Young. 1986. Understanding face recognition. British Journal of Psychology 77(3): 305–327.
Bryatt, G., and G. Rhodes. 1998. Recognition of own-race and other-race caricatures: Implications for models of face recognition. Vision Research 38: 2455–2468.
Burton, A.M., V. Bruce, and P.J.B. Hancock. 1999. From pixels to people: A model of familiar face recognition. Cognitive Science 23: 1–31.
Busso, C., Z. Deng, S. Yildirim, M. Bulut, C.M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan. 2004. Analysis of emotion recognition using facial expressions, speech and multimodal information. In Proceedings of the 6th international conference on multimodal interfaces, (State College, PA, USA, October 13–15, 2004). ICMI ’04, 205–211, ACM, New York. doi:http://doi.acm.org/10.1145/1027933.1027968
Calder, A., and A. Young. 2005. Understanding the recognition of facial identity and facial expression. Nature Reviews Neuroscience 6: 641–651.
Calder, A., A. Young, D. Rowland, D. Perrett, J. Hodges, and H. Etcoff. 1996. Facial emotion recognition after bilateral amygdala damage: Differentially severe impairment of fear. Cognitive Neuropsychology 13: 699–745.
Castellano, G., L. Kessous, and G. Caridakis. 2008. Emotion recognition through multiple modalities: Face, body gesture, speech. In Affect and emotion in human-computer interaction, Lectures Notes in Computer Science, vol. 4868, ed. C. Peter and R. Beale. Heidelberg: Springer.
Chen, L.S., and T.S. Huang. 2000. Emotional expressions in audiovisual human computer interaction. In Proceedings of ICME 2000, 423–426. New York, July–August 2000.
Chen, L.S. 2000. Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction. PhD Thesis, University of Illinois at Urbana-Champaign.
Cohen, I., N. Sebe, A. Garg, L.S. Chen, and T.S. Huang. 2003. Facial expression recognition from video sequences: Temporal and static modeling. Computer Vision and Image Understanding 91(1–2): 160–187.
Darwin, C. 1898. The expression of emotions in man and animals. New York: D. Appleton and Company.
Datcu, D., and L. Rothkrantz. 2008. Automatic bi-modal emotion recognition system based on fusion of facial expressions and emotion extraction from speech. In IEEE face and gesture conference FG2008. September 2008 ISBN 978-1-4244-2154-1.
D’Entremont, B., and D.W. Muir. 1997. Five-month-olds’ attention and affective responses to still-faced emotional expressions. Infant Behavior and Development 20(4): 563–568.
Doddington, G., W. Liggett, A. Maartin, M. Pryzbocki, and D. Reynolds. 1998. Sheep, goats, lambs, and wolves: A statistical analysis of speaker performance in the NIST 1998 Speaker Recognition Evaluation. In International conference on spoken language processing. Sydney: Sydney Convention Centre.
Dunn, J., I. Bretherton, and P. Munn. 1987. Conversations about feeling states between mothers and their young children. Developmental Psychology 23(1): 132–139.
Ekman, P. 1994. Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique. Psychological Bulletin 115(2): 268–287.
Ekman, P. 2009. Telling lies: Clues to deceit in the marketplace, politics, and marriage. New York: Norton.
Ekman, P., and W.V. Friesen. 1976. Pictures of facial affect. Palo Alto: Consulting Psychologists Press.
Ekman, P., and W.V. Friesen. 1978. Facial action coding system: Investigator’s guide. Palo Alto: Consulting Psychologists Press.
Ekman, P., R.E. Sorenson, and W.V. Friesen. 1969. Pan-cultural elements in facial displays of emotion. Science 164(3875): 86–88.
Ekman, P., W.V. Friesen, V. Wallace, and P. Ellsworth. 1972. Emotion in the human face: Guidelines for research and an integration of findings. Oxford: Pergamon.
Essa, I., and A. Pentland. 1995. Facial expression recognition using visually extracted facial action parameters. In Proceedings of international workshop on automatic face and gesture recognition. Zurich.
Fasel, B., and J. Luettin. 2003. Automatic facial expression analysis: A survey. Pattern Recognition 36: 259–275.
Gunes, H., and M. Piccardi. 2006. A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior. In Proceedings of the 18th international conference on pattern recognition (ICPR’06), vol. 1, 1148–1153. Hong Kong.
Gunes, H., and M. Piccardi. 2009. Automatic temporal segment detection and affect recognition from face and body display. IEEE Transactions on Systems, Man, and Cybernetics – Part B, Special Issue on Human Computing 39(1): 64–84.
Gunes, H., M. Piccardi, and M. Pantic. 2008. From the lab to the real world: Affect recognition using multiple cues and modalities. In Affective computing, focus on emotion expression, synthesis and recognition, ed. Jimmy Or, 185–218. Vienna: I-Tech Education and Publishing. ISBN 978-3-902613-23-3.
Hancock, P.J.B., V. Bruce, and A.M. Burton. 1991. Recognition of unfamiliar faces. Trends in Cognitive Sciences 4(9): 263–266.
Harris, P.L. 1989. Children and emotion: The development of psychological understanding. Oxford: Blackwell.
Haviland, J.M., and M. Lelwica. 1987. The induced affect response: 10-week-old infants’ responses to three emotion expressions. Developmental Psychology 23(1): 97–104.
Haxby, J.V., E.A. Hoffman, and M.I. Gobbini. 2000. The distributed human neural system for face perception. Trends in Cognitive Sciences 20(6): 223–233.
Hill, H., and V. Bruce. 1991. Effects of lighting on the perception of facial surface. Journal of Experimental Psychology: Human Perception and Performance 4(9): 263–266.
Horn, B.K.P., and B.G. Schunck. 1981. Determining optical flow. Artificial Intelligence 17(1–3): 185–204.
Hornak, J., E. Rolls, and D. Wade. 1996. Face and voice expression identification in patients with emotional and behavioral changes following ventral frontal lobe damage. Neuropsychologia 34: 173–181.
Howell, A.J., and H. Buxton. 1996. Towards unconstrained face recognition from image sequences. In Proceeding of the IEEE international conference on automatic face and gesture recognition (FGR’96), 224–229. Killington.
Humphreys, G., N. Donnelly, and M. Riddoch. 1993. Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia 31: 173–181.
Izard, C.E. 1971. The face of emotion. East Norwalk: Appleton-Century-Crofts.
Izard, C.E. 1997. Emotions and facial expressions: A perspective from Differential Emotions Theory. In The psychology of facial expression: Studies in emotion and social interaction, ed. J.A. Russell and J.M. Fernndez-Dols, 57–77. New York: Cambridge University Press.
Jack, R.E., C. Blais, C. Scheepers, P.G. Schyns, and R. Cadara. 2009. Cultural confusions show that facial expressions are not universal. Current Biology 19: 1543–1548.
Kanade, T., J. Cohn, and Y. Tian. 2000. Comprehensive database for facial expression analysis. In Proceedings of the 4th IEEE international conference on automatic face and gesture recognition (FG’00), 46–53. Grenoble, March 2000.
Kanwisher, N., J. McDermott, and M. Chun. 1997. The fusiform face area: A module in human extrastriate cortex specialized for face perception. The Journal of Neuroscience 17: 4302–4311.
Kelly, D.J., P.C. Quinn, A.M. Slater, K. Lee, L. Ge, and O. Pascalis. 2007. The other-race effect develops during infancy: Evidence of perceptual narrowing. Psychological Science 18: 1084–1089.
Lewis, M., and S. Goldberg. 1969. Perceptual-cognitive development in infancy: A generalized expectancy model as a function of the mother-infant interaction. Merrill-Palmer Quarterly 15(1): 81–100.
Li, Y., S. Gong, and H. Liddell. 2000. Support vector regression and classification based multiview face detection and recognition. In Proceedings of the IEEE international conference on automatic face and gesture recognition (FGR’00), 300–305. Grenoble.
Li, Y., S. Gong, and H. Liddell. 2001. Modelling faces dynamically across views and over time. In Proceedings IEEE international conference on computer vision, 554–559. Vancouver, July 2001.
Li, S.Z., R.F. Chu, S.C. Liao, and L. Zhang. 2007. Illumination invariant face recognition using near-infrared images. IEEE Transactions on PAMI 29(4): 627–639.
Light, L., F. Kayra-Stuart, and S. Hollander. 1979. Recognition memory for typical and unusual faces. Journal of Experimental Psychology: Human Learning and Memory 5: 212–228.
Liu, X., and T. Chen. 2003. Video-based face recognition using adaptive hidden Markov models. In Proceedings CVPR03 (I), 340–345. Madison
Lucas, S.M. 1998. Continuous n-tuple classifier and its application to real-time face recognition. In IEE Proceedings-Vision Image and Signal Processing 145(5): 343.
Lucas, S.M., and T.K. Huang. 2004. Sequence recognition with scanning N-tuple ensembles. In Proceedings ICPR04 (III), 410–413. Cambridge.
Malpass, R.S., and J. Kravitz. 1969. Recognition for faces of own and other race faces. Journal of Personality and Social Psychology 13: 330–334.
Markham, R., and K. Adams. 1992. The effect of type of task on children’s identification of facial expressions. Journal of Nonverbal Behavior 16(1): 21–39.
Matsumoto, D. 2001. Culture and emotion. In The handbook of culture and psychology, ed. D. Matsumoto. New York: Oxford University Press.
Meissner, C.A., and J.C. Brigham. 2001. Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review. Psychology, Public Policy, and Law 7: 3–35.
Mika, S., G. Ratsch, B. Scholkopf, A. Smola, J. Weston, and K.-R. Muller. 1999. Invariant feature extraction and classification in kernel spaces. In Advances in neural information processing systems, vol. 12, ed. M.I. Jordan, Y. LeCun, and Sara, A. Solla. Cambridge, MA: MIT.
Moses, Y., S. Edelman, and S. Ullman. 1996. Generalization to novel images in upright and inverted faces. Perception 25(4): 443–461.
Muir, D.W., and J. Nadel. 1998. Infant social perception. In Perceptual development: Visual, auditory, and speech perception in infancy, ed. A. Slater, 247–285. Hove: Psychology Press.
O’Toole, A.J., H. Abdi, F. Jiang, and P.J. Phillips. 2007a. Fusing face recognition algorithms and humans. IEEE Transactions on Systems, Man and Cybernetics 37: 1149–1155.
O’Toole, A.J., P.J. Phillips, F. Jiang, J.J. Ayadd, N. Penard, and H. Abdi. 2007b. Face recognition algorithms surpass humans matching faces across changed in illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 29: 1642–1646.
O’Toole, A.J., P.J. Phillips, A. Narvekar, F. Jiang, and J. Ayyad. 2008. Face recognition algorithms and the ‘other-race’ effect [Abstract]. Journal of Vision 8(6): 256–256.
Paleari, M., R. Benmokhtar, and B. Huet. 2009. Evidence theory based multimodal emotion recognition MMM 2009, 15th international multiMedia modeling conference, 435–446. Sophia Antipolis, January 7–9, 2009.
Pantic, M., and L.J.M. Rothkrantz. 2000. Automatic analysis of facial expressions: The state of the art. IEEE Transactions on PAMI 22(12): 1424–1445.
Phillips, P.J., P.J. Flynn, W.T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W.J. Worek. 2005. Overview of the face recognition grand challenge. In Proceedings of the IEEE conference on computer vision and pattern recognition, vol. 1, 947–954. San Diego: IEEE Computer Society.
Picard, R.W. 2000. Affective computing. Cambridge: MIT.
Ratliff, M.S., and E. Patterson. 2008. Emotion recognition using facial expressions with active appearance models. In Proceedings of IASTED human computer interaction 2008, 92–138. Anaheim.
Raytchev, B., and H. Murase. 2001. Unsupervised face recognition from image sequences. In Proceedings ICIP01(I), 1042–1045. Thessaloniki.
Raytchev, B., and H. Murase. 2002. VQ-Faces: Unsupervised face recognition from image sequences. In Proceedings ICIP02 (II), 809–812. Rochester, New York.
Raytchev, B., and H. Murase. 2003. Unsupervised recognition of multi-viewface sequences based on pairwise clustering with attraction and repulsion. Computer Vision and Image Understanding 91(1–2): 22–52.
Roli, F., and J. Kittler (eds.). 2002. Multiple Classifier Systems, Lectures Notes in Computer Science, vol. 2364. Berlin: Springer.
Russell, J.A. 1991. Culture and the categorization of emotions. Psychological Bulletin 110(3): 426–450.
Saks, M.J., and J.J. Koehler. 2005. The coming paradgm shift in forensic identification science. Science 309: 892–895.
Schyns, P.G. 1998. Diagnostic recognition: Task constraints, object information, and their interactions. Cognition 67(1–2): 147–179.
Sebe, N., I. Cohen, F.G. Cozman, T. Gevers, and T.S. Huang. 2005. Learning probabilistic classifiers for human-computer interaction applications. Multimedia Systems 10(6): 484–498.
Sebe, N., I. Cohen, T. Gevers, and T.S. Huang. 2006. Emotion recognition based on joint visual and audio cues. In Proceedings of the 18th international conference on pattern recognition (ICPR’06), vol. 1, 1136–1139. Hong Kong.
Shan, C., and R. Braspenning. 2009. Recognizing facial expressions automatically from video. In Handbook of ambient intelligence and smart environments, ed. H. Nakashima, J. Augusto, and H. Aghajan. New York: Springer.
Soken, N.H., and A.D. Pick. 1999. Infants’ perception of dynamic affective expressions: Do infants distinguish specific expressions? Child Development 70(6): 1275–1282.
Sorce, J.F., R.N. Emde, J.J. Campos, and M.D. Klinnert. 1985. Maternal emotional signaling: Its effect on the visual cliff behavior of 1-year-olds. Developmental Psychology 21(1): 195–200.
Sroufe, L.A. 1995. Emotional development: The organization of emotional life in the early years. New York: Cambridge University Press.
Stern, D. 1985. The interpersonal world of the infant: A view from psychoanalysis and developmental psychology. New York: Basic Books.
Tistarelli, M. 1996. Multiple constraints to compute optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(12): 1243–1250.
Tistarelli, M., M. Bicego, and E. Grosso. 2008. Dynamic face recognition: From human to machine vision. In Image and Vision Computing: Special issue on Multimodal Biometrics, M. Tistarelli and J. Bigun eds. doi:10.1016/j.imavis.2007.05.006.
Tranel, D., A. Damasio, and H. Damasio. 1988. Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity. Neurology 38: 690–696.
Tretiak, O., and L. Pastor. 1984. Velocity estimation from image sequences with second order differential operators. In Proceeding of 7th IEEE international conference on pattern recognition, 16–19. IEEE.
Troje, N.F., and H.H. Bülthoff. 1996. Face recognition under varying pose: The role of texture and shape. Vision Research 36: 1761–1771.
Valentine, T. 1991. A unified account of the effects of distinctiveness, inversion, and race in face recognition. Quarterly Journal of Experimental Psychology 43A: 161–204.
Walker-Andrews, A.S. 1997. Infants’ perception of expressive behaviors: Differentiation of multimodal information. Psychological Bulletin 121(3): 437–456.
Walker-Andrews, A.S., and L.E. Bahrick. 2001. Perceiving the real world: Infants’ detection of and memory for social information. Infancy 2(4): 469–481.
Wellman, H.M., P.L. Harris, M. Banerjee, and A. Sinclair. 1995. Early understanding of emotion: Evidence from natural language. Cognition and Emotion 9(2–3): 117–149.
Widen, S.C., and J.A. Russell. 2003. A closer look at preschoolers’ freely produced labels for facial expressions. Developmental Psychology 39(1): 114–128.
Widen, S.C., and J.A. Russell. 2008a. Children acquire emotion categories gradually. Cognitive Development 23(2): 291–312.
Widen, S.C., and J.A. Russell. 2008b. Young children’s understanding of others’ emotions. In Handbook of emotions, 3rd ed, ed. M. Lewis, J.M. Haviland-Jones, and L.F. Barrett, 348–363. New York: Guilford Press.
Young, A.W., F. Newcombe, de Haan, M. Small, and D.C. Hay. 1993. Face perception after brain injury: Selective impairments affecting identity and expression. Brain 116(4): 941–959.
Zeng, Z., M. Pantic, G.I. Roisman, and T.S. Huang. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on PAMI 31(1): 39–58.
Zhou, S.K., V. Krueger, and R. Chellappa. 2003. Probabilistic recognition of human faces from video. Computer Vision and Image Understanding 91(1–2): 214–245.
Zhou, S.K., R. Chellappa, and B. Moghaddam. 2004. Visual tracking and recognition using appearance-adaptive models in particle filters. Image Processing 13(11): 1491–1506.
Acknowledgements
Funding from the European Union COST action 2101 “Biometrics for Identity Documents and Smart Cards” and from the Regional Research Authority are acknowledged.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media B.V.
About this chapter
Cite this chapter
Tistarelli, M., Barrett, S.E., O’Toole, A.J. (2012). Facial Recognition, Facial Expression and Intention Detection. In: Mordini, E., Tzovaras, D. (eds) Second Generation Biometrics: The Ethical, Legal and Social Context. The International Library of Ethics, Law and Technology, vol 11. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-3892-8_11
Download citation
DOI: https://doi.org/10.1007/978-94-007-3892-8_11
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-3891-1
Online ISBN: 978-94-007-3892-8
eBook Packages: Humanities, Social Sciences and LawPhilosophy and Religion (R0)