Skip to main content
Top
Published in: Cognitive Processing 2/2012

01-10-2012 | Editorial

Social signals: from theory to applications

Authors: Isabella Poggi, Francesca D’Errico, Alessandro Vinciarelli

Published in: Cognitive Processing | Special Issue 2/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The Special Issue Editorial introduces the research milieu in which Social Signal Processing originates, by merging computer scientists and social scientists and giving rise to this field in parallel with Human–Computer Interaction, Affective Computing, and Embodied Conversational Agents, all similarly characterized by high interdisciplinarity, stress on multimodality of communication, and the continuous loop from theory to simulation and application. Some frameworks of the cognitive and social processes underlying social signals are identified as reference points (Theory of Mind and Intersubjectivity, mirror neurons, and the ontogenesis and phylogenesis of communication), while three dichotomies (automatic vs. controlled, individualistic vs. intersubjective, and meaning vs. influence) are singled out as leads to navigate within the theoretical and applicative studies presented in the Special Issue.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
Literature
go back to reference Allwood J (2008) Dimensions of embodied communication—towards a typology of embodied communication. In: Wachsmuth I, Lenzen M, Knoblich G (eds) Embodied communication in humans and machines. Oxford University Press, Oxford, pp 257–284CrossRef Allwood J (2008) Dimensions of embodied communication—towards a typology of embodied communication. In: Wachsmuth I, Lenzen M, Knoblich G (eds) Embodied communication in humans and machines. Oxford University Press, Oxford, pp 257–284CrossRef
go back to reference Ambady N, Rosenthal R (1993) Half a minute: predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. J Personal Soc Psychol 64:431–441CrossRef Ambady N, Rosenthal R (1993) Half a minute: predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. J Personal Soc Psychol 64:431–441CrossRef
go back to reference Asch SE (1946) Forming impressions of personality. J Abnormal Soc Psychol 41:258–290CrossRef Asch SE (1946) Forming impressions of personality. J Abnormal Soc Psychol 41:258–290CrossRef
go back to reference Bargh JA (2006) Social psychology and the unconscious: The automaticity of the higher mental processes. Psychology Press, Philadelphia Bargh JA (2006) Social psychology and the unconscious: The automaticity of the higher mental processes. Psychology Press, Philadelphia
go back to reference Baron-Cohen S (1991) Precursors to a theory of mind: understanding attention in others. In: Whiten A (ed) Natural theories of mind: evolution, development and simulation of everyday mindreading. Basil Blackwell, Oxford Baron-Cohen S (1991) Precursors to a theory of mind: understanding attention in others. In: Whiten A (ed) Natural theories of mind: evolution, development and simulation of everyday mindreading. Basil Blackwell, Oxford
go back to reference Baron-Cohen S (1995) Mindblindness: an essay on autism and theory of mind. MIT Press, Cambridge Baron-Cohen S (1995) Mindblindness: an essay on autism and theory of mind. MIT Press, Cambridge
go back to reference Bartlett FC (1932) Remembering: a study in experimental and social psychology. University Press, Cambridge Bartlett FC (1932) Remembering: a study in experimental and social psychology. University Press, Cambridge
go back to reference Brinck I (2001) Attention and the evolution of intentional communication. Pragmat Cogn 9(2):255–272CrossRef Brinck I (2001) Attention and the evolution of intentional communication. Pragmat Cogn 9(2):255–272CrossRef
go back to reference Castelfranchi C (1992) No more cooperation, please! in search of the social structure of verbal interaction. Communication from an artificial intelligence perspective. NATO ASI Ser 100:205–227 Castelfranchi C (1992) No more cooperation, please! in search of the social structure of verbal interaction. Communication from an artificial intelligence perspective. NATO ASI Ser 100:205–227
go back to reference Curhan J, Pentland A (2007) Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. J Appl Psychol 92(3):802–811PubMedCrossRef Curhan J, Pentland A (2007) Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. J Appl Psychol 92(3):802–811PubMedCrossRef
go back to reference De Jaegher H, Di Paolo EA, Gallagher S (2010) Can social interaction constitute social cognition? Trends Cogn Sci 14(10):441–447PubMedCrossRef De Jaegher H, Di Paolo EA, Gallagher S (2010) Can social interaction constitute social cognition? Trends Cogn Sci 14(10):441–447PubMedCrossRef
go back to reference Efron D (1941) Gesture and environment. King’s Crown Press, New York Efron D (1941) Gesture and environment. King’s Crown Press, New York
go back to reference Ekman P, Friesen W, Hager J (2002) Facial action coding system (FACS): manual. A Human Face, Salt Lake City Ekman P, Friesen W, Hager J (2002) Facial action coding system (FACS): manual. A Human Face, Salt Lake City
go back to reference Fiske ST, Taylor SE (1991) Social cognition, 2nd edn. McGraw Hill, New York Fiske ST, Taylor SE (1991) Social cognition, 2nd edn. McGraw Hill, New York
go back to reference Fiske ST, Taylor SE (2008) Social cognition: from brains to culture. McGraw-Hill, New York Fiske ST, Taylor SE (2008) Social cognition: from brains to culture. McGraw-Hill, New York
go back to reference Gallese V (2006) Intentional attunement: a neurophysiological perspective on social cognition and its disruption in autism. Brain Res 1079:15–24PubMedCrossRef Gallese V (2006) Intentional attunement: a neurophysiological perspective on social cognition and its disruption in autism. Brain Res 1079:15–24PubMedCrossRef
go back to reference Ghiglione R (1986) L’homme communiquant. Colin, Paris Ghiglione R (1986) L’homme communiquant. Colin, Paris
go back to reference Higgins ET, Rholes WS (1976) Impression formation and role fulfillment: a “holistic reference” approach. J Exp Soc Psychol 12:422–435CrossRef Higgins ET, Rholes WS (1976) Impression formation and role fulfillment: a “holistic reference” approach. J Exp Soc Psychol 12:422–435CrossRef
go back to reference Jakobson R (1953) Essais de Linguistique généra1. Minuit, Paris Jakobson R (1953) Essais de Linguistique généra1. Minuit, Paris
go back to reference Kendon A (2004) Gesture. Visible action as utterance. Cambridge University Press, Cambridge Kendon A (2004) Gesture. Visible action as utterance. Cambridge University Press, Cambridge
go back to reference Kita S (ed) (2003) Pointing: where language, culture, and cognition meet. Lawrence Erlbaum, Mahwah Kita S (ed) (2003) Pointing: where language, culture, and cognition meet. Lawrence Erlbaum, Mahwah
go back to reference Knoblich G, Sebanz N (2008) Evolving intentions for social interaction: from entrainment to joint action. Philosoph Trans R Soc Lond B Biol Sci 12; 363(1499):2021–31 Knoblich G, Sebanz N (2008) Evolving intentions for social interaction: from entrainment to joint action. Philosoph Trans R Soc Lond B Biol Sci 12; 363(1499):2021–31
go back to reference Lazarus RS (1982) Thoughts on the relations between emotion and cognition. Am Psychol 37:1019–1024CrossRef Lazarus RS (1982) Thoughts on the relations between emotion and cognition. Am Psychol 37:1019–1024CrossRef
go back to reference Leone G (2012, this volume) Observing social signals in scaffolding interactions: how to detect when a helping intention risks falling short. Cogn Process doi:10.1007/s10339-011-0422-z Leone G (2012, this volume) Observing social signals in scaffolding interactions: how to detect when a helping intention risks falling short. Cogn Process doi:10.​1007/​s10339-011-0422-z
go back to reference McNeill D (1992) Hand and mind. University of Chicago Press, Chicago McNeill D (1992) Hand and mind. University of Chicago Press, Chicago
go back to reference McNeill D (ed) (2000) Language and gesture. Cambridge University Press, Cambridge McNeill D (ed) (2000) Language and gesture. Cambridge University Press, Cambridge
go back to reference Mehu M, Scherer KR (2012, this volume) A psycho-ethological approach to Social Signal Processing. Cogn Process Mehu M, Scherer KR (2012, this volume) A psycho-ethological approach to Social Signal Processing. Cogn Process
go back to reference Meltzoff AN, Decety J (2003) What imitation tells us about social cognition. A rapprochement between developmental psychology and cognitive neuroscience. Philosoph Trans R Soc Lond 358:491–500CrossRef Meltzoff AN, Decety J (2003) What imitation tells us about social cognition. A rapprochement between developmental psychology and cognitive neuroscience. Philosoph Trans R Soc Lond 358:491–500CrossRef
go back to reference Miceli M, Poggi, I, de Rosis F (2006) Emotional and non-emotional persuasion. IJIS, Special issue on Natural Argumentation Miceli M, Poggi, I, de Rosis F (2006) Emotional and non-emotional persuasion. IJIS, Special issue on Natural Argumentation
go back to reference Morris D (1997) Manwatching. A field-guide to human behavior. Jonathan Cape, London Morris D (1997) Manwatching. A field-guide to human behavior. Jonathan Cape, London
go back to reference Müller C (1998) Redebegleitende Gesten. Kulturgeschichte—Theorie—Sprachvergleich. Berlin-Verlag Arno Spitz, Berlin Müller C (1998) Redebegleitende Gesten. Kulturgeschichte—Theorie—Sprachvergleich. Berlin-Verlag Arno Spitz, Berlin
go back to reference Müller C (2004) Forms and uses of the palm up open hand: a case of a gesture family? In: Müller C, Posner R (eds) The semantics and pragmatics of everyday gestures. Weidler, Berlin Müller C (2004) Forms and uses of the palm up open hand: a case of a gesture family? In: Müller C, Posner R (eds) The semantics and pragmatics of everyday gestures. Weidler, Berlin
go back to reference Nass C, Brave S (2005) Wired for speech: how voice activates and advances the human-computer relationship. The MIT Press, Cambridge Nass C, Brave S (2005) Wired for speech: how voice activates and advances the human-computer relationship. The MIT Press, Cambridge
go back to reference Nathan MJ, Alibali MW (2011) How gesture use enables intersubjectivity in the classroom. In: Stam G, Ishino M (eds) Integrating gestures. John Benjamins, Amsterdam, pp 257–266 Nathan MJ, Alibali MW (2011) How gesture use enables intersubjectivity in the classroom. In: Stam G, Ishino M (eds) Integrating gestures. John Benjamins, Amsterdam, pp 257–266
go back to reference Novielli N, Mazzotta I, De Carolis B, and Pizzutilo S (2012, this volume) Analysing user’s reactions in advice-giving dialogues with a socially intelligent eca. Cogn Process. doi:10.1007/s10339- 011-0420-1 Novielli N, Mazzotta I, De Carolis B, and Pizzutilo S (2012, this volume) Analysing user’s reactions in advice-giving dialogues with a socially intelligent eca. Cogn Process. doi:10.​1007/​s10339- 011-0420-1
go back to reference Oberman LM, Hubbard EM, McCleery JP, Altschuler EL, Ramachandran VS, Pineda JA (2005) EEG evidence for mirror neuron dysfunction in autism spectrum disorders. Brain Res Cogn Brain Res 24:190–198 Oberman LM, Hubbard EM, McCleery JP, Altschuler EL, Ramachandran VS, Pineda JA (2005) EEG evidence for mirror neuron dysfunction in autism spectrum disorders. Brain Res Cogn Brain Res 24:190–198
go back to reference Pentland A (2007) Social Signal Processing. IEEE Sig Process Magaz 24(4):108–111CrossRef Pentland A (2007) Social Signal Processing. IEEE Sig Process Magaz 24(4):108–111CrossRef
go back to reference Pentland A (2008) Honest signals. How do they shape our world. MIT Press, Cambridge Pentland A (2008) Honest signals. How do they shape our world. MIT Press, Cambridge
go back to reference Pesarin A, Cristani M, Murino V, and Vinciarelli A (2012, this volume) Conversation analysis at work: de- tection of conflict in competitive discussions through semi-automatic turn-organization analysis. Cogn Process. doi:10.1007/s10339-011-0417-9 Pesarin A, Cristani M, Murino V, and Vinciarelli A (2012, this volume) Conversation analysis at work: de- tection of conflict in competitive discussions through semi-automatic turn-organization analysis. Cogn Process. doi:10.​1007/​s10339-011-0417-9
go back to reference Poggi I (2007) Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin Poggi I (2007) Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin
go back to reference Poggi I, D’Errico F, Spagnolo A (2010) The embodied morphemes of gaze. In: Kopp S, Wachsmuth I (eds) Gesture in embodied communication and human-computer interaction. Springer, LNAI 5934. doi:10.1007/978-3-642-12553-9_4 Poggi I, D’Errico F, Spagnolo A (2010) The embodied morphemes of gaze. In: Kopp S, Wachsmuth I (eds) Gesture in embodied communication and human-computer interaction. Springer, LNAI 5934. doi:10.​1007/​978-3-642-12553-9_​4
go back to reference Poggi I, D’Errico F (2012, this volume) Social signals. A framework in terms of goals and beliefs. Cogn Process Poggi I, D’Errico F (2012, this volume) Social signals. A framework in terms of goals and beliefs. Cogn Process
go back to reference Shannon CE, Weaver W (1949) The mathematical theory of communication. University of Illinois, Urbana Shannon CE, Weaver W (1949) The mathematical theory of communication. University of Illinois, Urbana
go back to reference Tomasello M (2008) Origins of human communication. The MIT press, Cambridge Tomasello M (2008) Origins of human communication. The MIT press, Cambridge
go back to reference Vesper C, Butterfill S, Knöblich G, Sebanz N (2010) A minimal architecture for joint action. Neural Netw 23:998–1003PubMedCrossRef Vesper C, Butterfill S, Knöblich G, Sebanz N (2010) A minimal architecture for joint action. Neural Netw 23:998–1003PubMedCrossRef
go back to reference Vinciarelli A, Pantic M, D’Errico F, Heylen D, Pantic M, Pelachaud C, Poggi I, Schroeder M (2012) Bridging the gap between social animal and unsocial machine: a survey of Social Signal Processing. IEEE Trans Affect Comput 3(1):69–87CrossRef Vinciarelli A, Pantic M, D’Errico F, Heylen D, Pantic M, Pelachaud C, Poggi I, Schroeder M (2012) Bridging the gap between social animal and unsocial machine: a survey of Social Signal Processing. IEEE Trans Affect Comput 3(1):69–87CrossRef
go back to reference Wachsmuth I, Lenzen M. Knoblich G (2008) In: (eds) Embodied communication in humans and machines. Oxford University press, Oxford Wachsmuth I, Lenzen M. Knoblich G (2008) In: (eds) Embodied communication in humans and machines. Oxford University press, Oxford
go back to reference Williams JH, Whiten A, Suddendorf T, Perrett DI (2001) Imitation, mirror neurons and autism. Neurosci Biobehav Rev 25:287–295 Williams JH, Whiten A, Suddendorf T, Perrett DI (2001) Imitation, mirror neurons and autism. Neurosci Biobehav Rev 25:287–295
go back to reference Wittgenstein L (1953) Philosophical investigations. In: Anscombe GEM, Rhees, R Basil (eds) Blackwell, Oxford Wittgenstein L (1953) Philosophical investigations. In: Anscombe GEM, Rhees, R Basil (eds) Blackwell, Oxford
go back to reference Zajonc R (1980) Feeling and thinking: preferences need no inferences. Am Psychol 35:151–175CrossRef Zajonc R (1980) Feeling and thinking: preferences need no inferences. Am Psychol 35:151–175CrossRef
go back to reference Zlatev JT, Racine C, Sinha C, Itkonen E (2008) The shared mind: perspectives on intersubjectivity. Benjamins, Amsterdam Zlatev JT, Racine C, Sinha C, Itkonen E (2008) The shared mind: perspectives on intersubjectivity. Benjamins, Amsterdam
Metadata
Title
Social signals: from theory to applications
Authors
Isabella Poggi
Francesca D’Errico
Alessandro Vinciarelli
Publication date
01-10-2012
Publisher
Springer-Verlag
Published in
Cognitive Processing / Issue Special Issue 2/2012
Print ISSN: 1612-4782
Electronic ISSN: 1612-4790
DOI
https://doi.org/10.1007/s10339-012-0514-4

Other articles of this Special Issue 2/2012

Cognitive Processing 2/2012 Go to the issue