nach oben

Journal on Multimodal User Interfaces

Erschienen in:

02.01.2019 | Original Paper

The sense of social agency in gaze leading

verfasst von: Samuel Recht, Ouriel Grynszpan

Erschienen in: Journal on Multimodal User Interfaces | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Social interactions entail reciprocal reactions where one’s communicative acts triggers responses in others. Fluent interpersonal exchange relies on the ability to discriminate behaviors produced by others that are responses to one’s actions, thus involving a social sense of agency. Given the pivotal role of gaze in human communication, we propose to use gaze following as a model for studying the sense of agency in social actions. The experiment investigates the influence of sensory expertise and timing of the action’s effects by comparing feedback provided by a human avatar versus a nonfigurative animated object (an arrow) and by varying the control exerted by participants’ gaze on the feedback (avatar vs arrow). Results revealed a linear relationship between the judgement of agency and feedback latencies and higher agency discriminating performances with the avatar. These outcomes suggest that classical cognitive accounts of the sense of agency can be expanded to the realm of social actions and provide important information for designing virtual agents to train social gaze interactions.

Vorheriger Artikel Training the use of theory of mind using artificial agents

Nächster Artikel Virtual discrete trial training for teacher trainees

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Bandura A (2006) Toward a psychology of human agency. Perspect Psychol Sci 1:164–180. https://doi.org/10.1111/j.1745-6916.2006.00011.x CrossRef

Nadel J, Guérini C, Pezé A, Rivet C (1999) The evolving nature of imitation as a format for communication. In: Nadel J, Butterworth G (eds) Imitation in infancy. Cambridge University Press, New York, pp 209–234

Nadel J (2002) Imitation and imitation recognition: functional use in preverbal infants and nonverbal children with autism. In: Meltzoff AN, Prinz W (eds) The imitative mind: development, evolution, and brain bases. Cambridge University Press, Cambridge, pp 42–62CrossRef

Grynszpan O, Nadel J, Martin J-C et al (2012) Self-monitoring of gaze in high functioning autism. J Autism Dev Disord 42:1642–1650. https://doi.org/10.1007/s10803-011-1404-9 CrossRef

Loveland KA (2005) Social-emotional impairment and self-regulation in autism spectrum disorders. In: Nadel J, Muir D (eds) Emotional development: recent research advances. Oxford University Press, Oxford, pp 365–382

Haggard P, Chambon V (2012) Sense of agency. Curr Biol 22:R390–R392. https://doi.org/10.1016/j.cub.2012.02.040 CrossRef

Gallagher S (2000) Philosophical conceptions of the self: implications for cognitive science. Trends Cogn Sci 4:14–21. https://doi.org/10.1016/S1364-6613(99)01417-5 CrossRef

Jeannerod M (2003) The mechanism of self-recognition in humans. Behav Brain Res 142:1–15CrossRef

van der Wel RPRD, Sebanz N, Knoblich G (2012) The sense of agency during skill learning in individuals and dyads. Conscious Cogn 21:1267–1279. https://doi.org/10.1016/j.concog.2012.04.001 CrossRef

10.

Obhi SS, Hall P (2011) Sense of agency and intentional binding in joint action. Exp Brain Res 211:655–662. https://doi.org/10.1007/s00221-011-2675-2 CrossRef

11.

Pfister R, Obhi SS, Rieger M, Wenke D (2014) Action and perception in social contexts: intentional binding for social action effects. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2014.00667

12.

Herwig A, Horstmann G (2011) Action–effect associations revealed by eye movements. Psychon Bull Rev 18:531–537. https://doi.org/10.3758/s13423-011-0063-3 CrossRef

13.

Verschoor SA, Spapé M, Biro S, Hommel B (2013) From outcome prediction to action selection: developmental change in the role of action–effect bindings. Dev Sci 16:801–814. https://doi.org/10.1111/desc.12085

14.

Blakemore SJ, Wolpert DM, Frith CD (2002) Abnormalities in the awareness of action. Trends Cogn Sci 6:237–242CrossRef

15.

Wolpert DM, Doya K, Kawato M (2003) A unifying computational framework for motor control and social interaction. Philos Trans R Soc Lond B Biol Sci 358:593–602. https://doi.org/10.1098/rstb.2002.1238 CrossRef

16.

Sperry RW (1950) Neural basis of the spontaneous optokinetic response produced by visual inversion. J Comp Physiol Psychol 43:482–489CrossRef

17.

von Holst E, Mittelstaedt H (1950) Das Reafferenzprinzip. Naturwissenschaften 37:464–476. https://doi.org/10.1007/BF00622503 CrossRef

18.

Wurtz RH (2008) Neuronal mechanisms of visual stability. Vis Res 48:2070–2089CrossRef

19.

Wolpert DM, Ghahramani Z, Jordan MI (1995) An internal model for sensorimotor integration. Science 269:1880–1882CrossRef

20.

Wolpert DM, Miall RC (1996) Forward models for physiological motor control. Neural Netw Off J Int Neural Netw Soc 9:1265–1279CrossRefMATH

21.

Haggard P (2005) Conscious intention and motor cognition. Trends Cogn Sci 9:290–295. https://doi.org/10.1016/j.tics.2005.04.012 CrossRef

22.

Wegner DM (2003) The mind’s best trick: how we experience conscious will. Trends Cogn Sci 7:65–69. https://doi.org/10.1016/S1364-6613(03)00002-0 CrossRef

23.

Farrer C, Valentin G, Hupé JM (2013) The time windows of the sense of agency. Conscious Cogn 22:1431–1441. https://doi.org/10.1016/j.concog.2013.09.010 CrossRef

24.

Kawabe T, Roseboom W, Nishida S (2013) The sense of agency is action–effect causality perception based on cross-modal grouping. Proc R Soc Lond B Biol Sci 280:20130991. https://doi.org/10.1098/rspb.2013.0991 CrossRef

25.

Sato A, Yasuda A (2005) Illusion of sense of self-agency: discrepancy between the predicted and actual sensory consequences of actions modulates the sense of self-agency, but not the sense of self-ownership. Cognition 94:241–255. https://doi.org/10.1016/j.cognition.2004.04.003 CrossRef

26.

Shanks DR, Dickinson A (1991) Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit 19:353–360. https://doi.org/10.3758/BF03197139 CrossRef

27.

Shanks DR, Pearson SM, Dickinson A (1989) Temporal contiguity and the judgement of causality by human subjects. Q J Exp Psychol Sect B 41:139–159. https://doi.org/10.1080/14640748908401189

28.

Moore JW, Fletcher PC (2012) Sense of agency in health and disease: a review of cue integration approaches. Conscious Cogn 21:59–68. https://doi.org/10.1016/j.concog.2011.08.010 CrossRef

29.

Synofzik M, Vosgerau G, Newen A (2008) Beyond the comparator model: a multifactorial two-step account of agency. Conscious Cogn 17:219–239. https://doi.org/10.1016/j.concog.2007.03.010 CrossRef

30.

David N, Newen A, Vogeley K (2008) The “sense of agency” and its underlying cognitive and neural mechanisms. Conscious Cogn 17:523–534. https://doi.org/10.1016/j.concog.2008.03.004 CrossRef

31.

Grynszpan O, Simonin J, Martin J-C, Nadel J (2012) Investigating social gaze as an action-perception online performance. Front Hum Neurosci 6:94. https://doi.org/10.3389/fnhum.2012.00094 CrossRef

32.

Pfeiffer UJ, Schilbach L, Jording M et al (2012) Eyes on the mind: investigating the influence of gaze dynamics on the perception of others in real-time social interaction. Front Psychol 3:537. https://doi.org/10.3389/fpsyg.2012.00537 CrossRef

33.

Kobayashi H, Kohshima S (2001) Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye. J Hum Evol 40:419–435. https://doi.org/10.1006/jhev.2001.0468 CrossRef

34.

Posner MI (1980) Orienting of attention. Q J Exp Psychol 32:3–25. https://doi.org/10.1080/00335558008248231 CrossRef

35.

Frischen A, Bayliss AP, Tipper SP (2007) Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychol Bull 133:694–724. https://doi.org/10.1037/0033-2909.133.4.694 CrossRef

36.

Lachat F, Conty L, Hugueville L, George N (2012) Gaze cueing effect in a face-to-face situation. J Nonverbal Behav 36:177–190. https://doi.org/10.1007/s10919-012-0133-x CrossRef

37.

Driver J (1999) Gaze perception triggers reflexive visuospatial orienting. Vis Cogn 6:509–540. https://doi.org/10.1080/135062899394920 CrossRef

38.

Friesen CK, Kingstone A (1998) The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychon Bull Rev 5:490–495. https://doi.org/10.3758/BF03208827 CrossRef

39.

Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci Biobehav Rev 24:581–604. https://doi.org/10.1016/S0149-7634(00)00025-7 CrossRef

40.

Charman T (2003) Why is joint attention a pivotal skill in autism? Philos Trans R Soc Lond B Biol Sci 358:315–324. https://doi.org/10.1098/rstb.2002.1199 CrossRef

41.

Scaife M, Bruner JS (1975) The capacity for joint visual attention in the infant. Nature 253:265–266. https://doi.org/10.1038/253265a0 CrossRef

42.

Mundy P, Newell L (2007) Attention, joint attention, and social cognition. Curr Dir Psychol Sci 16:269–274. https://doi.org/10.1111/j.1467-8721.2007.00518.x CrossRef

43.

Edwards SG, Stephenson LJ, Dalmaso M, Bayliss AP (2015) Social orienting in gaze leading: a mechanism for shared attention. Proc R Soc B 282:20151141. https://doi.org/10.1098/rspb.2015.1141 CrossRef

44.

Brignani D, Guzzon D, Marzi CA, Miniussi C (2009) Attentional orienting induced by arrows and eye-gaze compared with an endogenous cue. Neuropsychologia 47:370–381. https://doi.org/10.1016/j.neuropsychologia.2008.09.011 CrossRef

45.

Friesen CK, Ristic J, Kingstone A (2004) Attentional effects of counterpredictive gaze and arrow cues. J Exp Psychol Hum Percept Perform 30:319–329. https://doi.org/10.1037/0096-1523.30.2.319 CrossRef

46.

Guzzon D, Brignani D, Miniussi C, Marzi CA (2010) Orienting of attention with eye and arrow cues and the effect of overtraining. Acta Psychol (Amst) 134:353–362. https://doi.org/10.1016/j.actpsy.2010.03.008 CrossRef

47.

Hietanen JK, Leppänen JM, Nummenmaa L, Astikainen P (2008) Visuospatial attention shifts by gaze and arrow cues: an ERP study. Brain Res 1215:123–136. https://doi.org/10.1016/j.brainres.2008.03.091 CrossRef

48.

Hietanen JK, Nummenmaa L, Nyman MJ et al (2006) Automatic attention orienting by social and symbolic cues activates different neural networks: an fMRI study. NeuroImage 33:406–413. https://doi.org/10.1016/j.neuroimage.2006.06.048 CrossRef

49.

Marotta A, Lupiáñez J, Martella D, Casagrande M (2012) Eye gaze versus arrows as spatial cues: two qualitatively different modes of attentional selection. J Exp Psychol Hum Percept Perform 38:326–335. https://doi.org/10.1037/a0023959 CrossRef

50.

Stevens SA, West GL, Al-Aidroos N et al (2008) Testing whether gaze cues and arrow cues produce reflexive or volitional shifts of attention. Psychon Bull Rev 15:1148–1153. https://doi.org/10.3758/PBR.15.6.1148 CrossRef

51.

Tipples J (2008) Orienting to counterpredictive gaze and arrow cues. Percept Psychophys 70:77–87. https://doi.org/10.3758/PP.70.1.77 CrossRef

52.

Tipples J (2002) Eye gaze is not unique: automatic orienting in response to uninformative arrows. Psychon Bull Rev 9:314–318. https://doi.org/10.3758/BF03196287 CrossRef

53.

Hooker CI, Paller KA, Gitelman DR et al (2003) Brain networks for analyzing eye gaze. Cogn Brain Res 17:406–418. https://doi.org/10.1016/S0926-6410(03)00143-5 CrossRef

54.

Bayliss AP, Murphy E, Naughtin CK et al (2013) “Gaze leading”: initiating simulated joint attention influences eye movements and choice behavior. J Exp Psychol Gen 142:76–92. https://doi.org/10.1037/a0029286 CrossRef

55.

Dalmaso M, Edwards GS, Bayliss AP (2016) Re-encountering individuals who previously engaged in joint gaze modulates subsequent gaze cueing. J Exp Psychol Learn Mem Cogn 42:271–284. https://doi.org/10.1037/xlm0000159 CrossRef

56.

Dratsch T, Schwartz C, Yanev K et al (2013) Getting a grip on social gaze: control over others’ gaze helps gaze detection in high-functioning autism. J Autism Dev Disord 43:286–300. https://doi.org/10.1007/s10803-012-1569-x CrossRef

57.

Grynszpan O, Nadel J, Martin J-C, Fossati P (2017) The awareness of joint attention: a study using gaze contingent avatars. Interact Stud 18(2):234–253. https://doi.org/10.1075/is.18.2.05gry CrossRef

58.

Kim K, Mundy P (2012) Joint attention, social-cognition, and recognition memory in adults. Front Hum Neurosci 6:1. https://doi.org/10.3389/fnhum.2012.00172

59.

Oberwelland E, Schilbach L, Barisic I et al (2016) Look into my eyes: investigating joint attention using interactive eye-tracking and fMRI in a developmental sample. NeuroImage 130:248–260. https://doi.org/10.1016/j.neuroimage.2016.02.026 CrossRef

60.

Schilbach L, Wilms M, Eickhoff SB et al (2010) Minds made for sharing: initiating joint attention recruits reward-related neurocircuitry. J Cogn Neurosci 22:2702–2715. https://doi.org/10.1162/jocn.2009.21401 CrossRef

61.

Wilms M, Schilbach L, Pfeiffer U et al (2010) It’s in your eyes—using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Soc Cogn Affect Neurosci 5:98. https://doi.org/10.1093/scan/nsq024 CrossRef

62.

Daprati E, Franck N, Georgieff N et al (1997) Looking for the agent: an investigation into consciousness of action and self-consciousness in schizophrenic patients. Cognition 65:71–86CrossRef

63.

Farrer C, Franck N, Georgieff N et al (2003) Modulating the experience of agency: a positron emission tomography study. NeuroImage 18:324–333. https://doi.org/10.1016/S1053-8119(02)00041-1 CrossRef

64.

Sperduti M, Delaveau P, Fossati P, Nadel J (2011) Different brain structures related to self- and external-agency attribution: a brief review and meta-analysis. Brain Struct Funct 216:151–157. https://doi.org/10.1007/s00429-010-0298-1 CrossRef

65.

Faul F, Erdfelder E, Lang A-G, Buchner A (2007) G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 39:175–191. https://doi.org/10.3758/BF03193146 CrossRef

66.

Courgeon M, Clavel C (2013) MARC: a framework that features emotion models for facial animation during human–computer interaction. J Multimodal User Interfaces 7:311–319. https://doi.org/10.1007/s12193-013-0124-1 CrossRef

67.

Courgeon M, Rautureau G, Martin J-C, Grynszpan O (2014) Joint attention simulation using eye-tracking and virtual humans. IEEE Trans Affect Comput 5:238–250. https://doi.org/10.1109/TAFFC.2014.2335740 CrossRef

68.

Wilson HR, Wilkinson F, Lin L-M, Castillo M (2000) Perception of head orientation. Vis Res 40:459–472. https://doi.org/10.1016/S0042-6989(99)00195-9 CrossRef

69.

Horowitz TS, Wolfe JM, Alvarez GA et al (2009) The speed of free will. Q J Exp Psychol 62:2262–2288. https://doi.org/10.1080/17470210902732155 CrossRef

70.

Sakia RM (1992) The Box–Cox transformation technique: a review. Statistician 41:169–178CrossRef

71.

Al Moubayed S, Edlund J, Beskow J (2012) Taming Mona Lisa: communicating gaze faithfully in 2D and 3D facial projections. ACM Trans Interact Intell Syst 1:25CrossRef

72.

Senju A, Southgate V, White S, Frith U (2009) Mindblind eyes: an absence of spontaneous theory of mind in Asperger syndrome. Science 325:883–885. https://doi.org/10.1126/science.1176170 CrossRef

73.

Senju A, Tojo Y, Dairoku H, Hasegawa T (2004) Reflexive orienting in response to eye gaze and an arrow in children with and without autism. J Child Psychol Psychiatry 45:445–458CrossRef

74.

Kajopoulos J, Wong AHY, Yuen AWC et al (2015) Robot-assisted training of joint attention skills in children diagnosed with autism. In: Tapus A, André E, Martin J-C et al (eds) Social robotics. Springer International Publishing, Cham, pp 296–305CrossRef

Titel: The sense of social agency in gaze leading
verfasst von: Samuel Recht
Ouriel Grynszpan
Publikationsdatum: 02.01.2019
Verlag: Springer International Publishing
Erschienen in: Journal on Multimodal User Interfaces / Ausgabe 1/2019
Print ISSN: 1783-7677
Elektronische ISSN: 1783-8738
DOI: https://doi.org/10.1007/s12193-018-0286-y

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 1/2019

Virtual discrete trial training for teacher trainees

Special issue editorial: Virtual Agents for Social Skills Training

Training the use of theory of mind using artificial agents

Training doctors’ social skills to break bad news: evaluation of the impact of virtual environment displays on the sense of presence