Maia Garau
ABSTRACT
In this paper we describe an experiment designed to investigate the importance of eye gaze in humanoid avatar's representing people engaged in conversation. We compare responses to dyadic conversations in four mediated conditions: video, audio-only, and two avatar conditions. The avatar conditions differed only in their treatment of eye gaze. In the random-gaze condition the avatars head and eye animations were unrelated to conversational flow. In the informed-gaze condition, they were related to turn-taking during the conversation. The head animations were tracked and the eye animations were inferred from the audio stream. Our comparative analysis of 100 post-experiment questionnaires showed that the random-gaze avatar did not improve on audio-only communication. The informed-gaze avatar significantly outperformed the random-gaze model and also outperformed audio-only on several response measures. We conclude that an avatar whose gaze behaviour is related to the conversation provides a marked improvement on an avatar that merely exhibits liveliness.
- 1.Anstis, S.M., Mayhew, J.W., Morley, T. The Perception of Where a Face or Television 'Portrait' is Looking. American Journal of Psychology 82 (1969), 474-489.Google Scholar
Cross Ref
- 2.Argyle, M., Bodily Communication. Methuen & Co., London, 1975.Google Scholar
- 3.Argyle, M. and Cook, M. Gaze and Mutual Gaze. Cambridge University Press, Cambridge, 1976.Google Scholar
- 4.Argyle, M. and Ingham, R. Mutual Gaze and Proximity. Semiotica 6 (1972), 32-49.Google ScholarCross Ref
- 5.Argyle, M., Ingham, R., Alkema, F. and McCallin, M. The Different Functions of Gaze. Semiotica 7 (1973), 10- 32.Google Scholar
- 6.Argyle, M., Lefebvre, L. and Cook, M. The Meaning of Five Patterns of Gaze. Eur. J. Soc. Psychol. 4, 2 (1974), 125-136.Google ScholarCross Ref
- 7.Buxton, W. Telepresence: integrating shared task and person spaces, in Proceedings of Graphics Interface '92, 123-129. Earlier version appears in Proceedings of Groupware '91 (Amsterdam, Oct. 29, 1991), 27-36. Google ScholarDigital Library
- 8.Colburn, A., Drucker, S., Cohen, M. The Role of Eye- Gaze in Avatar-Mediated Conversational Interfaces, in Sketches and Applications, Siggraph '00 (New Orleans LA, July '00), ACM Press, 253.Google Scholar
- 9.Gibson, J.J. and Pick, A. Perception of Another Person's Looking Behaviour. American Journal of Psychology 46 (1963), 386-394.Google Scholar
- 10.Hindmarsh, J., Fraser, M., Heath, C., Benford, S. and Greenhalgh, C. Fragmented Interaction: Establishing Mutual Orientation in Virtual Environments, in Proceedings of CSCW '98 (Seattle WA, November 1998), 48-53. Google ScholarDigital Library
- 11.Isaacs, E. and Tang, J. What Video Can and Can't Do for Collaboration: A Case Study. Multimedia Systems, 2 (1993), 63-73. Google ScholarDigital Library
- 12.Kendon, A. Some Functions of Gaze-Direction in Social Interaction. Acta Psychologica, 26 (1967), 22-63.Google ScholarCross Ref
- 13.Kendon, M. and Cook, A. The Consistency of Gaze Patterns in Social Interaction. Br. J. Psychol, 60, 4 (1969), 481-494.Google Scholar
- 14.Lord, C. and Haith, M.M. The Perception of Eye Contact. Perception & Psychophysics 16, 3 (1974), 413-416.Google ScholarCross Ref
- 15.McCullagh, P. and Nelder, J.A. Generalised Linear Models. Chapman and Hall, 1983.Google ScholarCross Ref
- 16.Sellen, A. Remote Conversations: The Effects of Mediating Talk with Technology. Human-Computer Interaction, 10(4) (1995), 401-444. Google ScholarDigital Library
- 17.Short, J., Williams, E. and Christie, B. The Social Psychology of Telecommunications. John Wiley & Sons, London, 1976.Google Scholar
- 18.Slater, M., Steed, A., McCarthy, J., Maringelli, F. (1998) The Influence of Body Movement on Subjective Presence in Virtual Environments. Human Factors, 40(3), 469- 477.Google Scholar
- 19.Slater, M., Howell, J., Steed, A., Pertaub, D-P., Garau, M. and Springel, S. Acting in Virtual Reality, in ACM Collaborative Virtual Environments, (San Francisco CA, Sept 2000), 103-110. Google ScholarDigital Library
- 20.Steed, A. Slater, M., Sadagic, A. Tromp, J. and Bullock, A. Leadership and collaboration in virtual environments. In IEEE Virtual Reality, (Houston TX, March 1999), 112-115. Google ScholarDigital Library
- 21.Straus, S. and McGrath, J.E. Does the Medium Matter: The Interaction of Task and Technology on Group Performance and Member Reactions. Journal of Applied Psychology 79 (1994), 87-97.Google Scholar
- 22.Taylor, M.J. and Rowe, S.R. Gaze Communication Using Semantically Consistent Spaces, in Proceedings of CHI 2000 (The Hague, Amsterdam, April 2000), ACM Press, 400-407. Google ScholarDigital Library
- 23.Vertegaal, R. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration, in Proceedings of CHI '99 (Pittsburgh PA, May 1999), ACM Press, 294-301. Google ScholarDigital Library
- 24.Vilhjalmsson, H. and Cassell, J. BodyChat: Autonomous Communicative Behaviours in Avatars, in Autonomous Agents '98 (Minneapolis MN, May 1998), 269-276. Google ScholarDigital Library
Index Terms
- The impact of eye gaze on communication using humanoid avatars
Recommendations
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this ...
Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments
CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative workParticipants' eye-gaze is generally not captured or represented in immersive collaborative virtual environment (ICVE) systems. We present EyeCVE, which uses mobile eye-trackers to drive the gaze of each participant's virtual avatar, thus supporting ...
The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper presents an experiment designed to investigate the impact of scommunication in an immersive virtual environment.Participants were paired by gender and were randomly assigned to a CAVE-like system or a head-mounted display. Both were ...
Comments