skip to main content
research-article

Talking bodies: Sensitivity to desynchronization of conversations

Published:06 October 2009Publication History
Skip Abstract Section

Abstract

In this article, we investigate human sensitivity to the coordination and timing of conversational body language for virtual characters. First, we captured the full body motions (excluding faces and hands) of three actors conversing about a range of topics, in either a polite (i.e., one person talking at a time) or debate/argument style. Stimuli were then created by applying the motion-captured conversations from the actors to virtual characters. In a 2AFC experiment, participants viewed paired sequences of synchronized and desynchronized conversations and were asked to guess which was the real one. Detection performance was above chance for both conversation styles but more so for the polite conversations, where desynchronization was more noticeable.

References

  1. Cassell, J., Vihjalmsson, H. H., and Bickmore, T. 2001. Beat: The behavior expression animation toolkit. In Proceedings of ACM SIGGRAPH. 477--486. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. de Heras Ciechomski, P., Schertenleib, S., Maïm, J., and Thalmann, D. 2005. Real-Time shader rendering for crowds in virtual heritage. In Proceedings of the 6th International Symposium on Virtual Reality, Archeology and Cultural Heritage (VAST'05). 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ennis, C., Peters, C., and O'Sullivan, C. 2008. Perceptual evaluation of position and orientation context rules for pedestrian formations. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (APGV'08). 75--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Hannah, A. and Murachver, T. 1999. Gender and conversational style as predictors of conversational behavior. J. Lang. Social Psychol. 8, 2, 153--174.Google ScholarGoogle ScholarCross RefCross Ref
  5. Heck, R., Kovar, L., and Gleicher, M. 2006. Splicing upper-body actions with locomotion. Comput. Graph. Forum. 25, 3, 459--466.Google ScholarGoogle ScholarCross RefCross Ref
  6. Ikemoto, L. and Forsyth, D. A. 2004. Enriching a motion collection by transplanting limbs. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 99--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Johansson, G. 1973. Visual perception of biological motion and a model for its analysis. Percept. and Psychophy. 14, 2, 201--211.Google ScholarGoogle ScholarCross RefCross Ref
  8. Maïm, J., Haegler, S., Yersin, B., Mueller, P., Thalmann, D., and VanGool, L. 2007. Populating ancient pompeii with crowds of virtual romans. In Proceedings of the 8th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST'07). 26--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. McDonnell, R., Larkin, M., Dobbyn, S., Collins, S., and O'Sullivan, C. 2008. Clone attack! Perception of crowd variety. ACM Trans. Graph. 27, 3, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Musse, S. R. and Thalmann, D. 2001. Hierarchical model for real time simulation of virtual human crowds. IEEE Trans. Vis. Comput. Graph. 7, 2, 152--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. O'Sullivan, C., Cassell, J., Vilhalmsson, H., Peters, C., Leeson, W., Giang, T., Dingliana, J., and Dobbyn, S. 2002a. Crowd and group simulation with levels of detail for geometry, motion and conversational behaviour. In Proceedings of the Eurographics Ireland Workshop. vol. 21. 15--20.Google ScholarGoogle Scholar
  12. O'Sullivan, C., Cassell, J., Vilhjalmsson, H., Dingliana, J., Dobbyn, S., McNamee, B., Peters, C., and Giang, T. 2002b. Levels of detail for crowds and groups. Comput. Graph. Forum 21, 4, 733--741.Google ScholarGoogle ScholarCross RefCross Ref
  13. Paris, S., Pettre, J., and Donikian, S. 2007. Pedestrian reactive navigation for crowd simulation: A predictive approach. Comput. Graph. Forum 26, 3, 665--674.Google ScholarGoogle ScholarCross RefCross Ref
  14. Peters, C. and Ennis, C. 2009. Modelling groups of plausible virtual pedestrians. IEEE Trans. Comput. Graph. Appl. 29, 4, 54--63.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Peters, C., Ennis, C., McDonnell, R., and O'Sullivan, C. 2008. Crowds in context: Evaluating the perceptual plausibility of pedestrian orientations. In Proceedings of Eurographics Short Papers. 227--230.Google ScholarGoogle Scholar
  16. Rose, D. and Clarke, T. J. 2009. Look who's talking: Visual detection of speech from whole-body biological motion cues during emotive interpersonal conversation. Perception 38, 153--156.Google ScholarGoogle ScholarCross RefCross Ref
  17. Thalmann, D. 2001. The foundations to build a virtual human society. In Proceedings of the 3rd International Workshop on Intelligent Virtual Agents (IVA). Lecture Notes in Artificial Intelligence, vol. 2190. Springer-Verlag, 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Talking bodies: Sensitivity to desynchronization of conversations

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Applied Perception
      ACM Transactions on Applied Perception  Volume 6, Issue 4
      September 2009
      63 pages
      ISSN:1544-3558
      EISSN:1544-3965
      DOI:10.1145/1609967
      Issue’s Table of Contents

      Copyright © 2009 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 October 2009
      • Accepted: 1 August 2009
      • Received: 1 July 2009
      Published in tap Volume 6, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader