Skip to main content
SpringerLink
Log in
Book cover

International Gesture Workshop

GW 1997: Gesture and Sign Language in Human-Computer Interaction pp 23–35Cite as

Movement phases in signs and co-speech gestures, and their transcription by human coders

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1371))

Abstract

The previous literature has suggested that the hand movement in co-speech gestures and signs consists of a series of phases with qualitatively different dynamic characteristics. In this paper, we propose a syntagmatic rule system for movement phases that applies to both co-speech gestures and signs. Descriptive criteria for the rule system were developed for the analysis video-recorded continuous production of signs and gesture. It involves segmenting a stream of body movement into phases and identifying different phase types. Two human coders used the criteria to analyze signs and cospeech gestures that are produced in natural discourse. It was found that the criteria yielded good inter-coder reliability. These criteria can be used for the technology of automatic recognition of signs and co-speech gestures in order to segment continuous production and identify the potentially meaningbearing phase.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McNeill, D.: Hand and Mind. University of Chicago Press, Chicago (1992)

    Google Scholar 

  2. Kendon, A.: Some Relationships Between Body Motion and Speech. In: Siegman, A., Pope, B. (eds.): Studies in Dyadic Communication. Pergamon Press, New York (1972) 177–210

    Google Scholar 

  3. Kendon, A.: Gesticulation and speech: Two Aspects of the Process of Utterance. In: Key, M. R. (ed.): The Relation Between Verbal and Nonverbal Communication. Mouton, The Hague (1980) 207–227

    Google Scholar 

  4. Liddel, S.K., Johnson R.E.: American Sign Language — Compound Formation Processes, Lexicalization, and Phonological Remnants. Natural Language and Linguistic Theory. 4 (1986) 445–513

    Article  Google Scholar 

  5. Sandler, W.: The Spreading Hand Autosegment of American Sign Language. Sign Language Studies 50 (1986) 1–28

    Google Scholar 

  6. Perlmutter, D.M: Sonority and Syllable Structure in American Sign Language. Linguistic Inquiry 23 (1992) 407–442.

    Google Scholar 

  7. Birdwhistell, R. L: Kinesics and Context. University of Pennsylvania Press, Philadelphia (1970)

    Google Scholar 

  8. Calbris, G.: The Semiotics of French Gesture. Indiana University Press, Bloomington (1990)

    Google Scholar 

  9. Kendon, A.: Gestures as Illocutionary and Discourse Structure Markers in Southern Italian Conversation. Journal of Pragmatics (1995) 23 247–279

    Article  Google Scholar 

  10. Liddel, S.K.: THINK and BELIEVE: Sequentiality in American Sign Language. Language 60. 372–399 (1984)

    Article  Google Scholar 

  11. Liddel, S.K. Structure for Representing Hand Shape and Local Movement at the Phonemic Level. In: Fischer, S., Siple, P. (ed.): Theoretical Issues in Sign Language Research, Vol.1. University of Chicago Press, Chicago (1990) 37–65

    Google Scholar 

  12. Dell, C.: A Primer for Movement Description: Using Effort-Shape and Supplementary Concepts. Dance Notation Bureau, New York (1970)

    Google Scholar 

  13. Kita, S.: The Temporal Relationship between Gesture and Speech: A Study of Japanese-English Bilinguals. Master’s thesis, University of Chicago (1990)

    Google Scholar 

  14. de Ruiter, J.: Production of Gesture and Speech. unpublished Ph.D. dissertation, University of Nijmegen (1998)

    Google Scholar 

  15. McNeill, D.: A Straight Path — To Where? Reply to Butterworth and Hadar. Psychological Review. 96 (1989) 175–179.

    Article  Google Scholar 

  16. Duncan, S.: Grammatical Form and ‘Thinking-for-Speaking’ in Mandarin Chinese and English: An Analysis Based on Speech-accompanying Gesture. Unpublished Ph.D. dissertation, University of Chicago (1996)

    Google Scholar 

  17. McNeill, D., Levy, E.T., Pedelty, L.L.: Gesture and Speech. In: Hammond, G.R. (ed.): Advances in Psychology: Cerebral Control of Speech and Limb Movements. Elsevier/North Holland Publishers, Amsterdam (1992) 203–256

    Google Scholar 

  18. van der Hulst, H: On the Other Hand. Lingua. 98 (1996) 121–143

    Article  Google Scholar 

  19. van Gijn, I.: Vormkarakteristieken van Gestures en Gebaren [Form Characteristics of Signs and Gestures]. Master’s thesis, Leiden University (1997)

    Google Scholar 

  20. van Gijn, I., Kita, S., van der Hulst H.: Symmetry Condition in Sign Language Phonology and Gesture.(in preparation)

    Google Scholar 

  21. Brugman, H., Kita., S.: Impact of Digital Video Technology on Transcription: a Case of Spontaneous Gesture Transcription. KODIKAS/CODE: Ars Semeiotica 18 (1995) 95–112

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Max-Planck Institute for Psycholinguistics, PB 310, 6500, AH Nijmegen, The Netherlands

    Sotaro Kita

  2. Department of Dutch Language, Leiden University, The Netherlands

    Ingeborg van Gijn

  3. Leiden University, HIL / ATW, PB 9515, 2300, RA Leiden, The Netherlands

    Harry van der Hulst

Authors
  1. Sotaro Kita
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ingeborg van Gijn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Harry van der Hulst
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Ipke Wachsmuth Martin Fröhlich

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag

About this paper

Cite this paper

Kita, S., van Gijn, I., van der Hulst, H. (1998). Movement phases in signs and co-speech gestures, and their transcription by human coders. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052986

Download citation

  • DOI: https://doi.org/10.1007/BFb0052986

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64424-8

  • Online ISBN: 978-3-540-69782-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation