Abstract
Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands We present a coding system combined with an annotation tool for the analysis of gestural behavior. The NEUROGES coding system consists of three modules that progress from gesture kinetics to gesture function. Grounded on empirical neuropsychological and psychological studies, the theoretical assumption behind NEUROGES is that its main kinetic and functional movement categories are differentially associated with specific cognitive, emotional, and interactive functions. ELAN is a free, multimodal annotation tool for digital audio and video media. It supports multileveled transcription and complies with such standards as XML and Unicode. ELAN allows gesture categories to be stored with associated vocabularies that are reusable by means of template files. The combination of the NEUROGES coding system and the annotation tool ELAN creates an effective tool for empirical research on gestural behavior.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barroso, F., Freedman, N., Grand, S., & Van Meel, J. (1978). Evocation of two types of hand movements in information processing. Journal of Experimental Psychology: Human Perception & Performance, 4, 321–329.
Blonder, L. X., Burns, A. F., Bowers, D., Moore, R. W., & Heilman, K. M. (1995). Spontaneous gestures following right hemisphere infarct. Neuropsychologia, 33, 203–213.
Brugman, H., & Russel, A. (2004). Annotating multimedia/multimodal resources with ELAN. In M. T. Lino, M. F. Xavier, F. Ferreira, R. Costa, & R. Silva (Eds.), Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004) (pp. 2065–2068). Paris: European Language Resources Association.
Dalby, J. T., Gibson, D., & Grossi, V. (1980). Lateralized hand gesture during speech. Journal of Motor Behavior, 12, 292–297.
Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1, 49–98.
Fernández-Carriba, S., Loeches, A., Morcillo, A., & Hopkins, W. D. (2002). Asymmetry in facial expression of emotions by chimpanzees. Neuropsychologia, 40, 1523–1533.
Freedman, N. (1972). The analysis of movement behavior during the clinical interview. In A. W. Siegman & B. Pope (Eds.) Studies in dyadic communication (pp. 153–175). New York: Pergamon.
Freedman, N., & Bucci, W. (1981). On kinetic filtering in associative monologue. Semiotica, 34, 225–249.
Freedman, N., & Hoffman, S. P. (1967). Kinetic behavior in altered clinical states: Approach to objective analysis of motor behavior during clinical interviews. Perceptual & Motor Skills, 24, 527–539.
Freedman, N., O’Hanlon, J., Oltman, P., & Witkin, H. A. (1972). The imprint of psychological differentiation on kinetic behavior in varying communicative contexts. Journal of Abnormal Psychology, 79, 239–258.
Gainotti, G. (1999). Neuropsychology of emotions. In G. Denes & L. Pizzamiglio (Eds.), Handbook of clinical and experimental neuropsychology (pp. 613–633). Hove, U.K.: Psychology Press.
Hampson, E., & Kimura, D. (1984). Hand movement asymmetries during verbal and nonverbal tasks. Canadian Journal of Psychology, 38, 102–125.
Joraschky, P. (1983). Das Körperschema und das Körper-Selbst als Regulationsprinzipien der Organismus-Umwelt-Interaktion. München: Minerva.
Kimura, D. (1973a). Manual activity during speaking: I. Right-handers. Neuropsychologia, 11, 45–50.
Kimura, D. (1973b). Manual activity during speaking: II. Left-handers. Neuropsychologia, 11, 51–55.
Krout, M. H. (1935). Autistic gestures: An experimental study in symbolic movement. Psychological Monographs, 46(Whole No. 208).
Laban, R. von (1950). The mastery of movement on the stage. London: Macdonald & Evans.
Laban, R. von (1988). The mastery of movement (4th rev. ed.). Plymouth, U.K.: Northcote House.
Lausberg, H. (1995, March). Bewegungsverhalten als Prozessparameter in einer kontrollierten Studie mit funktioneller Entspannung. Paper presented at the 42. Arbeitstagung des Deutschen Kollegiums für Psychosomatische Medizin, Jena, Germany.
Lausberg, H., Cruz, R. F., Kita, S., Zaidel, E., & Ptito, A. (2003). Pantomime to visual presentation of objects: Left hand dyspraxia in patients with complete callosotomy. Brain, 126, 343–360.
Lausberg, H., Heekeren, H., Kazzer, P., & Wartenburger, I. (2009). Differential cortical mechanisms underlying pantomimed tool use and demonstrations with tool in hand. Manuscript submitted for publication.
Lavergne, J., & Kimura, D. (1987). Hand movement asymmetry during speech: No effect of speaking topic. Neuropsychologia, 25, 689–693.
Lott, P. (1999). Gesture and aphasia. Bern: Peter Lang.
Morris, D. (1978). Der Mensch mit dem wir leben: Ein Handbuch unseres Verhaltens. München: Knaur.
Moscovitch, M., & Olds, J. (1982). Asymmetries in spontaneous facial expressions and their possible relation to hemispheric specialization. Neuropsychologia, 20, 71–81.
Rohlfing, K., Loehr, D., Duncan, S., Brown, A., Franklin, A., Kimbara, I., et al. (2006). Comparison of multimodal annotation tools—Workshop report. Gesprächsforschung: Online-Zeitschrift zur verbalen Interaktion, 7, 99–123.
Sainsbury, P. (1954). A method of measuring spontaneous movements by time-sampling motion pictures. Journal of Mental Science, 100, 742–748.
Sassenberg, U., Foth, M., Wartenburger, I., & van der Meer, E. (2009). Show your hands—are you really clever? Reasoning, gesture production, and intelligence. Manuscript submitted for publication.
Schmidt, T., Duncan S., Ehmer, O., Hoyt, J., Kipp, M., Loehr, D., et al. (2008). An exchange format for multimodal annotations. In N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odjik, S. Piperidis, & D. Tapias (Eds.), Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC-08). Paris: European Language Resources Association. Available at www.lrec-conf.org/proceedings/lrec2008/.
Sousa-Poza, J. F., & Rohrberg, R. (1977). Body movement in relation to type of information (person- and nonperson-oriented) and cognitive style (field dependence). Human Communication Research, 4, 19–29.
Trevarthen, C. (1996). Lateral asymmetries in infancy: Implications for the development of the hemispheres. Neuroscience & Biobehavioral Reviews, 20, 571–586.
Ulrich, G. (1977). Untersuchungsinstrumente: Videoanalytische Methoden zur Erfassung averbaler Verhaltensparameter bei depressiven Symptomen. Pharmakopsychiatrie, 10, 176–182.
Ulrich, G., & Harms, K. (1985). A video analysis of the non-verbal behaviour of depressed patients before and after treatment. Journal of Affective Disorders, 9, 63–67.
Verfaellie, M., Bowers, D., & Heilman, K. M. (1988). Hemispheric asymmetries in mediating intention, but not selective attention. Neuropsychologia, 26, 521–531.
Wallbott, H. G. (1989). Movement quality changes in psychopathological disorders. In B. Kirkcaldy (Ed.), Normalities and abnormalities in human movement (pp. 128–146). Basel: Karger.
Wallis, J. (2004, March). Baboon muzzle wiping: Possibly an ancient gesture of internal conflict. Paper presented at the Gestural Communication in Nonhuman and Human Primates Workshop, Max Planck Institute for Evolutionary Anthropology, Leipzig.
Witkin, H. A., Lewis, H. B., Hertzman, M., Machover, K., Bretnall Meissner, P., & Wapner, S. (1954). Personality through perception, an experimental and clinical study. New York: Harper.
Author information
Authors and Affiliations
Corresponding author
Additional information
The development of the NEUROGES coding system was supported by German Research Foundation (DFG) Grant LA 1249/1–3.
Rights and permissions
About this article
Cite this article
Lausberg, H., Sloetjes, H. Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods 41, 841–849 (2009). https://doi.org/10.3758/BRM.41.3.841
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BRM.41.3.841