Ksenia Kolykhalova
ABSTRACT
In this paper we describe a serious games platfrom for validating sonification of human full-body movement qualities. This platform supports the design and development of serious games aiming at validating (i) our techniques to measure expressive movement qualities, and (ii) the mapping strategies to translate such qualities in the auditory domain, by means of interactive sonification and active music experience. The platform is a part of a more general framework developed in the context of the EU ICT H2020 DANCE "Dancing in the dark" Project n.645553 that aims at enabling the perception of nonverbal artistic whole-body experiences to visual impaired people.
- K. Bousmalis, L. Morency, and M. Pantic. Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition. In Automatic Face Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 746--752, 2011.Google Scholar
Cross Ref
- K. L. C. G. Castellano, G. Multimodal emotion recognition from expressive faces, body gestures and speech. In Doctoral Consortium of ACII, Lisbon, 2007.Google Scholar
- B. R. Dubus, G. A systematic review of mapping strategies for the sonification of physical quantities. Plos One, 8(12), 2013.Google Scholar
- K. Felix Navarro, E. Lawrence, J. Garcia Marin, and C. Sax. A dynamic and customisable layered serious game design framework for improving the physical and mental health of the aged and the infirm. In Conference on eHealth, Telemedicine, and Social Medicine. IARIA Conference, 2011.Google Scholar
- T. Hermann. Taxonomy and Definitions for Sonification and Auditory Display. In P. Susini and O. Warusfel, editors, Proceedings of the 14th International Conference on Auditory Display (ICAD 2008). IRCAM, 2008.Google Scholar
- H. Hung and D. Gatica-Perez. Estimating cohesion in small groups using audio-visual nonverbal behavior. Multimedia, IEEE Transactions on, 12(6):563--575, 2010. Google ScholarDigital Library
- G. Kramer. Auditory Display: Sonification, Audification, and Auditory Interfaces. Perseus Publishing, 1993. Google ScholarDigital Library
- D. Lakens and M. Stel. If they move in sync, they must feel in sync: Movement synchrony leads to attribution of rapport and entitativity. Social Congnition, 29 (1):1--14, 2011.Google ScholarCross Ref
- B. Mazzarino and M. Mancini. The need for impulsivity and smoothness improving hci by qualitatively measuring new high-level human motion features. International Conference on Signal Processing and Multimedia Applications, pages 62--67, 2009.Google Scholar
- R. Niewiadomski, M. Mancini, G. Volpe, and A. Camurri. Automated detection of impulsive movements in hci. In Proceedings of the 11th Biannual Conference on Italian SIGCHI Chapter, CHItaly 2015, pages 166--169, New York, NY, USA, 2015. ACM. Google ScholarDigital Library
- S. A. C. A. O. F. H. J. Piana, S. Adaptive body gesture representation for automatic emotion recognition. In Transactions on Interactive Intelligent System, 2015. Google ScholarDigital Library
- M. Rehm. Non-symbolic gestural interaction for aml. In D. R.-C. A. J. Aghajan, H., editor, Human-Centric: Interface for Ambient Intelligence, pages 327--345. ACM Press, Amsterdam, The Netherlands, 2010.Google Scholar
- G. Varni, A. Camurri, P. Coletta, and G. Volpe. Toward a real-time automated measure of empathy and dominance. In Computational Science and Engineering, 2009. CSE '09. International Conference on, volume 4, pages 843--848, 2009. Google ScholarDigital Library
Index Terms
- A serious games platform for validating sonification of human full-body movement qualities
Recommendations
Vocalizing dance movement for interactive sonification of laban effort factors
DIS '14: Proceedings of the 2014 conference on Designing interactive systemsWe investigate the use of interactive sound feedback for dance pedagogy based on the practice of vocalizing while moving. Our goal is to allow dancers to access a greater range of expressive movement qualities through vocalization. We propose a ...
Seeing, Sensing and Recognizing Laban Movement Qualities
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsHuman movement has historically been approached as a functional component of interaction within human computer interaction. Yet movement is not only functional, it is also highly expressive. In our research, we explore how movement expertise as ...
Seeing movement qualities
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWith the increased availability of movement based interactive devices there is a growing interest in exploring the potential design space for engaging movement-based interactions. This has led to the exploration of different ways to sense and model ...
Comments