Sarah Fdili Alaoui
Jules Françoise
ABSTRACT
Human movement has historically been approached as a functional component of interaction within human computer interaction. Yet movement is not only functional, it is also highly expressive. In our research, we explore how movement expertise as articulated in Laban Movement Analysis (LMA) can contribute to the design of computational models of movement's expressive qualities as defined in the framework of Laban Efforts. We include experts in LMA in our design process, in order to select a set of suitable multimodal sensors as well as to compute features that closely correlate to the definitions of Efforts in LMA. Evaluation of our model shows that multimodal data combining positional, dynamic and physiological information allows for a better characterization of Laban Efforts. We conclude with implications for design that illustrate how our methodology and our approach to multimodal capture and recognition of Effort qualities can be integrated to design interactive applications.
Supplemental Material
- Irmgard Bartenieff. 1970. Four Adaptations of Effort Theory in Research and Teaching. Gordon and Breach Science, NY, USA.Google Scholar
- Frédéric Bevilacqua, Bruno Zamborlin, Antony Sypniewski, Norbert Schnell, Fabrice Guédy, and Nicolas Rasamimanana. 2010. Continuous realtime gesture following and recognition. In Embodied Communication and Human-Computer Interaction, volume 5934 of Lecture Notes in Computer Science. Springer, 73--84. Google ScholarDigital Library
- andreas Scharader Borge Kordts, Bashar Altakrouri. 2015. Capturing and Analysing Movement Using Depth Sensors and Labanotation. In ACM SIGGRAPH Symposium on Engineering Interactive Computing Systems.Google Scholar
- Durell Bouchard and Norman Badler. 2007. Semantic segmentation of motion capture using laban movement analysis. In Intelligent Virtual Agents. Springer, 37--44. Google ScholarDigital Library
- Mary C. Broughton and Catherine J. Stevens. 2012. Analyzing Expressive Qualities in Movement and Stillness: Effort-Shape Analyses of Solo Marimbists' Bodily Expression. (2012).Google Scholar
- Antonnio Camurri, Barbara Mazzarino, Matteo Ricchetti, Renee Timmers, and Gualtierro Volpe. 2004. Multimodal analysis of expressive gesture in music and dance performances. In Gesture-based communication in human-computer interaction volume 2915 of Lecture Notes in Artificial Intelligence. Springer, 357--358. Google ScholarCross Ref
- Diane Chi, Monica Costa, Liwei Zhao, and Norman Badler. 2000. The EMOTE model for effort and shape. In In Proceedings of ACM SIGGRAPH. ACM, 173--182. Google ScholarDigital Library
- Martha Davis. 1987. Steps to achieving observer agreement: the LIMS reliability project. Movement Studies (NY: Laban / Bartenieff Institute) 2 (1987), 7--19.Google Scholar
- Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. The MIT Press.Google Scholar
- Daniel Fallman. 2011. The new good: exploring the potential of philosophy of technology to contribute to human-computer interaction. In Proceedings of the 2011 CHI Conference on Human Factors in Computing Systems (CHI'11). ACM, 1051--1060. Google ScholarDigital Library
- Sarah Fdili Alaoui, Frederic Bevilacqua, Bertha Bermudez, and Christian Jacquemin. 2013. Dance Interaction with physical model visualization based on movement qualities. International Journal of Arts and Technology, IJART (2013), 0--12.Google Scholar
- Sarah Fdili Alaoui, Baptiste Caramiaux, Marcos Serrano, and Frédéric Bevilacqua. 2012. Movement qualities as interaction modality. In Proceedings of the ACM SIGCHI Conference on Designing Interactive Systems (DIS'12). ACM Press, Newcastle, UK, 761--769. Google ScholarDigital Library
- Sarah Fdili Alaoui, Kristin Carlson, Shannon Cuykendall, , Karen Studd, Karen Bradley, and Thecla Schiphorst. 2015a. How Do Experts Observe Movement. In Proceedings of the International Workshop on Movement and Computing. Vancouver, BC, Canada. Google ScholarDigital Library
- Sarah Fdili Alaoui, Thecla Schiphorst, Shannon Cuykendall, Kristin Carlson, Karen Studd, and Karen Bradley. 2015b. Strategies for Embodied Design: The Value and Challenges of Observing Movement. In Proceedings of ACM Creativity and Cognition (CC '15). ACM, Glasgow, Scotland, UK, 121--130.Google Scholar
- Jules Françoise, Baptiste Caramiaux, and Frédéric Bevilacqua. 2012. A Hierarchical Approach for the Design of Gesture-to-Sound Mappings. In Proceedings of SMC conference. 233--240.Google Scholar
- Jules Françoise, Sarah Fdili Alaoui, Thecla Schiphorst, and Frédéric Bevilacqua. 2014. Vocalizing Dance Movement for Interactive Sonification of Laban Effort Factors. In Proceedings of the ACM SIGCHI Conference on Designing Interactive Systems (DIS '14). ACM, Vancouver, Canada, 1079--1082. Google ScholarDigital Library
- Marco Gillies, Rebecca Fiebrink, Atau Tanaka, Jérémie Garcia, Frederic Bevilacqua, Alexis Heloir, Fabrizio Nunnari, Wendy Mackay, Saleema Amershi, Bongshin Lee, Nicolas d'Alessandro, Joëlle Tilmanne, Todd Kulesza, and Baptiste Caramiaux. 2016. Human-Centred Machine Learning. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI'16). ACM, 3558--3565. Google ScholarDigital Library
- Kristina Höök, Martin P Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, San Jose, CA, USA, 3131--3142. Google ScholarDigital Library
- Caroline Hummels, Kees C. J. Overbeeke, and Sietske Klooster. 2007. Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction. Personal and Ubiquitous Computing 11, 8 (oct 2007), 677--690. Google ScholarDigital Library
- David Kirsh. 2013. Embodied cognition and the magical future of interaction design. ACM Transaction on Computer Human Interaction 20, 1 (2013), 1--30. Google ScholarDigital Library
- Rudolf Laban and F. C Lawrence. 1974. Effort Economy of Human Movement. Princeton Book.Google Scholar
- Rudolf Laban and Lisa Ullmann. 1963. Modern educational dance. MacDonald and Evans.Google Scholar
- Amy LaViers and Magnus Egerstedt. 2012. Style based robotic motion. American Control Conference (ACC) (2012).Google ScholarCross Ref
- Wonjun Lee and Richard Shusterman. 2014. Practicing Somaesthetics : Exploring Its Impact on Interactive Product Design Ideation. In Proceedings of the ACM SIGCHI Conference on Designing Interactive Systems (DIS '14). ACM, Vancouver, Canada, 1055--1064. Google ScholarDigital Library
- JA Levy and MP Duke. 2003. Laban Movement Analysis in the study of personality, emotional state and movement style: An exploratory investigation of the veridicality of body language. Individual Differences Research 1, 1 (2003), 39.Google Scholar
- Lian Loke and George Poonkhin Khut. 2011. Surging Verticality : An Experience of Balance. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction (TEI'11). ACM, 237--240.Google ScholarDigital Library
- Lian Loke and Toni Robertson. 2013. Moving and making strange: An embodied approach to movement-based interaction design. Transaction on Computer Human Interaction 20, 1 (2013).Google Scholar
- Tino Lourens, Roos van Berkel, and Emilia Barakova. 2010. Communicating emotions and mental states to robots in a real time parallel framework using Laban movement analysis. Robotics and Autonomous Systems 58, 12 (2010), 1256--1265. Google ScholarDigital Library
- Diego Silang Maranan, Sarah Fdili Alaoui, Thecla Schiphorst, Philippe Pasquier, and Lyn Bartram. 2014. Designing For Movement : Evaluating Computational Models using LMA Effort Qualities. In Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems (CHI'14). ACM, Toronto, Canada.Google Scholar
- Elena Márquez Segura, Laia Turmo Vidal, Asreen Rostami, and Annika Waern. 2016. Embodied Sketching. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, San Jose, CA, USA, 6014--6027. Google ScholarDigital Library
- M. Masuda, S. Kato, and H. Itoh. 2009. Emotion detection from body motion of human form robot based on laban movement analysis. Springer. 322--334 pages. Google ScholarDigital Library
- Helena Mentis and Carolina Johansson. 2013. Seeing Movement Qualities. In Proceedings of the 2013 CHI Conference on Human Factors in Computing Systems (CHI'13). ACM, Paris, France, 3375--3384. Google ScholarDigital Library
- M Merleau-Ponty. 1945. Phenomenology of Perception. Editions Gallimard.Google Scholar
- Jin Moen. 2007. From hand-held to body-worn: embodied experiences of the design and use of a wearable movement-based interaction concept. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction (TEI'07). ACM, 251--258.Google ScholarDigital Library
- Marianne Graves Petersen, Ole Sejer Iversen, Peter Gall Krogh, and Martin Ludvigsen. 2004. Aesthetic Interaction: A Pragmatist's Aesthetics of Interactive Systems. In Proceedings of the ACM SIGCHI Conference on Designing Interactive Systems (DIS '04). ACM, Cambridge, MA, USA, 269--276. Google ScholarDigital Library
- Mary Pietrowicz, Guy Garnett, Robert McGrath, and John Toenjes. 2010. Multimodal Gestural Interaction in Performance. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, 1--8.Google Scholar
- Nicolas Rasamimanana, Frédéric Bevilacqua, Norbert Schnell, Emmanuel Fléty, and Bruno Zamborlin. 2011. Modular Musical Objects Towards Embodied Control Of Digital Music Real Time Musical Interactions. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, 9--12.Google ScholarDigital Library
- TD Sanger. 2007. Bayesian filtering of myoelectric signals. Journal of neurophysiology (2007), 1839--1845.Google Scholar
- Thecla Schiphorst. 2011. Self-evidence: Applying Somatic Connoisseurship to Experience Design. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, Vancouver, BC, Canada, 145--160. Google ScholarDigital Library
- Norbert Schnell, Axel Röbel, Diemo Schwarz, Geoffroy Peeters, and Riccardo Borghesi. 2009. Mubu & friends assembling tools for content based real-time interactive audio processing in max/msp. In Proceedings of International Computer Music Conference. Montreal.Google Scholar
- Richard Shusterman. 2012. Thinking through the body: Essays in somaesthetics. Cambridge University Press. Google ScholarCross Ref
- Karen A Studd and Laura L Cox. 2013. Everybody is a body. Dog Ear Publishing.Google Scholar
- Gualtierro Volpe. 2003. Computational models of expressive gesture in Computational models of expressive gesture in multimedia systems. Ph.D. Dissertation. InfoMus Lab, Genova.Google Scholar
- Danielle Wilde, Thecla Schiphorst, and Sietske Klooster. 2011. Move to Design/Design to Move: A Conversation About Designing for the Body. interactions 18, 4 (jul 2011), 22--27.Google ScholarDigital Library
- Margaret Wilson. 2009. Dance pedagogy case studies: A grounded theory approach to analyzing qualitative data. Research in Dance Education 10, 1 (2009), 3--16. Google ScholarCross Ref
- Liwei Zhao and Norman Badler. 2005. Acquiring and validating motion qualities from live limb gestures. Graphical Models journal 67, 1 (2005), 1--16.Google ScholarDigital Library
Index Terms
- Seeing, Sensing and Recognizing Laban Movement Qualities
Recommendations
Vocalizing dance movement for interactive sonification of laban effort factors
DIS '14: Proceedings of the 2014 conference on Designing interactive systemsWe investigate the use of interactive sound feedback for dance pedagogy based on the practice of vocalizing while moving. Our goal is to allow dancers to access a greater range of expressive movement qualities through vocalization. We propose a ...
Designing for movement: evaluating computational models using LMA effort qualities
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWhile single-accelerometers are a common consumer embedded sensors, their use in representing movement data as an intelligent resource remains scarce. Accelerometers have been used in movement recognition systems, but rarely to assess expressive ...
Seeing movement qualities
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWith the increased availability of movement based interactive devices there is a growing interest in exploring the potential design space for engaging movement-based interactions. This has led to the exploration of different ways to sense and model ...
Comments