Skip to main content
main-content

Tipp

Weitere Artikel dieser Ausgabe durch Wischen aufrufen

30.03.2020 | Original Paper | Ausgabe 2/2020 Open Access

Journal on Multimodal User Interfaces 2/2020

Movement sonification expectancy model: leveraging musical expectancy theory to create movement-altering sonifications

Zeitschrift:
Journal on Multimodal User Interfaces > Ausgabe 2/2020
Autoren:
Joseph Newbold, Nicolas E. Gold, Nadia Bianchi-Berthouze
Wichtige Hinweise

Electronic supplementary material

The online version of this article (https://​doi.​org/​10.​1007/​s12193-020-00322-2) contains supplementary material, which is available to authorized users.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Abstract

When designing movement sonifications, their effect on people’s movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people’s expectations of their movement is not well explained. This is especially important when considering musical sonifications, to which people bring their own associations and musical expectation, and which can, in turn, alter their perception of the sonification. This paper presents a Movement Expectation Sonification Model, based on theories of motor-feedback and expectation, to explore how musical sonification can impact the way people perceive their movement. Secondly, we present a study that validates the predictions of this model by exploring how harmonic stability within sonification interacts with contextual cues in the environment to impact movement behaviour and perceptions. We show how musical expectancy can be built to either reward or encourage movement, and how such an effect is mediated through the presence of additional cues. This model offers a way for sonification designers to create movement sonifications that not only inform movement but can be used to encourage progress and reward successes.

Unsere Produktempfehlungen

Premium-Abo der Gesellschaft für Informatik

Sie erhalten uneingeschränkten Vollzugriff auf alle acht Fachgebiete von Springer Professional und damit auf über 45.000 Fachbücher und ca. 300 Fachzeitschriften.

Zusatzmaterial
Supplementary material 1 (mp4 21646 KB)
Literatur
Über diesen Artikel

Weitere Artikel der Ausgabe 2/2020

Journal on Multimodal User Interfaces 2/2020 Zur Ausgabe

Premium Partner

    Bildnachweise