Skip to main content
Erschienen in: International Journal of Social Robotics 1/2018

13.10.2017

Music to Motion: Using Music Information to Create Expressive Robot Motion

verfasst von: Mathias Sunardi, Marek Perkowski

Erschienen in: International Journal of Social Robotics | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In a robot theater, developing high-quality motions for a humanoid robot requires significant time and effort. People with artistic and animation skills are required to create expressive gestures and movements on the robots. We observe that dancers can translate music into motions that are perceived as expressive by the audience. In this study, we developed a program to exploit melodic and dynamics information from music to create expressive robot motion. The program was used on two applications: producing motions strictly from the music information and controlling the execution a pre-programmed sequence of actions. Both applications are intended for a robot theater. The former was applied on an arm robot, while the latter on a humanoid KHR-1 robot. Two surveys were done to analyze the impact of our method. The results suggest that the robot motions produced by our program can be perceived as being more expressive and more dynamic than the motions created by a person or without music information.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The MIDI beat resolution used by MusE is 384 ticks per beat.
 
2
The KHR-1 robot has since been discontinued by its manufacturer. Information about the robot can still be found here: [28].
 
4
The whole music is played for the Mozart Sonata No. 16 because the channel used to generate the motion data does not sound good when played by itself—the main melody is constructed by the combination of multiple channels.
 
Literatur
1.
Zurück zum Zitat Amaya K, Bruderlin A, Calvert T (1996) Emotion from motion. In: Graphics interface, vol. 96. Toronto, Canada, pp 222–229 Amaya K, Bruderlin A, Calvert T (1996) Emotion from motion. In: Graphics interface, vol. 96. Toronto, Canada, pp 222–229
2.
Zurück zum Zitat Bhutada A (2011) Universal event and motion editor for robots’ theatre. Master’s thesis, Portland State University, 1900 SW Fourth Ave., Suite 160, Portland, OR 97201 Bhutada A (2011) Universal event and motion editor for robots’ theatre. Master’s thesis, Portland State University, 1900 SW Fourth Ave., Suite 160, Portland, OR 97201
3.
Zurück zum Zitat Breazeal C (1999) A context-dependent attention system for a social robot. In: 1999 International joint conference on artificial intelligence Breazeal C (1999) A context-dependent attention system for a social robot. In: 1999 International joint conference on artificial intelligence
4.
Zurück zum Zitat Bruderlin A, Williams L (1995) Motion signal processing. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, pp 97–104 Bruderlin A, Williams L (1995) Motion signal processing. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, pp 97–104
5.
Zurück zum Zitat Busso C, Deng Z, Neumann U, Narayanan S (2005) Natural head motion synthesis driven by acoustic prosodic features. Comput Anim Virtual Worlds 16(3–4):283–290CrossRef Busso C, Deng Z, Neumann U, Narayanan S (2005) Natural head motion synthesis driven by acoustic prosodic features. Comput Anim Virtual Worlds 16(3–4):283–290CrossRef
6.
Zurück zum Zitat Camurri A, Volpe G, Poli GD, Leman M (2005) Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimed 12(1):43–53CrossRef Camurri A, Volpe G, Poli GD, Leman M (2005) Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimed 12(1):43–53CrossRef
7.
Zurück zum Zitat Fernando R (2004) GPU gems: programming techniques. Tips and tricks for real-time graphics. Pearson Higher Education, Upper Saddle River Fernando R (2004) GPU gems: programming techniques. Tips and tricks for real-time graphics. Pearson Higher Education, Upper Saddle River
8.
Zurück zum Zitat Fisher RA (1925) Statistical methods for research workers. Genesis Publishing Pvt Ltd, New DelhiMATH Fisher RA (1925) Statistical methods for research workers. Genesis Publishing Pvt Ltd, New DelhiMATH
10.
Zurück zum Zitat Hollander M, Wolfe DA, Chicken E (2013) Nonparametric statistical methods. Wiley, HobokenMATH Hollander M, Wolfe DA, Chicken E (2013) Nonparametric statistical methods. Wiley, HobokenMATH
11.
Zurück zum Zitat Johnson R (2014) Choosing between parametric and non-parametric tests. J Undergrad Res Minn State Univ Mankato 9(1):6 Johnson R (2014) Choosing between parametric and non-parametric tests. J Undergrad Res Minn State Univ Mankato 9(1):6
12.
Zurück zum Zitat Lee D, Park S, Hahn M, Lee N (2014) Robot actors and authoring tools for live performance system. In: 2014 International conference on information science and applications (ICISA). IEEE, pp 1–3 Lee D, Park S, Hahn M, Lee N (2014) Robot actors and authoring tools for live performance system. In: 2014 International conference on information science and applications (ICISA). IEEE, pp 1–3
13.
Zurück zum Zitat Sergey L (2009) Body language animation synthesis from prosody. Undergraduate honors thesis, Stanford University Sergey L (2009) Body language animation synthesis from prosody. Undergraduate honors thesis, Stanford University
15.
Zurück zum Zitat McNeill D (1992) Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago McNeill D (1992) Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago
17.
Zurück zum Zitat Meek GE, Ozgur C, Dunning K (2007) Comparison of the t vs. wilcoxon signed-rank test for likert scale data and small samples. J Mod Appl Stat Methods 6(1):10CrossRef Meek GE, Ozgur C, Dunning K (2007) Comparison of the t vs. wilcoxon signed-rank test for likert scale data and small samples. J Mod Appl Stat Methods 6(1):10CrossRef
20.
Zurück zum Zitat Michalowski MP, Sabanovic S, Kozima H (2007) A dancing robot for rhythmic social interaction. In: 2007 2nd ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 89–96 Michalowski MP, Sabanovic S, Kozima H (2007) A dancing robot for rhythmic social interaction. In: 2007 2nd ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 89–96
24.
Zurück zum Zitat Perkowski M, Bhutada A, Lukac M, Sunardi M (2013) On synthesis and verification from event diagrams in a robot theatre application. In: 2013 IEEE 43rd international symposium on multiple-valued logic (ISMVL). IEEE, pp 77–83 Perkowski M, Bhutada A, Lukac M, Sunardi M (2013) On synthesis and verification from event diagrams in a robot theatre application. In: 2013 IEEE 43rd international symposium on multiple-valued logic (ISMVL). IEEE, pp 77–83
25.
Zurück zum Zitat Perkowski M, Sasao T, Kim JH, Lukac M, Allen J, Gebauer S (2005) Hahoe kaist robot theatre: learning rules of interactive robot behavior as a multiple-valued logic synthesis problem. In: 2005. Proceedings. 35th International symposium on multiple-valued logic. IEEE, pp 236–248 Perkowski M, Sasao T, Kim JH, Lukac M, Allen J, Gebauer S (2005) Hahoe kaist robot theatre: learning rules of interactive robot behavior as a multiple-valued logic synthesis problem. In: 2005. Proceedings. 35th International symposium on multiple-valued logic. IEEE, pp 236–248
26.
Zurück zum Zitat Perlin K (1985) An image synthesizer. ACM Siggraph Comput Graphics 19(3):287–296CrossRef Perlin K (1985) An image synthesizer. ACM Siggraph Comput Graphics 19(3):287–296CrossRef
27.
Zurück zum Zitat Pilhofer M, Day H (2015) Music theory for dummies. Wiley, Hoboken Pilhofer M, Day H (2015) Music theory for dummies. Wiley, Hoboken
29.
Zurück zum Zitat Sargin ME, Erzin E, Yemez Y, Tekalp AM, Erdem AT, Erdem C, Ozkan M (2007) Prosody-driven head-gesture animation. In: 2007 IEEE international conference on acoustics, speech and signal processing-ICASSP’07, vol 2. IEEE, pp II–677 Sargin ME, Erzin E, Yemez Y, Tekalp AM, Erdem AT, Erdem C, Ozkan M (2007) Prosody-driven head-gesture animation. In: 2007 IEEE international conference on acoustics, speech and signal processing-ICASSP’07, vol 2. IEEE, pp II–677
30.
Zurück zum Zitat Scheeff M, Pinto J, Rahardja K, Snibbe S, Tow R (2002) Experiences with sparky, a social robot. In: Socially intelligent agents. Springer US, pp 173–180 Scheeff M, Pinto J, Rahardja K, Snibbe S, Tow R (2002) Experiences with sparky, a social robot. In: Socially intelligent agents. Springer US, pp 173–180
31.
Zurück zum Zitat Scheffé H (1952) An analysis of variance for paired comparisons. J Am Stat Assoc 47(259):381–400MathSciNetMATH Scheffé H (1952) An analysis of variance for paired comparisons. J Am Stat Assoc 47(259):381–400MathSciNetMATH
32.
Zurück zum Zitat Stanislavski C (2013) Building a character. A & C Black, London Stanislavski C (2013) Building a character. A & C Black, London
33.
Zurück zum Zitat Sunardi MI (2010) Expressive motion synthesis for robot actors in robot theatre. Master’s thesis, Portland State University, 1900 SW Fourth Ave., Suite 160, Portland, OR 97201 Sunardi MI (2010) Expressive motion synthesis for robot actors in robot theatre. Master’s thesis, Portland State University, 1900 SW Fourth Ave., Suite 160, Portland, OR 97201
34.
Zurück zum Zitat Thomas F, Johnston O, Thomas F (1995) The illusion of life: disney animation. Hyperion New York, New York Thomas F, Johnston O, Thomas F (1995) The illusion of life: disney animation. Hyperion New York, New York
35.
Zurück zum Zitat Unuma M, Anjyo K, Takeuchi R (1995) Fourier principles for emotion-based human figure animation. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, pp 91–96 Unuma M, Anjyo K, Takeuchi R (1995) Fourier principles for emotion-based human figure animation. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, pp 91–96
36.
Zurück zum Zitat Von Laban R, Lange R (1975) Laban’s principles of dance and movement notation. Princeton Book Co Pub, Princeton Von Laban R, Lange R (1975) Laban’s principles of dance and movement notation. Princeton Book Co Pub, Princeton
Metadaten
Titel
Music to Motion: Using Music Information to Create Expressive Robot Motion
verfasst von
Mathias Sunardi
Marek Perkowski
Publikationsdatum
13.10.2017
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 1/2018
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-017-0432-9

Weitere Artikel der Ausgabe 1/2018

International Journal of Social Robotics 1/2018 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.