Skip to main content

2019 | OriginalPaper | Buchkapitel

Robot Computing for Music Visualization

verfasst von : Pei-Chun Lin, David Mettrick, Patrick C. K. Hung, Farkhund Iqbal

Erschienen in: Theory and Applications of Models of Computation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents an algorithm design of Music Visualization on Robot (MVR) which could automatically link the flashlight, color, and emotion through music. We call this algorithm as MVR algorithm that composed by two analyses. First, we focus on Music Signal Analysis. Second, we focus on Music Sentiment Analysis. We integrate two analysis results and implement the MVR algorithm on a robot called Zenbo which is released from ASUS Company. We perform the Zenbo Robot in luminous environments. The MVR system not only could be used in Zenbo robot but also could extend to other fields of Artificial Intelligent (AI) equipment in the future.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat MilkDrop 1.04 for Windows 2000/NT/ME/98/95. Shareware Music Machine. Hitsquad Pty Ltd. Accessed 11 Oct 2010 MilkDrop 1.04 for Windows 2000/NT/ME/98/95. Shareware Music Machine. Hitsquad Pty Ltd. Accessed 11 Oct 2010
2.
Zurück zum Zitat MilkDrop Version History Archived 23 May 2007 at the Wayback Machine MilkDrop Version History Archived 23 May 2007 at the Wayback Machine
3.
Zurück zum Zitat MilkDrop preset authoring guide Archived 7 June 2007 at the Wayback Machine MilkDrop preset authoring guide Archived 7 June 2007 at the Wayback Machine
4.
Zurück zum Zitat Muller, M., Ellis, D.P.W., Klapuri, A., Richard, G.: Signal processing for music analysis. IEEE J. Sel. Top. Signal Process. 5(6), 1088–1110 (2011)CrossRef Muller, M., Ellis, D.P.W., Klapuri, A., Richard, G.: Signal processing for music analysis. IEEE J. Sel. Top. Signal Process. 5(6), 1088–1110 (2011)CrossRef
5.
Zurück zum Zitat McFee, B., et al.: Librosa: audio and music signal analysis in python. In: Proceedings of the 14th Python in Science Conference, SCIPY 2015, pp. 18–25 (2015) McFee, B., et al.: Librosa: audio and music signal analysis in python. In: Proceedings of the 14th Python in Science Conference, SCIPY 2015, pp. 18–25 (2015)
7.
Zurück zum Zitat Shukla, S., Khanna, P., Agrawal, K.K.: 2017 International Conference on Infocom Technologies and Unmanned Systems (Trends and Future Directions) (ICTUS), December 2017 Shukla, S., Khanna, P., Agrawal, K.K.: 2017 International Conference on Infocom Technologies and Unmanned Systems (Trends and Future Directions) (ICTUS), December 2017
8.
Zurück zum Zitat Jamdar, A., Abraham, J., Khanna, K., Dubey, R.: Emotion analysis of songs based on lyrical and audio features. Int. J. Artif. Intell. Appl. (IJAIA) 6(3), 35–50 (2015) Jamdar, A., Abraham, J., Khanna, K., Dubey, R.: Emotion analysis of songs based on lyrical and audio features. Int. J. Artif. Intell. Appl. (IJAIA) 6(3), 35–50 (2015)
9.
Zurück zum Zitat Abboud, R., Tekli, J.: MUSE prototype for music sentiment expression. In: 2018 IEEE International Conference on Cognitive Computing, San Francisco, USA, 2–7 July 2018, pp. 106–109 (2018) Abboud, R., Tekli, J.: MUSE prototype for music sentiment expression. In: 2018 IEEE International Conference on Cognitive Computing, San Francisco, USA, 2–7 July 2018, pp. 106–109 (2018)
10.
Zurück zum Zitat Wang, Q., Hai, Y., Shao, X., Gong, R.: Investigation on factors to influence color emotions and color preference responses. Optik 136, 71–78 (2017)CrossRef Wang, Q., Hai, Y., Shao, X., Gong, R.: Investigation on factors to influence color emotions and color preference responses. Optik 136, 71–78 (2017)CrossRef
11.
Zurück zum Zitat Kawabata, Y., Takahashi, F.: The association between colors and emotions for emotional words and facial expression. Wiley (2017) Kawabata, Y., Takahashi, F.: The association between colors and emotions for emotional words and facial expression. Wiley (2017)
12.
Zurück zum Zitat Kim, M., Lee, H.S., Park, J.W., Jo, S.H., Chung, M.J.: Determining color and blinking to support facial expression of robot for conveying emotional intensity. In: IEEE International Symposium on Robot and Human Interactive Communication, Technische Universität München, Munich (2008) Kim, M., Lee, H.S., Park, J.W., Jo, S.H., Chung, M.J.: Determining color and blinking to support facial expression of robot for conveying emotional intensity. In: IEEE International Symposium on Robot and Human Interactive Communication, Technische Universität München, Munich (2008)
13.
Zurück zum Zitat Terada, K., Yamauchi, A., Ito, A.: Artificial emotion expression for a robot by dynamic color change. In: The 21st IEEE International Symposium on IEEE RO-MAN, Paris (2012) Terada, K., Yamauchi, A., Ito, A.: Artificial emotion expression for a robot by dynamic color change. In: The 21st IEEE International Symposium on IEEE RO-MAN, Paris (2012)
14.
Zurück zum Zitat Lin, P.-C., Mettrick, D., Hung, P.C.K., Iqbal, F.: IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) 2018, Taichung, Taiwan, 10–12 December 2018 (2018) Lin, P.-C., Mettrick, D., Hung, P.C.K., Iqbal, F.: IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) 2018, Taichung, Taiwan, 10–12 December 2018 (2018)
17.
Zurück zum Zitat Böck, S., Krebs, F., Schedl, M.: Evaluating the online capabilities of onset detection methods. In: 11th International Society for Music Information Retrieval Conference (ISMIR 2012), pp. 49–54 (2012) Böck, S., Krebs, F., Schedl, M.: Evaluating the online capabilities of onset detection methods. In: 11th International Society for Music Information Retrieval Conference (ISMIR 2012), pp. 49–54 (2012)
18.
Zurück zum Zitat Ellis, D.P.W.: Beat tracking by dynamic programming. J. New Music Res. 36(1), 51–60 (2007)CrossRef Ellis, D.P.W.: Beat tracking by dynamic programming. J. New Music Res. 36(1), 51–60 (2007)CrossRef
20.
Zurück zum Zitat Song, S., Yamada, S.: Exploring mediation effect of mental alertness for expressive lights. In: HAI 2017, Bielefeld, Germany, 17–20 October 2017 (2017) Song, S., Yamada, S.: Exploring mediation effect of mental alertness for expressive lights. In: HAI 2017, Bielefeld, Germany, 17–20 October 2017 (2017)
21.
Zurück zum Zitat Rubin, S., Agrawala, M.: Generating emotionally relevant musical scores for audio stories. In: UIST 2014, Honolulu, HI, USA, 5–8 October 2014 (2014) Rubin, S., Agrawala, M.: Generating emotionally relevant musical scores for audio stories. In: UIST 2014, Honolulu, HI, USA, 5–8 October 2014 (2014)
22.
Zurück zum Zitat Palmer, S.E., Schloss, K.B., Xu, Z., Prado-León, L.R.: Music-color associations are mediated by emotion. PNAS 110(22), 8836–8841 (2013)CrossRef Palmer, S.E., Schloss, K.B., Xu, Z., Prado-León, L.R.: Music-color associations are mediated by emotion. PNAS 110(22), 8836–8841 (2013)CrossRef
Metadaten
Titel
Robot Computing for Music Visualization
verfasst von
Pei-Chun Lin
David Mettrick
Patrick C. K. Hung
Farkhund Iqbal
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-14812-6_27

Premium Partner