Top

Published in:

2021 | OriginalPaper | Chapter

Distributed Scores and Audio on Mobile Devices in the Music for a Multidisciplinary Performance

Author : Pedro Louzeiro

Published in: Perception, Representations, Image, Sound, Music

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In an attempt to uncover the strengths and limitations of web technologies for sound and music notation applications, driven by aesthetic goals and prompted by the lack of logistic means, the author has developed a system for animated scores and sound diffusion using browser-enabled mobile devices, controlled by a host computer running Max and a web server. Ease of deployment was seen as a desirable feature in comparison to native application computer-based systems – such as Comprovisador, a system which has lent many features to the one proposed herein. Weaknesses were identified motivating the design of mitigation and adaptation strategies at the technical and the compositional levels, respectively. The creation of music for a multidisciplinary performance entitled GarB’urlesco has served as a case study to assess the effectiveness of those strategies. The present text is an extended version of a paper presented at CMMR 2019, in Marseille.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter COMPOSITES 1: An Exploration into Real-Time Animated Notation in the Web Browser

next chapter The BabelBox: An Embedded System for Score Distribution on Raspberry Pi with INScore, SmartVox and BabelScores

Both host and client applications of Comprovisador run in the Max environment [25] using the bach library [6, 12] and also Java.

Scalable Vector Graphics (SVG) is an Extensible Markup Language (XML)-based vector image format for two-dimensional graphics with support for interactivity and animation.

MaxScore is a music notation library for the Max environment [1].

UDP (User Datagram Protocol) is a communications protocol used primarily for establishing low-latency and loss-tolerating connections between network applications.

Paid solutions are not included in the scope of this research.

At the cmmr 2019 conference, we have learnt about the Guido Project [5], an open source project that encompasses a music notation format, a score rendering engine and various music score utilities. The Guido engine is a library that can be embedded on different platforms using different programming languages, among which JavaScript. We find both the music notation format and the score rendering engine to be adequate for the type of generative applications we envisage.

WebSocket is a computer communications protocol, providing full-duplex communication channels over a single TCP connection.

– in devices running older Android versions – see Sect. 4.

This concept aims at solving synchronisation problems in real-time music and media systems. The author describes four approaches to synchronisation in increasing levels of sophistication: Synchronisation Levels 0 through 3. Level 1 consists on applying time-stamps to events, computing the events in advance within a “control stage” and delivering the computed events with time-stamps to a “rendering stage”. There, events are delayed according to time-stamps in order to produce accurately timed output.

The bach library enables music notation and CAC tools inside the Max environment. Its most prominent objects are bach.score (for standard metric notation) and bach.roll (for proportional notation). Both objects are notation editors (meaning a user can interact with them via mouse and keyboard to create/modify the score) and score players (they can read back score data and drive a MIDI synth or similar). Moreover, they feature Max type inputs and outputs in order to be controlled by and/or to control other Max processes in real time [6].

For a standalone interactive example of the score in action, visit https://glitchscore.glitch.me/.

Trying to render graphics with the more precise Web Audio clock would result in a much lower frame rate. Synchronisation is nonetheless controlled by the Web Audio clock using the Tone.Draw.schedule() method of the tone.js library (see [3, 27]).

llll stands for Lisp Like Linked List.

Dual-tone multi-frequency (DTMF) signaling is a telecommunication signaling system using the voice-frequency band over telephone lines between telephone equipment and other communications devices and switching centers.

MaxScore. http://www.computermusicnotation.com/. hochschule für Musik und Theater Hamburg

p5.js. https://p5js.org. Processing Foundation

tone.js. https://tonejs.github.io

xebra.js (2018). https://cycling74.github.io/xebra.js/index.html. cycling74

The Guido project (2020). https://guidodoc.grame.fr/about/. grame-CNCM

Agostini, A., Ghisi, D.: A max library for musical notation and computer-aided composition. Comput. Music J. 39(2), 11–27 (2015). https://doi.org/10.1162/COMJ_a_00296

Bell, J.: Audiovisual scores and parts synchronized over the web. In: Bhagwati, S., Bresson, J. (eds.) Proceedings of the International Conference on Technologies for Music Notation and Representation - TENOR 2018. Concordia University, Montreal, Canada, pp. 17–23 (2018). https://www.tenor-conference.org/proceedings.html

Clément, A.R., Ribeiro, F., Rodrigues, R., Penha, R.: Bridging the gap between performers and the audience using networked smartphones: the a.bel system. In: Proceedings of the International Conference on Live Interfaces, Brighton (2016). http://users.sussex.ac.uk/~thm21/ICLI_proceedings/2016/Papers/Short_Papers/127_Abel.pdf

Dannenberg, R.B.: Time-flow concepts and architectures for music and media synchronization. In: Proceedings of the 43rd International Computer Music Conference, Shanghai, pp. 104–109 (2017). https://www.cs.cmu.edu/~rbd/papers/timeflow2017.pdf

10.

Freeman, J.: Flock (2007). http://distributedmusic.gatech.edu/flock/

11.

Freeman, J.: Extreme sight-reading, mediated expression, and audience participation: real-time music notation in live performance. Comput. Music J. 32(3), 25–41 (2008). http://www.jstor.org/stable/40072645

12.

Ghisi, D., Agostini, A.: Extending bach: a family of libraries for real-time computer-assisted composition in max. J. New Music Res. 46(1), 34–53 (2017). https://doi.org/10.1080/09298215.2016.1236823

13.

Gottfried, R., Hajdu, G.: Drawsocket: a browser based system for networked score display. In: Hope, C., Vickery, L., Grant, N. (eds.) Proceedings of the International Conference on Technologies for Music Notation and Representation - TENOR 2019. Monash University, Melbourne, Australia, pp. 15–25 (2019). https://www.tenor-conference.org/proceedings.html

14.

Hajdu, G., Gottfried, R.: Networked music performance in the old elbe tunnel. In: Hope, C., Vickery, L., Grant, N. (eds.) Proceedings of the International Conference on Technologies for Music Notation and Representation - TENOR 2019, Monash University, Melbourne, Australia, pp. 55–60 (2019). https://www.tenor-conference.org/proceedings.html

15.

Holovaty, A., Richardson, C., O’Riordan, E.: Soundslice (2019). https://www.soundslice.com

16.

Hope, C., Vickery, L., Wyatt, A., James, S.: The decibel scoreplayer - a digital tool for reading graphic notation. In: Battier, M., et al. (eds.) Proceedings of the First International Conference on Technologies for Music Notation and Representation - TENOR 2015, Paris, France, pp. 58–69 (2015). https://www.tenor-conference.org/proceedings.html

17.

Lee, C.: Multimedia performance installation with virtual reality. In: Proceedings of the 43rd International Computer Music Conference, Shanghai, pp. 347–350 (2017). http://www.icmc2017.com/en/download.html

18.

Louzeiro, P.: Mediating a comprovisation performance: the comprovisador’s control interface. In: Proceedings of the 43rd International Computer Music Conference, Shanghai, pp. 362–367 (2017). http://www.icmc2017.com/en/download.html

19.

Louzeiro, P.: Real-time compositional procedures for mediated soloist-ensemble interaction: the comprovisador. In: Agustín-Aquino, O.A., Lluis-Puebla, E., Montiel, M. (eds.) MCM 2017. LNCS (LNAI), vol. 10527, pp. 117–131. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-71827-9_10CrossRef

20.

Louzeiro, P.: The comprovisador’s real-time notation interface (extended version). In: Aramaki, M., Davies, M.E.P., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2017. LNCS, vol. 11265, pp. 489–508. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01692-0_33CrossRef

21.

Louzeiro, P.: Improving sight-reading skills through dynamic notation - the case of Comprovisador. In: Bhagwati, S., Bresson, J. (eds.) Proceedings of the International Conference on Technologies for Music Notation and Representation - TENOR 2018. Concordia University, Montreal, Canada, pp. 55–61 (2018). https://www.tenor-conference.org/proceedings.html

22.

Louzeiro, P.: Distributed scores and audio on mobile devices in the music for a multidisciplinary performance. In: Proceedings of the 14th International Symposium on Computer Music Multidisciplinary Research, Marseille, pp. 401–412 (2019). https://cmmr2019.prism.cnrs.fr/downloads.html

23.

Michon, R., Orlarey, Y., Letz, S., Fober, D., Dumitrascu, C.: Mobile music with the faust programming language. In: Proceedings of the 14th International Symposium on Computer Music Multidisciplinary Research, Marseille, pp. 371–382 (2019). https://cmmr2019.prism.cnrs.fr/downloads.html

24.

Picking, R.: Reading music from screens vs paper. Behaviour & Information Technology 16(2), 72–78 (1997). https://doi.org/10.1080/014492997119914

25.

Puckette, M., et al.: Max 7: documentation. https://docs.cycling74.com/max7/

26.

Shafer, S.: VizScore: an on-screen notation delivery system for live performance. In: Proceedings of the International Computer Music Conference, Denton, TX, pp. 142–145 (2015). http://hdl.handle.net/2027/spo.bbp2372.2015.027

27.

Wilson, C.: A tale of two clocks - scheduling web audio with precision (2013). https://www.html5rocks.com/en/tutorials/audio/scheduling/

28.

Zagorac, S., Alessandrini, P.: ZScore: a distributed system for integrated mixed music composition and performance. In: Bhagwati, S., Bresson, J. (eds.) Proceedings of the International Conference on Technologies for Music Notation and Representation - TENOR 2018, Concordia University, Montreal, Canada, pp. 62–70 (2018). https://www.tenor-conference.org/proceedings.html

Title: Distributed Scores and Audio on Mobile Devices in the Music for a Multidisciplinary Performance
Author: Pedro Louzeiro
Publisher: Springer International Publishing
Book: Perception, Representations, Image, Sound, Music
Print ISBN: 978-3-030-70209-0

Electronic ISBN: 978-3-030-70210-6

Copyright Year: 2021
DOI: https://doi.org/10.1007/978-3-030-70210-6_22

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"