Adrian Hazzard
Chris Greenhalgh
Andrew McPherson
ABSTRACT
Failure is a common artefact of challenging experiences, a fact of life for interactive systems but also a resource for aesthetic and improvisational performance. We present a study of how three professional pianists performed an interactive piano composition that included playing hidden codes within the music so as to control their path through the piece and trigger system actions. We reveal how apparent failures to play the codes occurred for diverse reasons including mistakes in their playing, limitations of the system, but also deliberate failures as a way of controlling the system, and how these failures provoked aesthetic and improvised responses from the performers. We propose that creative and performative interfaces should be designed to enable aesthetic failures and introduce a taxonomy that compares human approaches to failure with approaches to capable systems, revealing new creative design strategies of gaming, taming, riding and serving the system.
Supplemental Material
- Ross J. Anderson. 2010. Security engineering: a guide to building dependable distributed systems. John Wiley & Sons. Google Scholar
Digital Library
- Steve Benford, Matt Adams, Nick Tandavanitj, Ju Row Farr, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, and Gabriella Giannachi. 2013. Performance-Led Research in the Wild. ACM Transactions on Computer-Human Interaction 20, 3: 1--22. Google ScholarDigital Library
- Steve Benford, Chris Greenhalgh, Adrian Hazzard, Alan Chamberlain, Maria Kallionpää, David M. Weigl, Kevin R. Page, and Mengdie Lin. 2018. Designing the audience journey through repeated experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 568. Google ScholarDigital Library
- S M Astrid Bin. The Show Must Go Wrong: Towards an understanding of audience perception of error in digital musical instrument performance. (Doctoral Dissertation, Queen Mary University of London). 368.Google Scholar
- Glenn A. Bowen. 2006. Grounded theory and sensitizing concepts. International journal of qualitative methods 5, 3: 12--23. https://doi.org/10/gcdvbtGoogle Scholar
- Jeffrey M. Bradshaw, Paul J. Feltovich, and Matthew Johnson. 2012. 13 Human--Agent Interaction. The Handbook of Human-Machine Interaction: A Human-Centered Design Approach.Google Scholar
- Gregor Broll and Steve Benford. 2005. Seamful design for locationbased mobile games. In International Conference on Entertainment Computing, 155--166. Google ScholarDigital Library
- Kim Cascone. 2000. The aesthetics of failure: "Post-digital" tendencies in contemporary computer music. Computer Music Journal 24, 4: 12--18. https://doi.org/10/bmb6ts Google ScholarDigital Library
- Matthew Chalmers, Ian MacColl, and Marek Bell. 2003. Seamful design: Showing the seams in wearable computing. https://doi.org/10/fjrdw4Google Scholar
- Cello Fortress - A game by Joost van Dongen. Retrieved January 3, 2019 from http://www.cellofortress.com/Google Scholar
- Arshia Cont, José Echeveste, Jean-Louis Giavitto, and Florent Jacquemard. 2012. Correct automatic accompaniment despite machine listening or human errors in Antescofo. In ICMC 2012International Computer Music Conference.Google Scholar
- Lowell Cross. 1999. Reunion: John Cage, Marcel Duchamp, Electronic Music and Chess. Leonardo Music Journal 9: 35--42. https://doi.org/10/cf3f2jGoogle ScholarCross Ref
- Anna Dickinson, John Arnott, and Suzanne Prior. 2007. Methods for human--computer interaction research with older people. Behaviour & Information Technology 26, 4: 343--352. https://doi.org/10/fwztwh Google ScholarDigital Library
- Guo Freeman and Donghee Yvette Wohn. 2017. eSports as an emerging research context at CHI: Diverse perspectives on definitions. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 1601--1608. Google ScholarDigital Library
- Anders Friberg. 2006. pDM: an expressive sequencer with real-time control of the KTH music-performance rules. Computer Music Journal 30, 1: 37--48. https://doi.org/10/d4krt9 Google ScholarDigital Library
- Kenneth H. Goodrich, Paul C. Schutte, Frank O. Flemisch, and Ralph A. Williams. 2006. Application of the H-mode, a design and interaction concept for highly automated vehicles, to aircraft. In 25th Digital Avionics Systems Conference, 2006 IEEE/AIAA, 1--13.Google Scholar
- Michael A. Goodrich and Alan C. Schultz. 2008. Human--robot interaction: a survey. Foundations and Trends® in Human--Computer Interaction 1, 3: 203--275. https://doi.org/10/b9k4td Google ScholarDigital Library
- Chris Greenhalgh, Steve Benford, Adrian Hazzard, and Alan Chamberlain. 2017. Playing fast and loose with music recognition. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 4302--4313. Google ScholarDigital Library
- Official Site of Guitar Hero. Retrieved January 3, 2019 from https://www.guitarhero.com/uk/en/Google Scholar
- Guy Hoffman and Gil Weinberg. 2011. Interactive improvisation with a robotic marimba player. Autonomous Robots 31, 2--3: 133-- 153. https://doi.org/10/d993sp Google ScholarDigital Library
- Stephen A. Hedges. 1978. Dice music in the eighteenth century. Music & Letters 59, 2: 180--187. https://doi.org/10/bgjcpkGoogle ScholarCross Ref
- Herbert H. Clark. 1996. Using language. 1996. Cambridge University Press: Cambridge 952: 274--296.Google ScholarCross Ref
- Kristina Höök and Jonas Löwgren. 2012. Strong concepts: Intermediate-level knowledge in interaction design research. ACM Transactions on Computer-Human Interaction (TOCHI) 19, 3: 23. https://doi.org/10/f225d4 Google ScholarDigital Library
- Ioanna Iacovides, Anna L. Cox, Patrick McAndrew, James Aczel, and Eileen Scanlon. 2015. Game-Play Breakdowns and Breakthroughs: Exploring the Relationship Between Action, Understanding, and Involvement. Human--Computer Interaction 30, 3--4: 202--231. https://doi.org/10/gfsmxz Google ScholarDigital Library
- Jesper Juul. 2013. The art of failure: An essay on the pain of playing video games. Mit Press. Google Scholar
- Maria Kallionpää. 2016. Performing the super instrument: reaching beyond technical and expressive capabilities. In Proceedings of the conference on Electronic Visualisation and the Arts, 28--33. Google ScholarDigital Library
- Maria Kallionpää and Hans-Peter Gasselseder. 2016. The imaginary friend: crossing over computer game scoring techniques and musical expression. In Proceedings of the conference on Electronic Visualisation and the Arts, 42--48. Google ScholarDigital Library
- Nina Keith and Michael Frese. 2008. Effectiveness of error management training: a meta-analysis. Journal of Applied Psychology 93, 1: 59. https://doi.org/10/fbksqfGoogle ScholarCross Ref
- Patrick Lin, Keith Abney, and George Bekey. 2011. Robot ethics: Mapping the issues for a mechanized world. Artificial Intelligence 175, 5--6: 942. https://doi.org/10/fxhj4b Google ScholarDigital Library
- Henry Lowood. 2008. High-performance play: The making of machinima. International Journal of Technology Management & Sustainable Development 7, 1: 25--42.Google Scholar
- Clemens Maidhof, Martina Rieger, Wolfgang Prinz, and Stefan Koelsch. 2009. Nobody is perfect: ERP effects prior to performance errors in musicians indicate fast monitoring processes. PLoS One 4, 4: e5032. https://doi.org/10/bj5stjGoogle ScholarCross Ref
- Elizabeth McNutt. 2003. Performing electroacoustic music: a wider view of interactivity. Organised Sound 8, 3: 297--304. https://doi.org/10/ddk46k Google ScholarDigital Library
- Imogene Newland. 2013. Embodying failure: Music performance, risk and authenticity. Somatechnics 3, 1: 98--118. https://doi.org/10/gd7d5vGoogle ScholarCross Ref
- Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 640. Google ScholarDigital Library
- Bruno H. Repp. 1996. The art of inaccuracy: Why pianists' errors are difficult to hear. Music Perception: An Interdisciplinary Journal 14, 2: 161--183. https://doi.org/10/gd7d5xGoogle ScholarCross Ref
- Jean-Claude Risset and Scott Van Duyne. 1996. Real-time performance interaction with a computer-controlled acoustic piano. Computer music journal 20, 1: 62--75. https://doi.org/10/d9bv5bGoogle Scholar
- William Ryan and Martin A Siegel. Evaluating Interactive Entertainment using Breakdown: Understanding Embodied Learning in Video Games. In DiGRA Conference. 2009. 9.Google Scholar
- Martina Angela Sasse, Sacha Brostoff, and Dirk Weirich. 2001. Transforming the "weakest link'-a human/computer interaction approach to usable and effective security. BT technology journal 19, 3: 122--131. https://doi.org/10/cj5hm4 Google ScholarDigital Library
- Amanda Sharkey and Noel Sharkey. 2012. Granny and the robots: ethical issues in robot care for the elderly. Ethics and information technology 14, 1: 27--40. https://doi.org/10/cdd62t Google ScholarDigital Library
- SingStar. Retrieved January 3, 2019 from https://www.singstar.com/home.htmlGoogle Scholar
- Plurality Spring by Paul Turowski and Simon Hutchinson. Retrieved January 3, 2019 from https://batta.itch.io/plurality-springGoogle Scholar
- Lucy A. Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press. Google ScholarDigital Library
- Yousician -- Your personal music teacher. Retrieved January 7, 2019 from https://yousician.com/Google Scholar
- Dieter Zapf, Michael Frese, Felix C. Brodbeck, C. Graf Hoyos, D. Frey, and D. Stahlberg. 1999. Fehler und Fehlermanagement. Arbeits-und Organisationspsychologie.Google Scholar
- John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems, 493--502. Google ScholarDigital Library
Index Terms
- Failing with Style: Designing for Aesthetic Failure in Interactive Performance
Recommendations
RhythmSynthesis: visual music instrument
C&C '11: Proceedings of the 8th ACM conference on Creativity and cognitionOriginating as an investigation into the relationships between rhythm and technology, RhythmSynthesis applies color, shape, and sound to demonstrate how our understanding of visual music, computation, and tangible, audio-visual interactions can be ...
^muzicode$: Composing and Performing Musical Codes
AM '16: Proceedings of the Audio Mostly 2016We present muzicodes, an approach to incorporating machine-readable 'codes' into music that allows the performer and/or composer to flexibly define what constitutes a code, and to perform around it. These codes can then act as triggers, for example to ...
_derivations: improvisation for tenor saxophone and interactive performance system
C&C '13: Proceedings of the 9th ACM Conference on Creativity & Cognition_derivations is an interactive performance system for use by a solo instrumentalist, and is designed to derive its sonic responses to improvisational input from the instrumentalist's live performance. Conceived of as an autonomous performance partner, ...
Comments