Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Automatic Recognition of Sound Categories from Their Vocal Imitation Using Audio Primitives Automatically Found by SI-PLCA and HMM Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction

Authors : Edward Jangwon Lee, Sangeon Yong, Soonbeom Choi, Liwei Chan, Roshan Peiris, Juhan Nam

Published in: Music Technology with Swing

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The musical possibilities of force sensors on touchscreen devices are explored, using Apple’s 3D Touch. Three functions are selected to be controlled by force: (a) excitation, (b) modification (aftertouch), and (c) mode change. Excitation starts a note, modification alters a playing note, and mode change controls binary on/off sound parameters. Four instruments are designed using different combinations of force-sound mapping strategies. ForceKlick is a single button instrument that plays consecutive notes within one touch by altering touch force, by detecting force down-peaks. The iPhone 6s/7 Ocarina features force-sensitive fingerholes that heightens octaves upon high force. Force Trombone continuously controls gain by force. Force Synth is a trigger pad array featuring all functions in one button: start note by touch, control vibrato with force, and toggle octaves upon abrupt burst of force. A simple user test suggests that adding force features to well-known instruments are more friendly and usable.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Toward Augmented Familiarity of the Audience with Digital Musical Instruments
next chapter Sonifying Twitter’s Emotions Through Music
Footnotes
1
3D Touch by Apple, on models after iPhone 6s:
 
2
Although Apple does not disclose 3D Touch’s sample rate, our preliminary experiments indicate it to be approximately between 10 and 15 ms (67–100Hz).
 
7
Not \(2^4 \times 2 = 32\), as “all holes open” does not have any fingers on screen to apply force.
 
Literature
1.
Bryan, N.J., Herrera, J., Oh, J., Wang, G.: MoMu: a mobile music toolkit. In: Proceedings of the 2010 International Conference on New Interfaces for Musical Expression, pp. 174–177. Sydney, Australia (2010)
2.
Cook, P., Scavone, G.P.: The synthesis toolkit (STK). In: Proceedings of the 1999 International Computer Music Conference, pp. 164–166. Beijing, China (1999)
3.
Essl, G., Rohs, M., Kratz, S.: Use the force (or something) - pressure and pressure-like input for mobile music performance. In: Proceedings of the 2010 International Conference on New Interfaces for Musical Expression, pp. 182–185. Sydney, Australia (2010)
4.
Kim, B., Yeo, W.S.: Interactive music performance with digital compass. In: Proceedings of the 2012 International Conference on New Interfaces for Musical Expression. Ann Arbor, Michigan (2012)
5.
Michon, R., Smith, J.O., Chafe, C., Wright, M., Wang, G.: NUANCE: adding multi-touch force detection to the iPad. In: Proceedings of the 2016 Sound and Music Computing Conference. Hamburg, Denmark (2016)
6.
Park, T.H., Oriol, N.: Fortissimo: force-feedback for mobile devices. In: Proceedings of the 2013 International Conference on New Interfaces for Musical Expression, pp. 291–294. Daejeon, Korea (2013)
7.
Tanaka, A.: Mobile music making. In: Proceedings of the 2004 International Conference on New Interfaces for Musical Expression, pp. 154–156. Singapore (2004)
8.
Wang, Ge.: Designing smule’s iPhone ocarina: the iPhone’s magic flute. In: Proceedings of the 2009 International Conference on New Interfaces for Musical Expression, pp. 303–307. Pittsburgh, Pennsylvania (2009)
9.
Yong, S., Lee, E.J., Peiris, R., Chan, L., Nam, J.: ForceClicks: enabling efficient button interaction with singer finger touch. In: Proceedings of the TEI 2017: Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. Yokohama, Japan (2017)
Metadata
Title
Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction
Authors
Edward Jangwon Lee
Sangeon Yong
Soonbeom Choi
Liwei Chan
Roshan Peiris
Juhan Nam
Copyright Year
2018
Book
Music Technology with Swing

Print ISBN: 978-3-030-01691-3

Electronic ISBN: 978-3-030-01692-0

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-030-01692-0_38