Skip to main content

2019 | OriginalPaper | Buchkapitel

MilkyWay: A Toolbox for Prototyping Collaborative Mobile-Based Interaction Techniques

verfasst von : Mandy Korzetz, Romina Kühn, Karl Kegel, Leon Georgi, Franz-Wilhelm Schumann, Thomas Schlegel

Erschienen in: Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Beside traditional multitouch input, mobile devices provide various possibilities to interact in a physical, device-based manner due to their built-in hardware. Applying such interaction techniques allows for sharing content easily, e.g. by literally pouring content from one device into another, or accessing device functions quickly, e.g. by facing down the device to mute incoming calls. So-called mobile-based interaction techniques are characterized by movements and concrete positions in real spaces. Even though such interactions may provide many advantages in everyday life, they have limited visibility in interaction design due to the complexity of sensor processing. Hence, mobile-based interactions are often integrated, if any, at late design stages. To support testing interactive ideas in early design stages, we propose MilkyWay, a toolbox for prototyping collocated collaborative mobile-based interaction techniques. MilkyWay includes an API and a mobile application. It enables easily building up mobile interactive spaces between multiple collocated devices as well as prototyping interactions based on device sensors by a programming-by-demonstration approach. Appropriate sensors are selected and combined automatically to increase tool support. We demonstrate our approach using a proof of concept implementation of a collaborative Business Model Canvas (BMC) application.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
Boilerplate code is code that has to be included in many places with little or no alteration.
 
3
As example the sensor types of typical mobile devices with Android operating system: https://​developer.​android.​com/​guide/​topics/​sensors/​sensors_​overview.
 
4
Gaia is a spacecraft of the European Space Agency (ESA) for astrometry and measures the positions, distances and motions of stars with unprecedented precision.
 
5
The traditional paper tool for BMC can be found on https://​strategyzer.​com/​.
 
Literatur
1.
Zurück zum Zitat Ajaj, R., Jacquemin, C., Vernier, F.: RVDT: a design space for multiple input devices, multiple views and multiple display surfaces combination. In: Proceedings of the International Conference on Multimodal Interfaces (ICMI-MLMI 2009), pp. 269–276 (2009). https://doi.org/10.1145/1647314.1647372 Ajaj, R., Jacquemin, C., Vernier, F.: RVDT: a design space for multiple input devices, multiple views and multiple display surfaces combination. In: Proceedings of the International Conference on Multimodal Interfaces (ICMI-MLMI 2009), pp. 269–276 (2009). https://​doi.​org/​10.​1145/​1647314.​1647372
3.
Zurück zum Zitat Ballagas, R., Memon, F., Reiners, R., Borchers, J.: iStuff mobile: rapidly prototyping new mobile phone interfaces for ubiquitous computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 1107–1116 (2007). https://doi.org/10.1145/1240624.1240793 Ballagas, R., Memon, F., Reiners, R., Borchers, J.: iStuff mobile: rapidly prototyping new mobile phone interfaces for ubiquitous computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 1107–1116 (2007). https://​doi.​org/​10.​1145/​1240624.​1240793
4.
Zurück zum Zitat Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2003), pp. 537–544 (2003). https://doi.org/10.1039/F29767200988CrossRef Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2003), pp. 537–544 (2003). https://​doi.​org/​10.​1039/​F29767200988CrossRef
5.
Zurück zum Zitat Baytaş, M.A., Yemez, Y., Özcan, O.: User interface paradigms for visually authoring mid-air gestures: a survey and a provocation. In: 1st International Workshop on Engineering Gestures for Multimodal Interfaces (EGMI 2014), pp. 8–14 (2014). http://ceur-ws.org/Vol-1190/ Baytaş, M.A., Yemez, Y., Özcan, O.: User interface paradigms for visually authoring mid-air gestures: a survey and a provocation. In: 1st International Workshop on Engineering Gestures for Multimodal Interfaces (EGMI 2014), pp. 8–14 (2014). http://​ceur-ws.​org/​Vol-1190/​
6.
Zurück zum Zitat Geiger, C., Fritze, R., Lehmann, A., Stöcklein, J.: HYUI: a visual framework for prototyping hybrid user interfaces. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI 2008), pp. 63–70 (2008). https://doi.org/10.1145/1347390.1347406 Geiger, C., Fritze, R., Lehmann, A., Stöcklein, J.: HYUI: a visual framework for prototyping hybrid user interfaces. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI 2008), pp. 63–70 (2008). https://​doi.​org/​10.​1145/​1347390.​1347406
7.
Zurück zum Zitat Gutwin, C., Greenberg, S.: Design for individuals, design for groups: tradeoffs between power and workspace awareness. In: Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (CSCW 1998), pp. 207–216 (1998). https://doi.org/10.1145/289444.289495 Gutwin, C., Greenberg, S.: Design for individuals, design for groups: tradeoffs between power and workspace awareness. In: Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (CSCW 1998), pp. 207–216 (1998). https://​doi.​org/​10.​1145/​289444.​289495
8.
Zurück zum Zitat Hartmann, B., Abdulla, L., Mittal, M., Klemmer, S.R.: Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 145–154 (2007). https://doi.org/10.1145/1240624.1240646 Hartmann, B., Abdulla, L., Mittal, M., Klemmer, S.R.: Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 145–154 (2007). https://​doi.​org/​10.​1145/​1240624.​1240646
10.
11.
Zurück zum Zitat Kim, J.W., Kim, H.J., Nam, T.J.: M.gesture: an acceleration-based gesture authoring system on multiple handheld and wearable devices. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), pp. 2307–2318. ACM (2016). https://doi.org/10.1145/2858036.2858358 Kim, J.W., Kim, H.J., Nam, T.J.: M.gesture: an acceleration-based gesture authoring system on multiple handheld and wearable devices. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), pp. 2307–2318. ACM (2016). https://​doi.​org/​10.​1145/​2858036.​2858358
12.
Zurück zum Zitat Kim, J.W., Nam, T.J.: EventHurdle: supporting designers’ exploratory interaction prototyping with gesture-based sensors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 267–276 (2013). https://doi.org/10.1145/2470654.2470691 Kim, J.W., Nam, T.J.: EventHurdle: supporting designers’ exploratory interaction prototyping with gesture-based sensors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 267–276 (2013). https://​doi.​org/​10.​1145/​2470654.​2470691
14.
Zurück zum Zitat Klompmaker, F., Schrage, K., Reimann, C.: INDiE: a framework for human computer interaction in distributed environments. In: Proceedings of the 6th International Conference on Mobile Technology, Application & Systems (Mobility 2009), pp. 26–29 (2009). https://doi.org/10.1145/1710035.1710061 Klompmaker, F., Schrage, K., Reimann, C.: INDiE: a framework for human computer interaction in distributed environments. In: Proceedings of the 6th International Conference on Mobile Technology, Application & Systems (Mobility 2009), pp. 26–29 (2009). https://​doi.​org/​10.​1145/​1710035.​1710061
15.
Zurück zum Zitat Korzetz, M., Kühn, R., Heisig, P., Schlegel, T.: Natural collocated interactions for merging results with mobile devices. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2016), pp. 746–752. ACM (2016). https://doi.org/10.1145/2957265.2961839 Korzetz, M., Kühn, R., Heisig, P., Schlegel, T.: Natural collocated interactions for merging results with mobile devices. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2016), pp. 746–752. ACM (2016). https://​doi.​org/​10.​1145/​2957265.​2961839
16.
Zurück zum Zitat Korzetz, M., Kühn, R., Schlegel, T.: Turn it, pour it, twist it: a model for designing mobile device-based interactions. In: Proceedings of the 5th International Conference on Human-Computer Interaction and User Experience in Indonesia (CHIuXiD 2019). ACM (2019). https://doi.org/10.1145/3328243.3328246 Korzetz, M., Kühn, R., Schlegel, T.: Turn it, pour it, twist it: a model for designing mobile device-based interactions. In: Proceedings of the 5th International Conference on Human-Computer Interaction and User Experience in Indonesia (CHIuXiD 2019). ACM (2019). https://​doi.​org/​10.​1145/​3328243.​3328246
17.
Zurück zum Zitat Kühn, R., Korzetz, M., Büschel, L., Korger, C., Manja, P., Schlegel, T.: Natural voting interactions for collaborative work with mobile devices. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2016), pp. 2570–2575. ACM (2016). https://doi.org/10.1145/2851581.2892300 Kühn, R., Korzetz, M., Büschel, L., Korger, C., Manja, P., Schlegel, T.: Natural voting interactions for collaborative work with mobile devices. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2016), pp. 2570–2575. ACM (2016). https://​doi.​org/​10.​1145/​2851581.​2892300
18.
Zurück zum Zitat Kühn, R., Korzetz, M., Büschel, L., Schumann, F.W., Schlegel, T.: Device-based interactions for anonymous voting and rating with mobile devices in collaborative scenarios. In: Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM 2016), pp. 315–317. ACM (2016). https://doi.org/10.1145/3012709.3016067 Kühn, R., Korzetz, M., Büschel, L., Schumann, F.W., Schlegel, T.: Device-based interactions for anonymous voting and rating with mobile devices in collaborative scenarios. In: Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM 2016), pp. 315–317. ACM (2016). https://​doi.​org/​10.​1145/​3012709.​3016067
19.
Zurück zum Zitat Kühn, R., Schlegel, T.: Mixed-focus collaboration activities for designing mobile interactions. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2018), pp. 71–77. ACM (2018). https://doi.org/10.1145/3236112.3236122 Kühn, R., Schlegel, T.: Mixed-focus collaboration activities for designing mobile interactions. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2018), pp. 71–77. ACM (2018). https://​doi.​org/​10.​1145/​3236112.​3236122
20.
Zurück zum Zitat Ledo, D., Houben, S., Vermeulen, J., Marquardt, N., Oehlberg, L., Greenberg, S.: Evaluation strategies for HCI toolkit research. In: Proceedings of the 2018 Conference on Human Factors in Computing Systems (CHI 2018), p. 17 (2018). https://doi.org/10.1145/3173574.3173610 Ledo, D., Houben, S., Vermeulen, J., Marquardt, N., Oehlberg, L., Greenberg, S.: Evaluation strategies for HCI toolkit research. In: Proceedings of the 2018 Conference on Human Factors in Computing Systems (CHI 2018), p. 17 (2018). https://​doi.​org/​10.​1145/​3173574.​3173610
21.
Zurück zum Zitat Leigh, S.W., Schoessler, P., Heibeck, F., Maes, P., Ishii, H.: THAW: Tangible interaction with see-through augmentation for Smartphones on computer screens. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2014), pp. 89–96. ACM (2015). https://doi.org/10.1145/2677199.2680584 Leigh, S.W., Schoessler, P., Heibeck, F., Maes, P., Ishii, H.: THAW: Tangible interaction with see-through augmentation for Smartphones on computer screens. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2014), pp. 89–96. ACM (2015). https://​doi.​org/​10.​1145/​2677199.​2680584
22.
Zurück zum Zitat Lucero, A., Holopainen, J., Jokela, T.: Pass-them-around: collaborative use of mobile phones for photo sharing. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI 2011), pp. 1787–1796 (2011). https://doi.org/10.1145/1978942.1979201 Lucero, A., Holopainen, J., Jokela, T.: Pass-them-around: collaborative use of mobile phones for photo sharing. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI 2011), pp. 1787–1796 (2011). https://​doi.​org/​10.​1145/​1978942.​1979201
23.
Zurück zum Zitat Lucero, A., Keränen, J., Jokela, T.: Social and spatial interactions: shared co-located mobile phone use. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2010), pp. 3223–3228. ACM (2010) Lucero, A., Keränen, J., Jokela, T.: Social and spatial interactions: shared co-located mobile phone use. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2010), pp. 3223–3228. ACM (2010)
24.
Zurück zum Zitat Lucero, A., Keränen, J., Korhonen, H.: Collaborative use of mobile phones for brainstorming. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2010), pp. 337–340. ACM (2010). https://doi.org/10.1145/1851600.1851659 Lucero, A., Keränen, J., Korhonen, H.: Collaborative use of mobile phones for brainstorming. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2010), pp. 337–340. ACM (2010). https://​doi.​org/​10.​1145/​1851600.​1851659
26.
Metadaten
Titel
MilkyWay: A Toolbox for Prototyping Collaborative Mobile-Based Interaction Techniques
verfasst von
Mandy Korzetz
Romina Kühn
Karl Kegel
Leon Georgi
Franz-Wilhelm Schumann
Thomas Schlegel
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-23563-5_38

Neuer Inhalt