Top

Published in:

2017 | OriginalPaper | Chapter

11. Interaction with Adaptive and Ubiquitous User Interfaces

Authors : Jan Gugenheimer, Christian Winkler, Dennis Wolf, Enrico Rukzio

Published in: Companion Technology

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Current user interfaces such as public displays, smartphones and tablets strive to provide a constant flow of information. Although they all can be regarded as a first step towards Mark Weiser’s vision of ubiquitous computing they are still not able to fully achieve the ubiquity and omnipresence Weiser envisioned. In order to achieve this goal these devices must be able to blend in with their environment and be constantly available. Since this scenario is technically challenging, researchers simulated this behavior by using projector-camera systems. This technology opens the possibility of investigating the interaction of users with always available and adaptive information interfaces. These are both important properties of a Companion-technology. Such a Companion system will be able to provide users with information how, where and when they are desired. In this chapter we describe in detail the design and development of three projector-camera systems(UbiBeam, SpiderLight and SmarTVision). Based on insights from prior user studies, we implemented these systems as a mobile, nomadic and home deployed projector-camera system which can transform every plain surface into an interactive user interface. Finally we discuss the future possibilities for Companion-systems in combination with a projector-camera system to enable fully adaptive and ubiquitous user interface.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Management of Multimodal User Interaction in Companion-Systems

next chapter Interaction History in Adaptive Multimodal Interaction

Biundo, S., Wendemuth, A.: Companion-technology for cognitive technical systems. Künstl. Intell. 30(1), 71–75 (2016). Special issue on companion technologies

Ferreira, D., Goncalves, J., Kostakos, V., Barkhuus, L., Dey, A.K.: Contextual experience sampling of mobile application micro-usage. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’14, pp. 91–100. ACM, New York (2014). doi:10.1145/2628363.2628367. http://doi.acm.org/10.1145/2628363.2628367

Gugenheimer, J., Knierim, P., Seifert, J., Rukzio, E.: Ubibeam: an interactive projector-camera system for domestic deployment. In: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS ’14, pp. 305–310. ACM, New York (2014). doi:10.1145/2669485.2669537. http://doi.acm.org/10.1145/2669485.2669537

Gugenheimer, J., Honold, F., Wolf, D., Schüssel, F., Seifert, J., Weber, M., Rukzio, E.: How companion-technology can enhance a multi-screen television experience: a test bed for adaptive multimodal interaction in domestic environments. KI-Künstl. Intell. 30, 1–8 (2015)

Gugenheimer, J., Knierim, P., Winkler, C., Seifert, J., Rukzio, E.: Ubibeam: exploring the interaction space for home deployed projector-camera systems. In: Human-Computer Interaction–INTERACT 2015, pp. 350–366. Springer, Berlin (2015)

Hardy, J.: Reflections: a year spent with an interactive desk. Interactions 19(6), 56–61 (2012). doi:10.1145/2377783.2377795. http://doi.acm.org/10.1145/2377783.2377795 CrossRef

Hardy, J., Alexander, J.: Toolkit support for interactive projected displays. In: Proceedings of MUM 2012, pp. 42:1–42:10. ACM, New York (2012). doi:10.1145/2406367.2406419. http://doi.acm.org/10.1145/2406367.2406419

Harrison, C., Benko, H., Wilson, A.D.: Omnitouch: wearable multitouch interaction everywhere. In: Proceedings of UIST 2011, pp. 441–450. ACM, New York (2011). doi:10.1145/2047196.2047255. http://doi.acm.org/10.1145/2047196.2047255

Hassenzahl, M.: The thing and I: understanding the relationship between user and product. In: Funology, pp. 31–42. Springer, Berlin (2005)

10.

Huber, J., Steimle, J., Liao, C., Liu, Q., Mühlhäuser, M.: Lightbeam: interacting with augmented real-world objects in pico projections. In: Proceedings of MUM 2012, pp. 16:1–16:10. ACM, New York (2012). doi:10.1145/2406367.2406388. http://doi.acm.org/10.1145/2406367.2406388

11.

Karitsuka, T., Sato, K.: A wearable mixed reality with an on-board projector. In: Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR ’03, pp. 321. IEEE Computer Society, Washington, DC (2003). http://dl.acm.org/citation.cfm?id=946248.946820

12.

Linder, N., Maes, P.: Luminar: portable robotic augmented reality interface design and prototype. In: Adjunct Proceedings UIST 2010, pp. 395–396. ACM, New York (2010). doi:10.1145/1866218.1866237. http://doi.acm.org/10.1145/1866218.1866237

13.

Lumo interactive projector. http://www.lumoplay.com/ Accessed 18 April 2015

14.

Mistry, P., Maes, P.: Sixthsense: a wearable gestural interface. In: ACM SIGGRAPH ASIA 2009 Sketches, SIGGRAPH ASIA ’09, pp. 11:1–11:1. ACM, New York (2009). doi:10.1145/1667146.1667160. http://doi.acm.org/10.1145/1667146.1667160

15.

Pinhanez, C.S.: The everywhere displays projector: a device to create ubiquitous graphical interfaces. In: Proceedings of UbiComp 2001, pp. 315–331. Springer, London (2001). http://dl.acm.org/citation.cfm?id=647987.741324

16.

Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., Forlines, C.: iLamps: geometrically aware and self-configuring projectors. In: ACM SIGGRAPH 2003 Papers, SIGGRAPH ’03, pp. 809–818. ACM, New York (2003). doi:10.1145/1201775.882349. http://doi.acm.org/10.1145/1201775.882349

17.

Strauss, A.L., Corbin, J.M., et al.: Basics of Qualitative Research, vol. 15. Sage, Newbury Park, CA (1990)

18.

Tamaki, E., Miyaki, T., Rekimoto, J.: Brainy hand: an ear-worn hand gesture interaction device. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’09, pp. 4255–4260. ACM, New York (2009). doi:10.1145/1520340.1520649. http://doi.acm.org/10.1145/1520340.1520649

19.

Weiser, M.: The computer for the 21st century. SIGMOBILE Mob. Comput. Commun. Rev. 3(3), 3–11 (1999). doi:10.1145/329124.329126. http://doi.acm.org/10.1145/329124.329126 CrossRef

20.

Wilson, A.D.: Using a depth camera as a touch sensor. In: Proceedings of ITS 2010, ITS ’10, pp. 69–72. ACM, New York (2010). doi:10.1145/1936652.1936665. http://doi.acm.org/10.1145/1936652.1936665

21.

Wilson, A., Benko, H., Izadi, S., Hilliges, O.: Steerable augmented reality with the Beamatron. In: Proceedings of UIST 2012, pp. 413–422. ACM, New York (2012). doi:10.1145/2380116.2380169. http://doi.acm.org/10.1145/2380116.2380169

22.

Winkler, C., Reinartz, C., Nowacka, D., Rukzio, E.: Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS ’11, pp. 61–70. ACM, New York (2011). doi:10.1145/2076354.2076367. http://doi.acm.org/10.1145/2076354.2076367

23.

Winkler, C., Seifert, J., Dobbelstein, D., Rukzio, E.: Pervasive information through constant personal projection: the ambient mobile pervasive display (AMP-D). In: Proceedings of CHI 2014, pp. 4117–4126. ACM, New York (2014). doi:10.1145/2556288.2557365. http://doi.acm.org/10.1145/2556288.2557365

24.

Xiao, R., Harrison, C., Hudson, S.E.: Worldkit: rapid and easy creation of ad-hoc interactive applications on everyday surfaces. In: Proceedings of CHI 2013, pp. 879–888. ACM, New York (2013). doi:10.1145/2470654.2466113. http://doi.acm.org/10.1145/2470654.2466113

Title: Interaction with Adaptive and Ubiquitous User Interfaces
Authors: Jan Gugenheimer
Christian Winkler
Dennis Wolf
Enrico Rukzio
Publisher: Springer International Publishing
Book: Companion Technology
Print ISBN: 978-3-319-43664-7

Electronic ISBN: 978-3-319-43665-4

Copyright Year: 2017
DOI: https://doi.org/10.1007/978-3-319-43665-4_11

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner