Sebastian Boring
Manuela Altendorfer
Gregor Broll
Otmar Hilliges
ABSTRACT
Large public displays have become pervasive in our everyday lives, but up to now, they are mostly information screens without any interaction possibilities. Users tend to forget what they saw relatively fast after leaving such a display. In this paper, we present a new interaction technique for transferring information from a public display onto a personal mobile phone with its built-in camera. Instead of having to rely on their memory, users simply take a picture of the information of interest. Instead of just storing the image, our system then retrieves the actual data represented on the screen, such as a stock quote, news text, or piece of music. The Shoot & Copy technique does not require visual codes that interfere with shown content or reduce screen real estate. Our prototype allows users to capture an arbitrary region of a standard desktop screen, containing icons, which represent pieces of data. The captured image is then analyzed and a reference to the corresponding data is sent back to the mobile phone. Once the user has time to view the information in more detail, our system allows retrieving the actual data from this reference. We present our prototype and the methods it uses for image processing, as well as an evaluation of our interaction technique illustrating its potential use and applications.
- AR Toolkit. http://www.hitl.washington.edu/artoolkit/Google Scholar
- Ballagas, R., Rohs, M., Sheridan, J., Borchers, J., Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays, In CHI' 05extended abstracts, New York, NY, USA, ACM, 2005, 1200--1203 Google ScholarDigital Library
- Ballagas, R., Rohs, M., Sheridan, J., Borchers, J., BYOD: Bring your own Device, In Proceedings of UbiComp 2004 Workshop on Ubiquitous Display Environments, Nottingham, UK, 2004Google Scholar
- BeeTagg. http://www.beetagg.com/Google Scholar
- Costanza, E., Leinss, M., Telling a Story on a Tag: The Importance of Markers's Visual Design for Real World Applications, MIRW 2006, workshop in conjunction with MobileHCI 2006, Espoo, Finland, ACM, 2006, 6--9Google Scholar
- Broll, G., Siorpaes, S., Rukzio, E., Paolucci, M., Hamard, J., Wagner, M., Schmidt, A., Supporting Mobile Service Usage through Physical Mobile Interaction, In Proceedings of PerCom 2007, White Plains, NY, USA, IEEE, 2007 Google ScholarDigital Library
- Greenberg, S., Boyle, M., Laberge, J., PDAs and Shared Public Displays: Making Personal Information Public, and Public Information Personal, In Personal and Ubiquitous Computing 3(1/2), London, UK, Springer, 1999, 54--64Google Scholar
- International Organization for Standardization: Information Technology - International Symbology Specification - Data Matrix. ISO/IEC 16022, 2000Google Scholar
- International Organization for Standardization: Information Technology - Automatic Identification and Data Capture Techniques - Bar Code Symbology - QR Code. ISO/IEC 18004, 2000Google Scholar
- Kohtake, N., Rekimoto, J., Anzai, Y., InfoPoint: A Device that Provides a Uniform User Interface to Allow Appliances to Work Together over a Network, Personal and Ubiquitous Computing 5(4), London, UK, Springer, 2001, 264--274 Google ScholarDigital Library
- Kato, H., Billinghurst, M., Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System, In Proceedings of IWAR 99, San Francisco, CA, USA, IEEE, 1999, 85--94 Google ScholarDigital Library
- Miyaoku, K., Higashino, S., Tonomura, Y., C-Blink: A Hue-Difference-Based Light Signal Marker for Large Screen Interaction via any Mobile Terminal, In Proceedings Of UIST'04, Santa Fee, NM, USA, ACM, 2004, 147--156 Google ScholarDigital Library
- Rekimoto, J., Pick-and-drop: A Direct Manipulation Technique for Multiple Computer Environments, In Proceedings of UIST'97, Banff, Canada, ACM, 1997, 31--39 Google ScholarDigital Library
- Rohs, M., Gfeller, B., Using Camera-Equipped Mobile Phones for Interacting with Real-World Objects, In Advances in Pervasive Computing, Austrian Computer Society (OCG), Vienna, Austria, 2004, 265--271Google Scholar
- Rohs, M., Real-World Interaction with Camera Phones, In Proceedings of UCS 2004, Tokyo, Japan, Revised Selected Papers, LNCS 3598, 2005, 74--89 Google ScholarDigital Library
- Rukzio, E., Schmidt, A., Hussmann, H., Physical Posters as Gateways to Context-aware Services for Mobile Devices, In Proceedings of WMCSA 2004, Google ScholarDigital Library
- Semacode. http://semacode.org/Google Scholar
- Semapedia. http://www.semapedia.org/Google Scholar
- ShotCode. http://www.shotcode.com/Google Scholar
Index Terms
- Shoot & copy: phonecam-based information transfer from public displays onto mobile phones
Recommendations
What goes where?: designing interactive large public display applications for mobile device interaction
ICIMCS '09: Proceedings of the First International Conference on Internet Multimedia Computing and ServiceIn this paper we describe our current research in the field of interactive large public displays with mobile device interaction. The core of our research is based on a user interface concept that takes advantage of input and output capabilities of ...
Subtle and Personal Workspace Requirements for Visual Search Tasks on Public Displays
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsWe explore how users approach and define personal space on large, public displays. Our results show that users of public displays use one of two strategies for visual search tasks: minimizers create a small window and work up close to the display, and ...
Sweep and point and shoot: phonecam-based interactions for large public displays
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsThis paper focuses on enabling interactions with large public displays using the most ubiquitous personal computing device, the mobile phone. Two new interaction techniques are introduced that use the embedded camera on mobile phones as an enabling ...
Comments