Tsung-Hsiang Chang
ABSTRACT
A user task often spans multiple heterogeneous devices, e.g., working on a PC in the office and continuing the work on a laptop or a mobile phone while commuting on a shuttle. However, there is a lack of support for users to easily migrate their tasks across devices. To address this problem, we created Deep Shot, a framework for capturing the user's work state that is needed for a task (e.g., the specific part of a webpage being viewed) and resuming it on a different device. In particular, Deep Shot supports two novel and intuitive interaction techniques, deep shooting and deep posting, for pulling and pushing work states, respectively, using a mobile phone camera. In addition, Deep Shot provides a concise API for developers to leverage its services and make their application states migratable. We demonstrated that Deep Shot can be used to support a range of everyday tasks migrating across devices. An evaluation consisting of a series of experiments showed that our framework and techniques are feasible.
Supplemental Material
- Bandelloni, R. and PaternF, F. Migratory User Interfaces Able To Adapt To Various Interaction Platforms. International journal of human-computer studies, 2004.Google Scholar
Cross Ref
- Bardram, JE. Activity-Based Computing: Support For Mobility And Collaboration In Ubiquitous Computing. Personal and Ubiquitous Computing, 2005. Google ScholarDigital Library
- Bardram, JE., Bunde-Pedersen, J., and Soegaard, M. Support For Activity-Based Computing In A Personal Computing Operating System. Proc. CHI '06. Google ScholarDigital Library
- Bay, H., Tuytelaars, T., and Van Gool, L. SURF: Speeded Up Robust Features. Proc. CVIU, 2008. Google ScholarDigital Library
- Boring, S., Altendorfer, M., Broll, G., and et al. Shoot & Copy: Phonecam-Based Information Transfer From Public Displays Onto Mobile Phones. Proc. Mobility '07. Google ScholarDigital Library
- Boring, S., Baur, D., Butz, A., and et al. Touch Projector: Mobile Interaction through Video. Proc. CHI '10. Google ScholarDigital Library
- Dearman, D and Pierce, JS. "It's On My Other Computer!": Computing With Multiple Devices. Proc. CHI '08. Google ScholarDigital Library
- Google Chrome to Phone. http://code.google.com/p/chrometophone.Google Scholar
- Hinckley, K. Synchronous Gestures For Multiple Persons And Computers. Proc. UIST '03. Google ScholarDigital Library
- 10. Hupp, D. and Miller, RC. Smart Bookmarks: Automatic Retroactive Macro Recording On The Web. Proc. UIST '07. Google ScholarDigital Library
- 11. Karlson, A., Iqbal, S., Meyers, and Tang, J. Mobile Taskflow in Context: A Screenshot Study of Smartphone Usage. Proc. CHI '10. Google ScholarDigital Library
- 12. Li, Y., and Landay, J. Activity-based prototyping of ubicomp applications for long-lived, everyday human activities, Proc. CHI'08. Google ScholarDigital Library
- 13. Liao, C., Liu, Q., and et al. Pacer: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone. Proc. CHI '10. Google ScholarDigital Library
- 14. Liu, Q., McEvoy, P., and Lai, C.-J. Mobile camera supported document redirection. Proc. MM '06. Google ScholarDigital Library
- 15. Miller, RC and Myers, BA. Synchronizing Clipboards Of Multiple Computers. Proc. UIST '99. Google ScholarDigital Library
- 16. Pierce, J. and Nichols, J. An Infrastructure For Extending Applications' User Experiences Across Multiple Personal Devices. Proc. UIST '08. Google ScholarDigital Library
- 17. Rekimoto, J. Pick-And-Drop: A Direct Manipulation Technique For Multiple Computer Environments. Proc. UIST '97. Google ScholarDigital Library
- 18. Rekimoto, J and Saitoh, M. Augmented Surfaces: A Spatially Continuous Work Space For Hybrid Computing Environments. Proc. CHI '99. Google ScholarDigital Library
- 19. Schilit, B and Sengupta, U. Device Ensembles. Computer, IEEE Computer Socity, 2004. Google ScholarDigital Library
- 20. Tang, J., Lin, J., and et al. Recent Shortcuts: Using Recent Interactions To Support Shared Activities. Proc. CHI '07. Google ScholarDigital Library
- 21. Tan, DS., Meyers, B., and Czerwinski, M. WinCuts: manipulating arbitrary window regions for more effective use of screen space. Proc. CHI '04. Google ScholarDigital Library
- 22. Want, R, Fishkin, K, and Gujar, A. Bridging Physical And Virtual Worlds With Electronic Tags. Proc. CHI '99.. Google ScholarDigital Library
Index Terms
- Deep shot: a framework for migrating tasks across devices using mobile phone cameras
Recommendations
Management of security policies for mobile devices
InfoSecCD '07: Proceedings of the 4th annual conference on Information security curriculum developmentThis paper discusses management of security policies for mobile devices. The increasing use of mobile devices in the workplace is covered, as well as new software applications that allow employees to use their mobile devices to increase their ...
Open project: a lightweight framework for remote sharing of mobile applications
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technologyThe form factor of mobile devices remains small while their computing power grows at an accelerated rate. Prior work has explored expanding the output space by leveraging free displays in the environment. However, existing solutions often do not scale. ...
Multimodal object oriented user interfaces in mobile affective interaction
In this paper, we investigate an object oriented (OO) architecture for multimodal emotion recognition in interactive applications through mobile phones or handheld devices. Mobile phones are different from desktop computers since mobile phones are not ...
Comments