Dongwook Yoon
Hrvoje Benko
François Guimbretière
ABSTRACT
The orientation and repositioning of physical artefacts (such as paper documents) to afford shared viewing of content, or to steer the attention of others to specific details, is known as micro-mobility. But the role of grasp in micro-mobility has rarely been considered, much less sensed by devices. We therefore employ capacitive grip sensing and inertial motion to explore the design space of combined grasp + micro-mobility by considering three classes of technique in the context of active reading. Single user, single device techniques support grip-influenced behaviors such as bookmarking a page with a finger, but combine this with physical embodiment to allow flipping back to a previous location. Multiple user, single device techniques, such as passing a tablet to another user or working side-by-side on a single device, add fresh nuances of expression to co-located collaboration. And single user, multiple device techniques afford facile cross-referencing of content across devices. Founded on observations of grasp and micro-mobility, these techniques open up new possibilities for both individual and collaborative interaction with electronic documents.
Supplemental Material
- Annett, M., Gupta, A., Bischof, W., Exploring and Understanding Unintended Touch during Direct Pen Interaction. ACM Trans. Comput.-Hum. Interact., 2014. 21(5): Article 28. Google Scholar
Digital Library
- Becchio, C., Manera, V., Sartori, L., Cavallo, A., Castiello, U., Grasping intentions: from thought experiments to empirical evidence. Frontiers in Human Neuroscience, 2012. 6 (117): p. 1--6.Google Scholar
- Bragdon, A., Zeleznik, R., Williamson, B., Miller, T., LaViola, J., GestureBar: improving the approachability of gesture-based interfaces. CHI '09. Google ScholarDigital Library
- Buxton, W., Integrating the Periphery and Context: A New Taxonomy of Telematics. Graphics Interface '95.Google Scholar
- Chen, N., Guimbretiere, F., Dixon, M., Lewis, C., Agrawala, M., Navigation Techniques for Dual-Display E-Book Readers. CHI'08. Google ScholarDigital Library
- Chen, N., Guimbretiere, F., Sellen, A., Designing a Multi-Slate Reading Environment to Support Active Reading Activities. TOCHI, 2012. 19(3): Article 18. Google ScholarDigital Library
- Cheng, L., Hsiao, F., Liu, Y., Chen, M., iRotate grasp: automatic screen rotation based on grasp of mobile devices. UIST'12 Adjunct Proceedings. Google ScholarDigital Library
- Cheng, L., Liang, H., Wu, C., Chen, M., iGrasp: graspbased adaptive keyboard for mobile devices. CHI '13 Extended Abstracts. Google ScholarDigital Library
- Cockburn, A., Gutwin, C., Scarr, J., Malacria, S., Supporting Novice to Expert Transitions in User Interfaces. ACM Comput. Surv., 2014. 47 (2): Article 31. Google ScholarDigital Library
- Fishkin, K., Gujar, A., Harrison, B., Moran, T., Want, R., Embodied user interfaces for really direct manipulation. CACM, 2000. 43 (9): p. 75--80. Google ScholarDigital Library
- Freeman, D., Benko, H., Morris, M., Wigdor, D., ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. ITS'09. Google ScholarDigital Library
- Goel, M., Wobbrock, J., Patel, S., GripSense: Using Built-In Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. UIST'12. Google ScholarDigital Library
- Greenberg, S., Boyle, M., LaBerge, J., PDAs and Shared Public Displays: Making Personal Information Public, and Public Information Personal. Personal Technologies, 1999. 3 (1): p. 54--64.Google Scholar
- Hamilton, P., Wigdor, D., Conductor: enabling and understanding cross-device interaction. CHI '14. Google ScholarDigital Library
- Hinckley, K., Bi, X., Pahud, M., Buxton, B., Informal Information Gathering Techniques for Active Reading. CHI'12. Google ScholarDigital Library
- Hinckley, K., Pahud, M., Benko, H., Irani, P., Guimbretiere, F., Gavriliu, M., Chen, X., Matulic, F., Buxton, B., Wilson, A., Sensing Techniques for Tablet+Stylus Interaction. UIST'14. Google ScholarDigital Library
- Hinckley, K., Song, H., Sensor Synaesthesia: Touch in Motion, and Motion in Touch. CHI 2011. Google ScholarDigital Library
- Hong, M., Piper, A., Weibel, N., Olberding, S., Hollan, J., Microanalysis of active reading behavior to inform design of interactive desktop workspaces. ITS '12. Google ScholarDigital Library
- Kim, K., Chang, W., Cho, S., Shim, J., Lee, H., Park, J., Lee, Y., Kim, S., Hand Grip Pattern Recognition for Mobile User Interfaces. Proc. AAAI/IAAI-2006: Innovative Applications of Artificial Intelligence. Google ScholarDigital Library
- Kim, S., Kim, J., Lee, S., Bezel-flipper: design of a light-weight flipping interface for e-books. CHI'13 Extended Abstracts. Google ScholarDigital Library
- Kruger, R., Carpendale, M., Scott, S., Greenberg, S. How People Use Orientation on Tables: Comprehension, Coordination and Communication. Proc. ACM Group 2003. Google ScholarDigital Library
- Liu, S., Guimbretire, F., FlexAura: a flexible nearsurface range sensor. UIST'12. Google ScholarDigital Library
- Luff, P., Heath, C., Mobility in collaboration. CSCW '98. Google ScholarDigital Library
- Mackenzie, C., Iberall, T., The Grasping Hand. Advances in Psychology 104, ed. G. Stelmach and P. Vroon. 1994, Amsterdam: North Holland.Google Scholar
- Marquardt, N., Hinckley, K., Greenberg, S., CrossDevice Interaction via Micro-mobility and Fformations. UIST '12. Google ScholarDigital Library
- Marshall, C., Turning the Page on Page Navigation. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05). Google ScholarDigital Library
- Marshall, C., Bly., S., Saving and Using Encountered Information: Implications for Electronic Periodicals. CHI'05. Google ScholarDigital Library
- Mason, A., MacKenzie, C., Grip forces when passing an object to a partner. Experimental Brain Research, 2005. 163 (2): p. 173--187. Springer.Google Scholar
- Morris, M., Brush, A., Meyers, B., Reading Revisited: Evaluating the Usability of Digital Display Surfaces for Active Reading Tasks. Tabletop'07.Google Scholar
- Noor, M., Ramsay, A., Hughes, S., Rogers, S., Williamson, J., Murray-Smith, R. 28 frames later: predicting screen touches from back-of-device grip changes. CHI '14.Google Scholar
- Olafsdottir, H., Tsandilas, T., Appert, C., Prospective motor control on tabletops: planning grasp for multitouch interaction. CHI '14. Google ScholarDigital Library
- Oulasvirta, A., Bergstrom-Lehtovirta, J. Ease of Juggling: Studying the Effects of Manual Multitasking. CHI'11. Google ScholarDigital Library
- Schmidt, D., Chehimi, F., Rukzio, E., Gellersen, H., PhoneTouch: A Technique for Direct Phone Interaction on Surfaces. UIST'10. Google ScholarDigital Library
- Sellen, A., Harper, H., The myth of the paperless office. 2002, Cambridge, MA: MIT Press. Google ScholarDigital Library
- Sommer, R., Further studies of small group ecology. Sociometry, 1965. 28: p. 337--348.Google ScholarCross Ref
- Sun, M., Cao, X., Song, H., Izadi, S., Benko, H., Guimbretiere, F., Ren, X., Hinckley, K., Enhancing Naturalness of Pen-and-Tablet Drawing through Context Sensing. ITS '11. Google ScholarDigital Library
- Tashman, C., Edwards, W., LiquidText: A Flexible, Multitouch Environment to Support Active Reading. CHI'11. Google ScholarDigital Library
- Taylor, B., Bove Jr., V. Graspables: Grasp-Recognition as a User Interface. CHI'09. Google ScholarDigital Library
- Terrenghi, L., Kirk, D., Sellen, A., Izadi, S., Affordances for manipulation of physical versus digital media on interactive surfaces. CHI '07. Google ScholarDigital Library
- Wagner, J., Huot, S., Mackay, W., BiTouch and BiPad: Designing Bimanual Interaction for Hand-held Tablets. CHI'12. Google ScholarDigital Library
- Wimmer, R., Grasp Sensing for Human-Computer Interaction. TEI'11. Google ScholarDigital Library
- Wimmer, R., Boring, S. HandSense Discriminating Different Ways of Grasping and Holding a Tangible User Interface., TEI '09. Google ScholarDigital Library
- Wolf, K., Müller-Tomfelde, C., Cheng, K., Wechsung, I., PinchPad: performance of touch-based gestures while grasping devices. TEI '12.. Google ScholarDigital Library
- Yoon, D., Cho, Y., Yeom, K., Park, J., TouchBookmark: a lightweight navigation and bookmarking technique for e-books. CHI'11 extended Abstracts. Google ScholarDigital Library
Index Terms
- Sensing Tablet Grasp + Micro-mobility for Active Reading
Recommendations
Cross-device interaction via micro-mobility and f-formations
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technologyGroupTogether is a system that explores cross-device interaction using two sociological constructs. First, F-formations concern the distance and relative body orientation among multiple users, which indicate when and how people position themselves as a ...
Sensing techniques for tablet+stylus interaction
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his ...
Macro/micro-mobility fast handover in hierarchical mobile IPv6
Mobile Internet Protocol version 6 (MIPv6) has been proposed to solve the problem of mobility in the new era of Internet by handling routing of IPv6 packets to mobile nodes that have moved away from their home network. Users will move frequently between ...
Comments