Andrew D. Wilson
Otmar Hilliges
David Kirk
ABSTRACT
This paper explores the intersection of emerging surface technologies, capable of sensing multiple contacts and of-ten shape information, and advanced games physics engines. We define a technique for modeling the data sensed from such surfaces as input within a physics simulation. This affords the user the ability to interact with digital objects in ways analogous to manipulation of real objects. Our technique is capable of modeling both multiple contact points and more sophisticated shape information, such as the entire hand or other physical objects, and of mapping this user input to contact forces due to friction and collisions within the physics simulation. This enables a variety of fine-grained and casual interactions, supporting finger-based, whole-hand, and tangible input. We demonstrate how our technique can be used to add real-world dynamics to interactive surfaces such as a vision-based tabletop, creating a fluid and natural experience. Our approach hides from application developers many of the complexities inherent in using physics engines, allowing the creation of applications without preprogrammed interaction behavior or gesture recognition.
Supplemental Material
- Agarawala, A. and Balakrishnan, R. 2006. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. CHI 2006, 1283--1292. Google Scholar
Digital Library
- Barron, J., Fleet, D., Beauchemin, S., and Burkitt, T. 1992. Performance of optical flow techniques. Computer Vision and Pattern Recognition, 236--242.Google Scholar
- D. Baraff, 1989. Analytical methods for dynamic simulation of non-penetrating rigid bodies, SIGGRAPH Computer Graphics, 223--232. Google ScholarDigital Library
- D. Baraff. 1994. Fast contact force computation for nonpenetrating rigid bodies. SIGGRAPH Computer Graphics, 23--34. Google ScholarDigital Library
- Chang, B.-W., and Unger, D. 1993. Animation: from cartoons to the user interface. UIST '93, 45--55. Google ScholarDigital Library
- Chang, F., Chen, C.-J., and Lu, C.-J. 2004. A linear-time component labeling algorithm using contour tracing technique, Computer Vision and Image Understanding, vol. 93, no. 2, 206--220. Google ScholarDigital Library
- Dietz, P. and Leigh, D. 2001. DiamondTouch: a multi-user touch technology. UIST 2001, 219--226. Google ScholarDigital Library
- Dragicevic, P. 2004. Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows. UIST 2004, 193--196. Google ScholarDigital Library
- Erleben, K., Sporring, J., Henriksen, K., and Dohlman, K. 2005. Physics-Based Animation. Charles River Media, Inc. Google ScholarDigital Library
- Fröhlich, B., Tramberend, H., Beers, A., Agrawala, M., and Baraff, D. 2000. Physically-based manipulation on the responsive workbench. IEEE VR Conference 2000, 5--11. Google ScholarDigital Library
- Gonzalez, R., and Woods, R. 2007. Digital Image Processing: Third Edition. Prentice Hall. Google ScholarDigital Library
- Geißler, J. 1998. Shuffle, throw or take it! working efficiently with an interactive wall. CHI Ext. Abstracts, 265--266. Google ScholarDigital Library
- Grossman, T., and Wigdor, D. 2007. Going deeper: a taxonomy of 3D on the tabletop. Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 137--144.Google Scholar
- Han, J.Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. UIST 2005, 115--118. Google ScholarDigital Library
- Hancock, M., Carpendale, S., and Cockburn, A. 2007. Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques. CHI 2007, 1147--1156. Google ScholarDigital Library
- Hancock, M., Carpendale, S., Supporting Multiple Off-Axis Viewpoints at a Tabletop Display. 2007. Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 171--178.Google Scholar
- Kruger, R., Carpendale, S., Scott, S., Tang, A. 2005. Fluid integration of rotation and translation, CHI 2005, 601--610. Google ScholarDigital Library
- Liu, J., Pinelle, D., Sallam, S., Subramanian, S., and Gutwin, C. 2006. TNT: improved rotation and translation on digital tables. Graphics Interface 2006, 25--32. Google ScholarDigital Library
- Mander, R., Salomon, G., and Wong, Y.Y. 1992 A 'pile' metaphor for supporting casual organization. CHI '92, 627--634. Google ScholarDigital Library
- Microsoft Corporation. Microsoft Surface. http://ww.surface.com. 2007.Google Scholar
- NVIDIA Corporation. NVIDIA PhysX. http://www.nvidia.com/object/nvidia_physx.html. 2008.Google Scholar
- Reetz, A., Gutwin, C., Stach, T., Nacenta, M., and Subramanian, S. 2006. Superflick: a natural and efficient technique for long-distance object placement on digital tables. Graphics Interface 2006. 163--170. Google ScholarDigital Library
- Robertson, G., Czerwinski, M., Larson, K., Robbins, D., Thiel, D., and van Dantzich, M. 1998. Data mountain: using spatial memory for document management. UIST '98, 153--162. Google ScholarDigital Library
- Ståhl, O., Wallberg, A., Söderberg, J., Humble, J., Fahlén, L. E., Bullock, A., and Lundberg, J. 2002. Information exploration using the pond. In Proc. CVE, 72--79. Google ScholarDigital Library
- Wilson, A. 2005. PlayAnywhere: a compact interactive tabletop projection-vision system. UIST 2005, 83--92. Google ScholarDigital Library
- Wilson, A. 2007. Depth-sensing video cameras for 3D Tangible Interaction. Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, 201--204.Google ScholarCross Ref
- Wu, M, and Balakrishnan, R. 2003. Multi-finger and whole hand gesture interaction techniques for multi-user tabletop displays. UIST 2003. 193--202. Google ScholarDigital Library
Index Terms
- Bringing physics to the surface
Recommendations
Interactions in the air: adding further depth to interactive tabletops
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technologyAlthough interactive surfaces have many unique and compelling qualities, the interactions they support are by their very nature bound to the display surface. In this paper we present a technique for users to seamlessly switch between interacting on the ...
Simulating grasping behavior on an imaging interactive surface
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesWe present techniques and algorithms to simulate grasping behavior on an imaging interactive surface (e.g., Microsoft Surface). In particular, we describe a contour model of touch contact shape, and show how these contours may be represented in a real-...
Beyond flat surface computing: challenges of depth-aware and curved interfaces
MM '09: Proceedings of the 17th ACM international conference on MultimediaIn the past decade, multi-touch-sensitive interactive surfaces have transitioned from pure research prototypes in the lab, to commercial products with wide-spread adoption. One of the longer term visions of this research follows the idea of ubiquitous ...
Comments