ABSTRACT
In this paper we present the tangible 3D tabletop and discuss the design potential of this novel interface. The tangible 3D tabletop combines tangible tabletop interaction with 3D projection in such a way that the tangible objects may be augmented with visual material corresponding to their physical shapes, positions, and orientation on the tabletop. In practice, this means that both the tabletop and the tangibles can serve as displays. We present the basic design principles for this interface, particularly concerning the interplay between 2D on the tabletop and 3D for the tangibles, and present examples of how this kind of interface might be used in the domain of maps and geolocalized data. We then discuss three central design considerations concerning 1) the combination and connection of content and functions of the tangibles and tabletop surface, 2) the use of tangibles as dynamic displays and input devices, and 3) the visual effects facilitated by the combination of the 2D tabletop surface and the 3D tangibles.
Supplemental Material
- Akaoka, E., Ginn, T. & Vertegaal, R. 2010. DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models TEI '10. ACM, 49--56. Google ScholarDigital Library
- Bandyopadhyay, D., Raskar, R. and Fuchs, H. 2001. Dynamic Shader Lamps: Painting on Movable Objects. ACM International Symposium on Augmented Reality, ACM Press. Google ScholarDigital Library
- Basballe, D. and Halskov, K. 2010. Projections on museum exhibits -- engaging visitors in the museum setting. Proc. Of OZCHI 2010, 80--87. Google ScholarDigital Library
- Baudisch, P. Becker, T. and Frederik Rudeck. 2010. Lumino: tangible building blocks based on glass fiber bundles. Proc. of SIGGRAPH '10, ACM Press. Google ScholarDigital Library
- Bencina, R., Kaltenbrunner, M. and Jordà, S. 2005. Improved Topological Fiducial Tracking in the reacTIVision System. Proc. IEEE International Workshop on Projector-Camera Systems.Google Scholar
- Bimber, O. and Raskar, R. 2004. Spatial Augmented Reality. Merging Real and Virtual Worlds, A. K. Peters Publishing. Google ScholarDigital Library
- Buxton, W. 1997. Living in Augmented Reality: Ubiquitous Media and Reactive Environments. Video Mediated Communication, K. Finn, A. Sellen and S. Wilber (Eds.). Erlbaum, Hillsdale, NJ, USA, 363--384.Google Scholar
- Clifton, P., Mazalek, A., Sanford, J., Rabola, C., Lee, S. and Powell, N. 2011. SketchTop: design collaboration on a multi-touch tabletop. Proc. of TEI '11, ACM Press, 333--336. Google ScholarDigital Library
- Correia, N., Mota, T., Nóbrega, R., Silva, L. and Almeida, A. 2010. A multi-touch tabletop for robust multimedia interaction in museums. Proc of ITS '10, ACM, 117--120. Google ScholarDigital Library
- Dalsgaard, P. and Halskov, K. 2010. Designing Urban Media Façades: Cases and Challenges. Proc of CHI '10, ACM, 2277--2286. Google ScholarDigital Library
- Dalsgaard, P. and Halskov, K. 2011. 3D Projection on Physical Objects: Design Insights from Five Real Life Cases. Proc of CHI '11, ACM. Google ScholarDigital Library
- Dalsgaard, P. & Halskov, K. 2012. "Reflective Design Documentation". In Proc. of DIS 2012: ACM conference on Designing interactive systems, ACM,. Google ScholarDigital Library
- Halskov, K. and Dalsgaard, P. 2011 Using 3D projection to bring a statue to life. Interactions. Google ScholarDigital Library
- Halskov, K. 2011. CAVI - An interaction design research lab. interactions 18(4), 92--95. Google ScholarDigital Library
- Hancock, M. Nacenta, M., Gutwin, C., and Carpendale, S. 2009. The effects of changing projection geometry on the interpretation of 3D orientation on tabletops. Proc. Of ITS '09, ACM Press, 157--164. Google ScholarDigital Library
- Ishii, H. and Ullmer, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. Proc. Of CHI '97, ACM, 234--241. Google ScholarDigital Library
- Villar, N., Butler, A. Westhues, J. 2008. Going beyond the display: a surface technology with an electronically switchable diffuser. UIST '08. ACM, New York, NY, USA, 269--278. Google ScholarDigital Library
- Jordà, S., Julia, C. F. and Gallardo, D. 2010. Interactive surfaces and tangibles. XRDS 16, 4, 21--28. Google ScholarDigital Library
- Kaltenbrunner, M. and Bencina, R. 2007. reacTIVision: a computer-vision framework for table-based tangible interaction. Proc. Of TEI '07, ACM, 69--74. Google ScholarDigital Library
- Lucchi, A., Jermann, P., Zufferey, G. & and Dillenbourg, P. 2010. An empirical evaluation of touch and tangible interfaces for tabletop displays. Proc. of TEI '10, ACM. Google ScholarDigital Library
- Marquardt, N., Jota, R., Greenberg, S., and Jorge, J. A. 2011. The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface. Proc. Interact 2011, 461--476. Google ScholarDigital Library
- Merrill, D., Kalanithi, J. and Maes, P. 2007. Siftables: towards sensor network user interfaces. Proc. of TEI 2007, ACM Press, 75--78. Google ScholarDigital Library
- Milgram, P. and Kishino, F. A. 1994. Taxonomy of Mixed Reality Visual Display. IEICE Transactions on Information Systems 12, 1321--1329.Google Scholar
- Nielsen, R., Fritsch, J., Halskov, K. and Brynskov, M. 2009. Out of the Box -- Exploring the Richness of Children's Use of an Interactive Table. IDC. Google ScholarDigital Library
- Norman, D. A. 1988. The design of everyday things, Basic Books, New York, NY, USA.Google Scholar
- Patten, J., Ishii, H., Hines, J. and Pangaro, G. 2001. Sensetable: A wireless object tracking platform for tangible user interfaces. CHI '01: Proc. SIGCHI Conference on Human Factors in Computing Systems., 253--260. Google ScholarDigital Library
- Piper, B, Ratti, C. & Ishii, H. 2002. Illuminating clay: a 3-D tangible interface for landscape analysis. In Proc. of CHI '02. ACM, New York, NY, USA, 355--362. Google ScholarDigital Library
- Raskar, R., Welch, G., Low, K-L. and Bandyopadhyay, D. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. Proc. of the 12th Eurographics Workshop on Rendering Techniques, 89--102. Google ScholarDigital Library
- Reisman, J. L., Davidson, P. L. and Han, J. Y. 2009. Generalizing multi-touch direct manipulation. SIGGRAPH. Google ScholarDigital Library
- Saakes, D. 2010. Shape Does Matter - designing materials in products. Lulu Publishers.Google Scholar
- Shaer, O., Strait, M., Valdes, C., Feng, T., Lintz, M. and Wang, H. 2011. Enhancing genomic learning through tabletop interaction. Proc. of CHI '11, ACM. Google ScholarDigital Library
- Shneiderman, B. 1983. Direct Manipulation: A step beyond programming languages. IEEE Computer, 16, 57--69. Google ScholarDigital Library
- Spindler, M., Martsch, M. & Dachselt, R. 2012. Going beyond the surface: studying multi-layer interaction above the tabletop. CHI 2012. ACM, New York, NY, USA, 1277--1286. Google ScholarDigital Library
- Stavness, I., Lam, B. & Fels, S. 2010. pCubee: a perspective-corrected handheld cubic display. CHI '10. ACM, New York, NY, USA, 1381--1390. Google ScholarDigital Library
- Takeoka, Y., Miyaki, T. and Rekimoto, J. 2010. Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In Proc. Of ACM ITS '10. Google ScholarDigital Library
- Valbuena, P. 2007. Augmented Sculptures. http://www.pablovalbuena.com/p05.htm.Google Scholar
- Velsen, M., Williams, J. and Verhulsdonck, G. 2009. Table-Top Gaming Narratology for Digital Interactive Storytelling. Proc. of ICIDS '09, Springer-Verlag, Berlin, Heidelberg, 109--120. Google ScholarDigital Library
- Williams, C., Yang, X. D., Partridge, G., Millar-Usiskin, J., Major, A. and Irani, P. 2011. TZee: exploiting the lighting properties of multi-touch tabletops for tangible 3d interactions. Proc. of CHI '11. ACM Press 1363--1372. Google ScholarDigital Library
- Wu, W. and Balakrishnan, R. R. 2003. Multi-finger and whole hand gestural interaction techniques for multiuser tabletop displays. Proc. of UIST '03. ACM Press, 193--202. Google ScholarDigital Library
- Yoshida. S., Yano, S. and Ando, H. 2010. Implementation of a tabletop 3D display based on light field reproduction. Proc of SIGGRAPH '10, ACM Press, Article 61. 1 page. Google ScholarDigital Library
- Zimmerman, J., Forlizzi, J. and Evenson, S. 2007. Research through design as a method for interaction design research in HCI. Proc. of CHI '07, ACM Press, 493--502 Google ScholarDigital Library
Index Terms
- Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection
Recommendations
Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied InteractionMore and more objects of our everyday environment are becoming smart and connected, offering us new interaction possibilities. Tangible interaction and gestural interaction are promising communication means with these objects in this post-WIMP ...
Tangible tabletops and dual reality for crisis management: case study with mobile robots and dynamic tangible objects
AbstractIn this paper, we present an experimental study between tangible interaction and tactile interaction on tabletops in a dual reality environment. We recruited 32 participants to take part in a user study, which consists of remotely displacing ...
Impact of mobile tangible slider design and its reachability on pointing performance
IHM '16: Actes de la 28ième conference francophone sur l'Interaction Homme-MachineTouch interaction is almost omnipresent on mobile devices and technological advances have made screens bigger. The users can then interact with more content displayed on screen but it is more difficult for the users to reach all the parts of the screen ...
Comments