Daniel Leithinger
David Lakatos
Hiroshi Ishii
ABSTRACT
Actuated shape output provides novel opportunities for experiencing, creating and manipulating 3D content in the physical world. While various shape displays have been proposed, a common approach utilizes an array of linear actuators to form 2.5D surfaces. Through identifying a set of common interactions for viewing and manipulating content on shape displays, we argue why input modalities beyond direct touch are required. The combination of freehand gestures and direct touch provides additional degrees of freedom and resolves input ambiguities, while keeping the locus of interaction on the shape output. To demonstrate the proposed combination of input modalities and explore applications for 2.5D shape displays, two example scenarios are implemented on a prototype system.
Supplemental Material
- Benali Khoudja, M., Hafez, M., Alexandre, J.M., Khed-dar, A. Tactile Interfaces: A State of the Art Survey. In Proceedings of the International Symposium on Robotics (2004), 721--72.Google Scholar
- Benko, H., and Wilson, A. 2010. Multi-point interactions with immersive omnidirectional visualizations in a dome. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 19--28. Google ScholarDigital Library
- Coelho, M., Ishii, H., and Maes, P. 2008. Surflex: a programmable surface for the design of tangible interfaces. In CHI '08 extended abstracts on Human factors in computing systems (CHI EA '08). ACM, New York, NY, USA, 3429--3434. Google ScholarDigital Library
- Francica, J., 2004. Interview with Xenotran Founder, Dr. Derrick Page. In Directions Magazine. November 21st 2004, http://www.directionsmag.com/articles/interview-with-xenotran-founder-drderrick-page/12359.Google Scholar
- Gargus, J., Kim, B., Rossignac, R., and Shaw, D. 2002. Finger Sculpting with Digital Clay. GVU Technical Re-port, GIT-GVU-02--2.Google Scholar
- Goldstein, S., Campbell, J., and Mowry, T. Programmable Matter. In IEEE Computer, 38(6): 99--101, June, 2005. Google ScholarDigital Library
- Goulthorpe, M., Burry, M., and Dunlop, G. Aegis Hyposurface: The Bordering of University and Practice. In Proc. of ACADIA, 2001, Association for Computer--Aided Design in Architecture, pp. 344--349.Google Scholar
- Grossman, T., Wigdor, D., and Balakrishnan, R. 2004. Multi-finger gestural interaction with 3d volumetric displays. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST '04). ACM, New York, NY, USA, 61--70. Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. 2009. Interactions in the air: adding further depth to interactive tabletops. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 139--148. Google ScholarDigital Library
- Hirota, K., Hirose, M. Simulation and presentation of curved surface in virtual reality environment through surface display. In Proceedings of the Virtual Reality Annual International Symposium (VRAIS '95). IEEE Computer Society, Washington, DC, USA, 211--21. Google ScholarDigital Library
- Ishii, H. and Ullmer, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI '97). ACM, New York, NY, USA, 234--241. Google ScholarDigital Library
- Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th Annual Conference on Computer Graphics and interactive Techniques SIGGRAPH '01. ACM, New York, NY, 469--476. Google ScholarDigital Library
- Iwata, H., Yano, H., and Ono, N. 2005. Volflex. In ACM SIGGRAPH 2005 Emerging technologies (SIGGRAPH '05), Donna Cox (Ed.). ACM, New York, NY, USA, 2005, Article 3. Google ScholarDigital Library
- Leithinger, D., and Ishii, H. 2010. Relief: a scalable actuated shape display. In Proceedings of the fourth international conference on Tangible, embedded, and em-bodied interaction (TEI '10). ACM, New York, NY, USA, 221--222. Google ScholarDigital Library
- Nakatani, M., Kajimoto, H., Sekiguchi, D., Kawakami, N., and Tachi, S. 3D form display with shape memory alloy. In Proc. 13th International Conference on Artificial Reality and Telexistence, Tokyo, Japan, 2003, pp. 179--18.Google Scholar
- Nakatani, M., Kajimoto, H., Kawakami, N., and Tachi, S. 2005. Tactile sensation with high-density pin-matrix. In Proceedings of the 2nd symposium on Applied perception in graphics and visualization (APGV '05). ACM, New York, NY, USA, 169--169. Google ScholarDigital Library
- Niiyama, R. and Kawaguchi, Y. Gemotion Screen: A Generative, Emotional, Interactive 3D Display. In Proceeding of the ASIAGRAPH 2008 in Shanghai, pp.115--120, Shanghai, China, July 200.Google Scholar
- Oguchi, R., Kakehi, Y., Takahashi, K., and Naemura, T. 2008. Photonastic surface: pin matrix type display controlled with light. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (ACE '08). ACM, New York, NY, USA, 396--396. Google ScholarDigital Library
- Page, D. J. (2005). Reconfigurable Surface. US Patent No. 6903871 B2.Google Scholar
- Poupyrev, I., Nashida, T., Maruyama, S., Rekimoto, J., and Yamaji, Y. 2004. Lumen: interactive visual and shape display for calm computing. In ACM SIGGRAPH 2004 Emerging Technologies (Los Angeles, California, August 08 - 12, 2004). H. Elliott-Famularo, Ed. SIGGRAPH '04. ACM, New York, NY, 17. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., Okabe, M. Actuation and Tangible User Interfaces: the Vaucanson Duck, Robots, and Shape Displays. Proceedings of TEI'07. 2007: ACM: pp. 205--212. Google ScholarDigital Library
- Rossignac, J., Allen, M., Book, W., Glezer, A., Ebert-Uphoff, I., Shaw, C., Rosen, D., Askins, S., Bai, J., Bosscher, P., Gargus, J., Kim, B.-M., Llamas, I., Nguyen, A., Yuan, G., Zhu, H. 2003. Finger Sculpting with Digital Clay: 3D Shape Input and Output through a Computer-Controlled Real Surface. smi, International Conference on Shape Modeling and Applications 2003, pp. 29. Google ScholarDigital Library
- Shimojo, M.; Shinohara, M.; Fukui, Y. Human shape recognition performance for 3D tactile display. In IEEE International Conference on Systems, Man, and Cybernetics, 1997, vol.4, no., pp.3192--3197 vol.4, 12--15 Oct 199.Google ScholarCross Ref
- Sutherland, I. The Ultimate Display. In International Federation of Information Processing, Vol. 2, 1965, pp. 506--508.Google Scholar
- Ward, F. (1985). Pin Screen. US Patent No. 4536980.Google Scholar
- Weibel, R. & Heller, M. 1991. Digital Terrain Modeling. In: Maguire, D.J., Goodchild, M.F. and Rhind, D.W. (eds.). Geographical Information Systems: Prin-ciples and Applications. London: Longman, 269--297.Google Scholar
- Wilson, A. 2006. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 255--258. Google ScholarDigital Library
- Zigelbaum, J., Browning, A., Leithinger, D., Bau, O., and Ishii, H. 2010. g-stalt: a chirocentric, spatiotemporal, and telekinetic gestural interface. In Proceedings of the fourth international conference on Tangible, em-bedded, and embodied interaction (TEI '10). ACM, New York, NY, USA, 261--264. Google ScholarDigital Library
Index Terms
- Direct and gestural interaction with relief: a 2.5D shape display
Recommendations
Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsRecent research in 3D user interfaces pushes towards immersive graphics and actuated shape displays. Our work explores the hybrid of these directions, and we introduce sublimation and deposition, as metaphors for the transitions between physical and ...
Relief: a scalable actuated shape display
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interactionRelief is an actuated tabletop display, which is able to render and animate three-dimensional shapes with a malleable surface. It allows users to experience and form digital models like geographical terrain in an intuitive manner. The tabletop surface ...
Recompose: direct and gestural interaction with an actuated surface
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsIn this paper we present Recompose, a new system for manipulation of an actuated surface. By collectively utilizing the body as a tool for direct manipulation alongside gestural input for functional manipulation, we show how a user is afforded ...
Comments