Jia Sheng
ABSTRACT
We explore the design space of using direct finger input in conjunction with a deformable physical prop for the creation and manipulation of conceptual 3D geometric models. The user sculpts virtual models by manipulating the space on, into, and around the physical prop, in an extension of the types of manipulations one would perform on traditional modeling media such as clay or foam. The prop acts as a proxy to the virtual model and hence as a frame of reference to the user's fingers. A prototype implementation uses camera-based motion tracking technology to track passive markers on the fingers and prop. The interface supports a variety of clay-like sculpting operations including deforming, smoothing, pasting, and extruding. All operations are performed using the unconstrained fingers, with command input enabled by a small set of finger gestures coupled with on-screen widgets.
- Anderson, D., Yedidia, J., Frankel, J., Marks, J., Agarwala, A., Beardsley, P., Hodgins, J., Leigh, D., Ryall, K., & Sullivan, E. (2000). Tangible interaction + graphical interpretation: a new approach to 3D modeling. SIGGRAPH. p. 393--402.]] Google Scholar
Digital Library
- Angelidis, A., Cani, M.-P., Wyvill, G., & King, S. (2004). Swirling-Sweepers: Constant-volume modeling. Pacific Graphics, p. 10--15.]] Google ScholarDigital Library
- Angelidis, A., Wyvill, G., & Cani, M.-P. (2004). Sweepers: Swept user-defined tools for modeling by deformation. Shape Modeling International, p. 63--73.]] Google ScholarDigital Library
- Barr, A. (1984). Global and local deformations of solid primitives. Computer Graphics, 18(3). p. 21--30.]] Google ScholarDigital Library
- Bourguignon, D., Chaine, R., Cani, M.-P., & Drettakis, G. (2004). Relief: A modeling by drawing tool. Eurographics Sketch-based Interfaces and Modeling, p. 151--160.]]Google Scholar
- Cao, X. & Balakrishnan, R. (2003). VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. UIST. p. 173--182.]] Google ScholarDigital Library
- Conner, B., Snibbe, S. S., Herndon, K. P., Robbins, D., Zeleznik, R., and Dam, A. v. (1992). Three dimensional widgets. Computer Graphics, 22(4). p. 121--129.]]Google Scholar
- Deering, M. (1995). HoloSketch: a virtual reality sketching/animation tool. ACM TOCHI, 2(3). p. 220--238.]] Google ScholarDigital Library
- Desbrun, M., Meyer, M., Schroder, P., & Barr, A. (1999). Implicit fairing of irregular meshes using diffusion and curvature flow. SIGGRAPH. p. 317--324.]] Google ScholarDigital Library
- Dewaele, G. & Cani, M.-P. (2004). Interactive global and local deformations for virtual clay. Graphical Models, 66. p. 352--269.]] Google ScholarDigital Library
- Dewaele, G. & Cani, M.-P. (2004). Virtual clay for direct hand manipulation. Eurographics (Short Papers).]]Google Scholar
- Ferley, E., Cani, M., & Gascuel, J. (2000). Practical volumetric scuplting. The Visual Computer, 16. p. 469--480.]]Google Scholar
- Fitzmaurice, G., Ishii, FL, & Buxton, W. (1995). Bricks: Laying the foundations for graspable user interfaces. CHI. p. 442--449.]] Google ScholarDigital Library
- Freeman, W. & Weissman, C. (1995). Television control by hand gestures. International Workshop on Automatic Face and Gesture Recognition, p. 179--183.]]Google Scholar
- Galyean, T. & Hughes, J. (1991). Sculpting: An interactive volume modeling technique. SIGGRAPH. p. 267--274.]] Google ScholarDigital Library
- Grossman, T., Balakrishnan, R., & Singh, K. (2003). An interface for creating and manipulating curves using a high degree-of-freedom input device. CHI. p. 185--192.]] Google ScholarDigital Library
- Grossman, T., Wigdor, D., & Balakrishnan, R. (2004). Multi finger gestural interaction with 3D volumetric displays. UIST. p. 61--70.]] Google ScholarDigital Library
- Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4). p. 486--517.]]Google ScholarCross Ref
- Hinckley, K., Pausch, R., Goble, J., & Kassell, N. (1994). Passive real-world interface props for neurosurgical visualization. CHI. p. 452--458.]] Google ScholarDigital Library
- Igarashi, T. & Hughes, J. (2001). A suggestive interface for 3D drawing. UIST. p. 173--181.]] Google ScholarDigital Library
- Igarashi, T., Matsuoka, S., & Tanaka, H. (1999). Teddy: a sketching interface for 3D freeform design. SIGGRAPH. p. 409--416.]] Google ScholarDigital Library
- Ishii, H. & Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms. CHI. p. 234--241.]] Google ScholarDigital Library
- Ix, F., El-Sana, J., Qin, H., & Kaufman, A. (1999). Haptic sculpting of dynamic surfaces. ACM Symposium on Interactive 3D Graphics, p. 103--110.]] Google ScholarDigital Library
- Kobbelt, L., Campagna, S., Vorsatz, J., & Seidel, H. (1998). Interactive multiresolution modeling on arbitrary meshes. SIGGRAPH. p. 105--114.]] Google ScholarDigital Library
- Llamas, I., Kim, B., Gargus, J., Rossignac, J., & Shaw, C. D. (2003). Twister: a space-warp operator for the two-handed editing of 3D shapes. SIGGRAPH. p. 663--668.]] Google ScholarDigital Library
- McDonnell, K., Qin, H., & Wlodarczyk, R. (2001). Virtual clay: A real-time sculpting system with haptic toolkits. ACM Symposium on Interactive 3D Graphics, p. 179--190.]] Google ScholarDigital Library
- Molteni, M. (1992). The clay modeling handbook: Learning from the masters. NY: Clarkson Potter Publishers.]]Google Scholar
- Nealen, A., Sorkine, O., Alexa, M., & Cohen-Or, D. (2005). A sketch-based interface for detail-preserving mesh editing. ACM Transactions on Graphics, 24(3). p. 1142--1147.]] Google ScholarDigital Library
- Nishmo, H., Utsumiya, K., & Korida, K. (1998). 3D object modeling using spatial and pictographic gestures. ACM Symp. on Virtual Reality Software and Technology, p. 51--58.]] Google ScholarDigital Library
- Pavlovic, V., Sharma, R., & Huang, T. (1997). Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans PAMI, 19(7). p. 677--695.]] Google ScholarDigital Library
- Perry, R. & Frisken, S. (2001). Kizamu: a system for sculpting digital characters. SIGGRAPH. p. 47--56.]] Google ScholarDigital Library
- Piper, B., Ratti, C., & Ishii, H. (2002). Illuminating clay: A 3D tangible interface for landscape analysis. CHI. p. 355--362.]] Google ScholarDigital Library
- Ringel, M., Berg, H., Jin, Y., & Winograd, T. (2001). Barehands: implement-free interaction with a wall-mounted display. CHI Extended Abstracts, p. 367--368.]] Google ScholarDigital Library
- Rossignac, J., Allen, M., Book, W., Glezer, A., Ebert-Uphoff, I., Shaw, C., Rosen, D., Askins, S., Bai, J., Paul Bosscher, Gargus, J., Kim, B., Llamas, I., Nguyen, A., Yuan, G., & Zhu, H. (2003). Finger sculpting with digital clay: 3D shape input and output through a computer-controlled real surface. Shape Modeling International, p. 229.]] Google ScholarDigital Library
- Sachs, E., Roberts, A., & Stoops, D. (1991). 3-draw: A tool for designing 3D shapes. IEEE Computer Graphics and Applications, 11(6). p. 18--26.]] Google ScholarDigital Library
- Schkolne, S., Pruett, M., & Schroeder, P. (2001). Surface drawing: Creating organic 3D shapes with the hand and tangible tools. CHI. p. 261--268.]] Google ScholarDigital Library
- Sederberg, T. & Parry, S. (1986). Free-form deformation of solid geometric models. SIGGRAPH. p. 151--160.]] Google ScholarDigital Library
- Segen, J. & Kumar, S. (1998). Gesture VR: Vision-based 3D hand interface for spatial interaction. Multimedia, p. 455--464.]] Google ScholarDigital Library
- Shaw, C. & Green, M. (1994). Two handed polygonal surface design. UIST. p. 205--212.]] Google ScholarDigital Library
- Tsang, S., Balakrishnan, R., Singh, K., & Ranjan, A. (2004). A suggestive interface for image guided 3D sketching. CHI. p. 591--598.]] Google ScholarDigital Library
- Wang, S. & Kaufman, A. (1995). Volume Sculpting. ACM Symposium on Interactive 3D Graphics, p. 151--156.]] Google ScholarDigital Library
- Yagou, H., Ohtake, Y., & Belyaev, A. (2002). Mesh smoothing via mean and median filtering applied to face normals. IEEE Geometric Modeling and Processing Theory and Applications Conference, p. 124--131.]] Google ScholarDigital Library
- Zelezink, R. C., Herndon, K., & Hughes, J. (1996). SKETCH: An interface for sketching 3D scenes. SIGGRAPH. p. 163--170.]] Google ScholarDigital Library
Index Terms
- An interface for virtual 3D sculpting via physical proxy
Recommendations
HandPainter - 3D Sketching in VR with Hand-based Physical Proxy
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems3D sketching in virtual reality (VR) enables users to create 3D virtual objects intuitively and immersively. However, previous studies showed that mid-air drawing may lead to inaccurate sketches. To address this issue, we propose to use one hand as a ...
Non-Touch Hand Gesture Based Interface Design for 3D Sculpting System
HCIK '16: Proceedings of HCI KoreaGesture recognition technology provides new types of interaction from content consumption domain to productivity domain. The natural hand gesture is also applicable for art and design such as non-touch 3D sculpting system. This study aims to analyze ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Comments