HyoJong Shin
Takeo Igarashi
ABSTRACT
Construction of a 3-D scene consisting of multiple objects can be tedious work. Existing 3-D editing tools require the user to choose an appropriate model in a database first and then carefully place it in the scene at a desired position combining various operations such as translation, rotation, and scaling. To simplify the process, we propose a system that takes simple 2D sketches of models in a scene as input for 3D scene construction. The system then automatically identifies corresponding models in a database and puts them in the appropriate location and posture so that their appearance matches the user's input sketches. The system combines a 3-D model search and a 3-D posture estimation to obtain the result. This system allows the user to construct a prototype of a 3-D scene quickly and intuitively.
We conducted a user study to compare our interface with traditional menu-based UI and verified that our system was useful for constructing a 3-D scene prototype, especially for facilitating the exploration of various alternative designs. We expect our system to be useful as a prototyping tool for 3-D scene construction in various application areas such as interior design, communication, education, and entertainment.
- Eggli, L., Ching-Yao, H., and Bruderlin, B. D. Inferring 3D models from freehand sketches and constraints. Computer-Aided Design 29 (2), 101--112, 1997.Google Scholar
Cross Ref
- Faugeras, O. Three-dimensional computer vision: A geometric viewpoint. MIT Press, Cambridge, MA, USA, 1993. Google ScholarDigital Library
- Fonseca, M., Barroso, B., Ribeiro, P., and Jorge, J. Sketch-based retrieval of clipart drawings. In AVI'04: Proceedings of the ACM Press, New York, NY, USA, 2004. Google ScholarDigital Library
- Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., and Jacobs, D. A search engine for 3D models. ACM Trans. Graph. 22(1), 83--105, 2003. Google ScholarDigital Library
- Gleicher, M., and Witkin, A. Through-the-lens camera control. In SIGGRAPH '92: Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, pp. 331--340. ACM Press, New York, NY, USA, 1992. Google ScholarDigital Library
- Igarashi, T., Matsuoka, S., and Tanaka, H. Teddy: A sketching interface for 3D freeform design. In Proceedings of SIGGRAPH '99, pp. 409--416. ACM Press, New York, NY, USA, 1999. Google ScholarDigital Library
- Ip, H. H. S., Cheng, A. K. Y., Wong, W. Y. F., and Feng, J. Affine-invariant sketch-based retrieval of images. In CGI '01: Proceedings of the international Conference on Computer Graphics, p. 55, IEEE Computer Society, Washington, DC, USA, 2001. Google ScholarDigital Library
- Owada, S., Nielsen, F., Okabe, M., and Igarashi, T. Volumetric illustration: Designing 3D models with internal textures. ACM Trans. Graph. 23(3), 322--328, 2004. Google ScholarDigital Library
- Pentland, A., and Kuo, J. The artist at the interface. Vision Science Technical Report 114, 18--26, 1989.Google Scholar
- Safar, M., Shahabi, C., and Sun, X. Image retrieval by shape: A comparative study. IEEE International Conference on Multimedia and Expo, pp. 141--144, 2000.Google ScholarCross Ref
- Shpitalni, M., and Lipson, H. Identification of faces in a 2D line drawing projection of a wireframe object. IEEE Trans. Pattern Anal. Mach. Intell., 18(19), 1000--1012, 1996. Google ScholarDigital Library
- Shpitalni, M., and Lipson, H. Optimization-based reconstruction of a 3D object from a single freehand line drawing. Computer-Aided Design, 28(8), 651--663, 1996.Google ScholarCross Ref
- Tanaka, T., Naito, S., and Takahashi, T. Generalized symmetry and its application to 3D shape generation. Visual Computer, 5(1-2), 83--94, 1989.Google ScholarCross Ref
- Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. SKETCH: An interface for sketching 3D scenes. In Proceedings of SIGGRAPH '96, pp. 163--170. ACM Press, New York, NY, USA, 1996. Google ScholarDigital Library
- Aaron, S, Faramarz, S, and Mario, C. S. Transformation strokes. In Proceedings of the 3rd Eurographics Workshop on Sketch-based Interface and Modeling, Vienna, Austria, September 2006.Google Scholar
- Karthik, R., and Suyu, H. Sketch-based 3D engineering part class browsing and retrieval. In EuroGraphics Symposium Proceedings on Sketch-based Interfaces and Modeling, 131--138, 2006. Google ScholarDigital Library
- Igarashi, T, and Hughes, J. F, A Suggestive Interface for 3D Drawing. 14th Annual Symposium on User Interface Software and Technology, ACM UIST'01, Orlando, FL, November 11--14, 2001 Google ScholarDigital Library
- Tolba, O., Dorsey, J., and Mcmillan, L.: Sketching with Projective 2D Strokes. In Proceedings of the ACM Symposium on User Interface Software and Technology, Asheville, NC. 1999. Google ScholarDigital Library
- Cohen J, M., Hughes, J, F, and Zeleznik R. C.: Harold: A World Made of Drawings, In Proceedings of NPAR, 2000, pp. 83--90. Google ScholarDigital Library
- Bourguignon, D., Cani, M, P, and Drettakis, G.: Drawing for Illustration and Annotation in 3D, Computer Graphics Forum, 20, 3 (2001), 114--122. (Proc. Eurographics '01)Google ScholarCross Ref
Index Terms
- Magic canvas: interactive design of a 3-D scene prototype from freehand sketches
Recommendations
Camera canvas: image editing software for people with disabilities
UAHCI'11: Proceedings of the 6th international conference on Universal access in human-computer interaction: applications and services - Volume Part IVWe developed Camera Canvas, photo editing and picture drawing software for individuals who cannot use their hands to operate a computer mouse. Camera Canvas is designed for use with camera-based mousereplacement interfaces that allow a user with severe ...
Dual Camera Magic Lens for Handheld AR Sketching
Human-Computer Interaction – INTERACT 2015AbstractOne challenge of supporting in-situ sketching tasks with Magic Lenses on handheld Augmented Reality systems is to provide accurate and robust pose tracking without disrupting the sketching experience. Typical tracking approaches rely on the back-...
User-perspective augmented reality magic lens from gradients
VRST '14: Proceedings of the 20th ACM Symposium on Virtual Reality Software and TechnologyIn this paper we present a new approach to creating a geometrically-correct user-perspective magic lens and a prototype device implementing the approach. Our prototype uses just standard color cameras, with no active depth sensing. We achieve this by ...
Comments