Chao-Hui Shen
Hongbo Fu
Shi-Min Hu
Skip Abstract Section
Abstract
This paper presents a technique that allows quick conversion of acquired low-quality data from consumer-level scanning devices to high-quality 3D models with labeled semantic parts and meanwhile their assembly reasonably close to the underlying geometry. This is achieved by a novel structure recovery approach that is essentially local to global and bottom up, enabling the creation of new structures by assembling existing labeled parts with respect to the acquired data. We demonstrate that using only a small-scale shape repository, our part assembly approach is able to faithfully recover a variety of high-level structures from only a single-view scan of man-made objects acquired by the Kinect system, containing a highly noisy, incomplete 3D point cloud and a corresponding RGB image.
- Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: shape completion and animation of people. ACM Trans. Graph. 24, 3, 408--416. Google Scholar
Digital Library
- Attene, M., Marini, S., Spagnuolo, M., and Falcidieno, B. 2011. Part-in-whole 3D shape matching and docking. The Visual Computer 27, 11, 991--1004. Google ScholarDigital Library
- Attene, M. 2010. A lightweight approach to repairing digitized polygon meshes. The Visual Computer 26, 11, 1393--1406. Google ScholarDigital Library
- Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3D faces. In SIGGRAPH '99, 187--194. Google ScholarDigital Library
- Canny, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679--698. Google ScholarDigital Library
- Chaudhuri, S., and Koltun, V. 2010. Data-driven suggestions for creativity support in 3D modeling. ACM Trans. Graph. 29, 6, 183:1--183:10. Google ScholarDigital Library
- Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Trans. Graph. 30, 6, 35:1--35:10. Google ScholarDigital Library
- Fu, H., Cohen-Or, D., Dror, G., and Sheffer, A. 2008. Upright orientation of man-made objects. ACM Trans. Graph. 27, 3, 42:1--42:7. Google ScholarDigital Library
- Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graph. 23, 3, 652--663. Google ScholarDigital Library
- Gal, R., Shamir, A., Hassner, T., Pauly, M., and Cohen-Or, D. 2007. Surface reconstruction using local shape priors. In SGP '07, 253--262. Google ScholarDigital Library
- Gal, R., Sorkine, O., Popa, T., Sheffer, A., and Cohen-Or, D. 2007. 3D collage: expressive non-realistic modeling. In NPAR '07, 7--14. Google ScholarDigital Library
- Gurari, E., 1999. Cis 680: Data structures: Chapter 19: Backtracking algorithms.Google Scholar
- Huang, Q., Koltun, V., and Guibas, L. 2011. Joint shape segmentation with linear programming. ACM Trans. Graph. 30, 6, 125:1--125:12. Google ScholarDigital Library
- Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinect-Fusion: real-time 3D reconstruction and interaction using a moving depth camera. In UIST '11, 559--568. Google ScholarDigital Library
- Jain, A., Thormählen, T., Ritschel, T., and Seidel, H.-P. 2012. Exploring shape variations by 3d-model decomposition and part-based recombination. Comp. Graph. Forum 31, 2. Google ScholarDigital Library
- Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. 29, 4, 102:1--102:12. Google ScholarDigital Library
- Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4, 55:1--55:11. Google ScholarDigital Library
- Kraevoy, V., and Sheffer, A. 2005. Template-based mesh completion. In SGP '05, 13--22. Google ScholarDigital Library
- Laga, H. 2011. Data-driven approach for automatic orientation of 3D shapes. The Visual Computer 27, 11, 977--989. Google ScholarDigital Library
- Lee, J., and Funkhouser, T. 2008. Sketch-based search and composition of 3D models. In EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling. Google ScholarDigital Library
- Li, Y., Wu, X., Chrysathou, Y., Sharf, A., Cohen-Or, D., and Mitra, N. J. 2011. GlobFit: consistently fitting primitives by discovering global relations. ACM Trans. Graph. 30, 4, 52:1--52:12. Google ScholarDigital Library
- Li, Y., Zheng, Q., Sharf, A., Cohen-Or, D., Chen, B., and Mitra, N. J. 2011. 2D-3D fusion for layer decomposition of urban facades. In ICCV '11. Google ScholarDigital Library
- Lin, J., Jin, X., and Wang, C. C. L. 2010. Fusion of disconnected mesh components with branching shapes. The Visual Computer 26, 6--8, 1017--1025. Google ScholarDigital Library
- Mitra, N. J., Guibas, L. J., and Pauly, M. 2006. Partial and approximate symmetry detection for 3D geometry. ACM Trans. Graph. 25, 3, 560--568. Google ScholarDigital Library
- Mitra, N. J., Guibas, L. J., and Pauly, M. 2007. Symmetrization. ACM Trans. Graph. 26, 3, 63:1--63:8. Google ScholarDigital Library
- Ovsjanikov, M., Li, W., Guibas, L., and Mitra, N. J. 2011. Exploration of continuous variability in collections of 3D shapes. ACM Trans. Graph. 30, 4, 33:1--33:10. Google ScholarDigital Library
- Pauly, M., Mitra, N. J., Giesen, J., Gross, M., and Guibas, L. J. 2005. Example-based 3D scan completion. In SGP '05. Google ScholarDigital Library
- Rother, C., Kolmogorov, V., and Blake, A. 2004. Grab-Cut: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 3, 309--314. Google ScholarDigital Library
- Schnabel, R., Wahl, R., and Klein, R. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26, 2, 214--226.Google ScholarCross Ref
- Schnabel, R., Degener, P., and Klein, R. 2009. Completion and reconstruction with primitive shapes. Computer Graphics Forum 28, 2, 503--512.Google ScholarCross Ref
- Shalom, S., Shamir, A., Zhang, H., and Cohen-Or, D. 2010. Cone carving for surface reconstruction. ACM Trans. Graph. 29, 6, 150:1--150:10. Google ScholarDigital Library
- Shao, T., Xu, W., Yin, K., Wang, J., Zhou, K., and Guo, B. 2011. Discriminative sketch-based 3D model retrieval via robust shape matching. Computer Graphics Forum 30, 7, 2011--2020.Google ScholarCross Ref
- Sharf, A., Alexa, M., and Cohen-Or, D. 2004. Context-based surface completion. ACM Trans. Graph. 23, 3, 878--887. Google ScholarDigital Library
- Shen, C.-H., Zhang, G.-X., Lai, Y.-K., Hu, S.-M., and Martin, R. R. 2010. Harmonic field based volume model construction from triangle soup. Journal of Computer Science and Technology 25, 3, 562--571. Google ScholarDigital Library
- Shin, H., and Igarashi, T. 2007. Magic canvas: interactive design of a 3-D scene prototype from freehand sketches. In GI '07, 63--70. Google ScholarDigital Library
- Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. 2011. Real-time human pose recognition in parts from single depth images. In CVPR '11, 1297--1304. Google ScholarDigital Library
- Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., and Cohen-Or, D. 2011. Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Trans. Graph. 30, 6, 126:1--126:10. Google ScholarDigital Library
- Sun, J., Kang, S., Xu, Z., Tang, X., and Shum, H. 2007. Flash cut: Foreground extraction with flash and no-flash image pairs. In CVPR'07, 1--8.Google Scholar
- Theobalt, C., Röessl, C., de Aguiar, E., and Seidel, H.-P. 2007. Animation collage. In SCA '07, 271--280. Google ScholarDigital Library
- Tong, J., Zhou, J., Liu, L., Pan, Z., and Yan, H. 2012. Scanning 3D full human bodies using kinects. IEEE Transactions on Visualization and Computer Graphics 18, 4, 643--650. Google ScholarDigital Library
- Weise, T., Bouaziz, S., Li, H., and Pauly, M. 2011. Realtime performance-based facial animation. ACM Trans. Graph. 30, 4, 77:1--77:10. Google ScholarDigital Library
- Weiss, A., Hirshberg, D., and Black, M. J. 2011. Home 3D body scans from noisy image and range data. In ICCV '11. Google ScholarDigital Library
- Wu, J., and Kobbelt, L. 2005. Structure recovery via hybrid variational surface approximation. Computer Graphics Forum 24, 3, 277--284.Google ScholarCross Ref
- Xu, K., Zheng, H., Zhang, H., Cohen-Or, D., Liu, L., and Xiong, Y. 2011. Photo-inspired model-driven 3D object modeling. ACM Trans. Graph. 30, 4, 80:1--80:10. Google ScholarDigital Library
- Xu, K., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Fit and diverse: Set evolution for inspiring 3D shape galleries. ACM Transactions on Graphics 31, 4, 57:1--57:10. Google ScholarDigital Library
- Zheng, Q., Sharf, A., Wan, G., Li, Y., Mitra, N., Cohen-Or, D., and Chen, B. 2010. Non-local scan consolidation for 3D urban scenes. ACM Trans. Graph. 29, 3, 94:1--94:9. Google ScholarDigital Library
- Zheng, Y., Fu, H., Cohen-Or, D., Au, O. K.-C., and Tai, C.-L. 2011. Component-wise controllers for structure-preserving shape manipulation. Computer Graphics Forum 30, 2, 563--572.Google ScholarCross Ref
- Zheng, Y., Chen, X., Cheng, M.-M., Zhou, K., Hu, S.-M., and Mitra, N. J. 2012. Interactive images: Cuboid proxies for smart image manipulation. ACM Trans. Graph. 31, 4, 99:1--99:11. Google ScholarDigital Library
Index Terms
- Structure recovery by part assembly
Recommendations
Recovery of Lost Color and Depth Frames in Multiview Videos
In this paper, we consider an integrated error concealment system for lost color frames and lost depth frames in multiview videos with depths. We first proposed a pixel-based color error-concealment method with the use of depth information. Instead of ...
Correct assembly sequence for robotic assembly using motion instability and part contact-level graphs
Determination of correct and stable assembly sequence is a must for automated assembly systems. The present work is a novel approach for generation of robotic assembly precedence constraints using directional part contact-level. This contains the ...
3D Reconstruction of Paper Based Assembly Drawings: State of the Art and Approach
GREC '01: Selected Papers from the Fourth International Workshop on Graphics Recognition Algorithms and ApplicationsEngineering solutions are generally documented in assembly and part drawings and bill of materials. A great benefit, qualitatively and commercially, can be achieved if these paper based storages can be transformed into digital information archives. The ...
Comments