skip to main content
research-article

A probabilistic model for component-based shape synthesis

Published:01 July 2012Publication History
Skip Abstract Section

Abstract

We present an approach to synthesizing shapes from complex domains, by identifying new plausible combinations of components from existing shapes. Our primary contribution is a new generative model of component-based shape structure. The model represents probabilistic relationships between properties of shape components, and relates them to learned underlying causes of structural variability within the domain. These causes are treated as latent variables, leading to a compact representation that can be effectively learned without supervision from a set of compatibly segmented shapes. We evaluate the model on a number of shape datasets with complex structural variability and demonstrate its application to amplification of shape databases and to interactive shape synthesis.

Skip Supplemental Material Section

Supplemental Material

tp152_12.mp4

mp4

22.8 MB

References

  1. Aliaga, D. G., Rosen, P. A., and Bekins, D. R. 2007. Style grammars for interactive visualization of architecture. IEEE Transactions on Visualization and Computer Graphics 13, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics 22, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: shape completion and animation of people. ACM Transactions on Graphics 24, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3D faces. In Proc. SIGGRAPH, ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bokeloh, M., Wand, M., and Seidel, H.-P. 2010. A connection between partial symmetry and inverse procedural modeling. ACM Transactions on Graphics 29, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bouchard, G., and Triggs, B. 2005. Hierarchical part-based visual object categorization. In Proc. IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chaudhuri, S., and Koltun, V. 2010. Data-driven suggestions for creativity support in 3D modeling. ACM Transactions on Graphics 29, 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Transactions on Graphics 30, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Cheeseman, P., and Stutz, J. 1996. Bayesian classification (autoclass): Theory and results. Advances in Knowledge Discovery and Data Mining. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chen, D.-Y., Tian, X.-P., Shen, Y.-T., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. Computer Graphics Forum 22, 3.Google ScholarGoogle ScholarCross RefCross Ref
  11. Chennubhotla, C., and Jepson, A. 2001. S-PCA: Extracting multi-scale structure from data. In Proc. International Conference on Computer Vision.Google ScholarGoogle Scholar
  12. Fidler, S., and Leonardis, A. 2007. Towards scalable representations of object categories: Learning a hierarchy of parts. In Proc. IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarGoogle Scholar
  13. Fu, H., Cohen-Or, D., Dror, G., and Sheffer, A. 2008. Upright orientation of man-made objects. ACM Transactions on Graphics 27, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Transactions on Graphics 23, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Huang, Q., Koltun, V., and Guibas, L. 2011. Joint shape segmentation with linear programming. ACM Transactions on Graphics 30, 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jain, A., Thormahlen, T., Ritschel, T., and Seidel, H.-P. 2012. Exploring shape variations by 3D-model decomposition and part-based recombination. Computer Graphics Forum 31, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jin, Y., and Geman, S. 2006. Context and hierarchy in a probabilistic image model. In Proc. IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Transactions on Graphics 29, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Koller, D., and Friedman, N. 2009. Probabilistic Graphical Models: Principles and Techniques. The MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kraevoy, V., Julius, D., and Sheffer, A. 2007. Model composition from interchangeable components. In Proc. Pacific Graphics, IEEE Computer Society. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Lee, J., and Funkhouser, T. 2008. Sketch-based search and composition of 3D models. In Proc. Eurographics Workshop on Sketch-Based Interfaces and Modeling. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Merrell, P., and Manocha, D. 2011. Model synthesis: A general procedural modeling algorithm. IEEE Transactions on Visualization and Computer Graphics 17, 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Merrell, P. 2007. Example-based model synthesis. In Proc. Symposium on Interactive 3D Graphics, ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ommer, B., and Buhmann, J. 2010. Learning the compositional nature of visual object categories for recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Ovsjanikov, M., Li, W., Guibas, L., and Mitra, N. J. 2011. Exploration of continuous variability in collections of 3D shapes. ACM Transactions on Graphics 30, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ranzato, M. A., Susskind, J., Mnih, V., and Hinton, G. 2011. On deep generative models with applications to recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Roux, N. L., Heess, N., Shotton, J., and Winn, J. 2011. Learning a generative model of images by factoring appearance and shape. Neural Computation, 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sharf, A., Blumenkrants, M., Shamir, a., and Cohen-Or, D. 2006. SnapPaste: an interactive technique for easy mesh composition. Visual Computer 22, 9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., and Cohen-Or, D. 2011. Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Transactions on Graphics 30, 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Stava, O., Beneš, B., Měch, R., Aliaga, D., and Kristof, P. 2010. Inverse procedural modeling by automatic generation of L-systems. Computer Graphics Forum 29, 2.Google ScholarGoogle Scholar
  31. Todorovic, S., and Ahuja, N. 2008. Unsupervised category modeling, recognition, and segmentation in images. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Tu, Z., Chen, X., Yuille, A. L., and Zhu, S.-C. 2005. Image parsing: Unifying segmentation, detection, and recognition. International Journal of Computer Vision 63, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Wessel, R., Blümel, I., and Klein, R. 2009. A 3d shape benchmark for retrieval and automatic classification of architectural data. In Eurographics 2009 Workshop on 3D Object Retrieval. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Xu, K., Zheng, H., Zhang, H., Cohen-Or, D., Liu, L., and Xiong, Y. 2011. Photo-inspired model-driven 3D object modeling. ACM Transactions on Graphics 30, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Zhu, L. L., Lin, C., Huang, H., Chen, Y., and Yuille, A. L. 2008. unsupervised structure learning: Hierarchical recursive composition, suspicious coincidence and competitive exclusion. In Proc. European Conference on Computer Vision. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A probabilistic model for component-based shape synthesis

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 31, Issue 4
        July 2012
        935 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/2185520
        Issue’s Table of Contents

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 July 2012
        Published in tog Volume 31, Issue 4

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader