Skip to main content
Top

2018 | OriginalPaper | Chapter

Part Detection for 3D Shapes via Multi-view Rendering

Authors : Youcheng Song, Zhengxing Sun, Mofei Song, Yunjie Wu

Published in: Advances in Multimedia Information Processing – PCM 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a novel way of shape structure analysis namely part detection, which provides the positions and categories of all potential parts for any input shape. Different from segmentation, part detection does not provide precise shape part boundaries, but rather gives the bounding boxes and semantic labels of shape parts. This is useful for applications like style discovery, retrieval, visualization, etc. Part detection is achieved by multi-view rendering in this paper. Firstly, our method renders 3D shape into images under different perspectives, and detects the potential parts (as boxes) in the images using Faster R-CNN. Then, each detection result votes for the visible vertices in its own box under the corresponding perspective. Finally, we select the vertices for each part category according to the voting result, and generate the bounding boxes. The performance of this approach on a database of 16 shape categories is demonstrated in the end of paper.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Attene, M., Biasotti, S., Mortara, M., Patanè, G., Spagnuolo, M., Falcidieno, B.: Computational methods for understanding 3D shapes. Comput. Graph. 30(3), 323–333 (2006)CrossRef Attene, M., Biasotti, S., Mortara, M., Patanè, G., Spagnuolo, M., Falcidieno, B.: Computational methods for understanding 3D shapes. Comput. Graph. 30(3), 323–333 (2006)CrossRef
2.
go back to reference Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al.: Shapenet: an information-rich 3D model repository. arXiv preprint arXiv:1512.03012 (2015) Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al.: Shapenet: an information-rich 3D model repository. arXiv preprint arXiv:​1512.​03012 (2015)
3.
go back to reference Fish, N., Averkiou, M., van Kaick, O., Sorkine-Hornung, O., Cohen-Or, D., Mitra, N.J.: Meta-representation of shape families. ACM Trans. Graph. 33(4), 1–11 (2014)CrossRef Fish, N., Averkiou, M., van Kaick, O., Sorkine-Hornung, O., Cohen-Or, D., Mitra, N.J.: Meta-representation of shape families. ACM Trans. Graph. 33(4), 1–11 (2014)CrossRef
4.
go back to reference Fu, H., Cohen-Or, D., Dror, G., Sheffer, A.: Upright orientation of man-made objects. ACM Trans. Graph. 27(3), 1 (2008)CrossRef Fu, H., Cohen-Or, D., Dror, G., Sheffer, A.: Upright orientation of man-made objects. ACM Trans. Graph. 27(3), 1 (2008)CrossRef
5.
go back to reference Han, Z., Liu, Z., Han, J., Bu, S.: 3D shape creation by style transfer. Vis. Comput. 31, 1147–1161 (2014)CrossRef Han, Z., Liu, Z., Han, J., Bu, S.: 3D shape creation by style transfer. Vis. Comput. 31, 1147–1161 (2014)CrossRef
6.
go back to reference Makadia, A., Yumer, M.E.: Learning 3D part detection from sparsely labeled data. In: 2014 2nd International Conference on 3D Vision, pp. 311–318. IEEE, December 2014 Makadia, A., Yumer, M.E.: Learning 3D part detection from sparsely labeled data. In: 2014 2nd International Conference on 3D Vision, pp. 311–318. IEEE, December 2014
7.
go back to reference Mitra, N., Wand, M., Zhang, H.R., Cohen-Or, D., Kim, V., Huang, Q.X.: Structure-aware shape processing. In: SIGGRAPH Asia 2013 Courses on - SA 2013, pp. 1–20. ACM Press, New York (2013) Mitra, N., Wand, M., Zhang, H.R., Cohen-Or, D., Kim, V., Huang, Q.X.: Structure-aware shape processing. In: SIGGRAPH Asia 2013 Courses on - SA 2013, pp. 1–20. ACM Press, New York (2013)
8.
go back to reference Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311–317 (1975)CrossRef Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311–317 (1975)CrossRef
9.
go back to reference Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28, pp. 91–99. Curran Associates, Inc. (2015) Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28, pp. 91–99. Curran Associates, Inc. (2015)
10.
go back to reference Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.: Multi-view convolutional neural networks for 3D shape recognition. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 945–953. IEEE, December 2015 Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.: Multi-view convolutional neural networks for 3D shape recognition. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 945–953. IEEE, December 2015
11.
go back to reference Yi, L., Kim, V.G., Ceylan, D., Shen, I.C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., Guibas, L.: A scalable active framework for region annotation in 3D shape collections. In: SIGGRAPH Asia (2016)CrossRef Yi, L., Kim, V.G., Ceylan, D., Shen, I.C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., Guibas, L.: A scalable active framework for region annotation in 3D shape collections. In: SIGGRAPH Asia (2016)CrossRef
12.
go back to reference Zheng, Y., Cohen-Or, D., Mitra, N.J.: Smart variations: functional substructures for part compatibility. Comput. Graph. Forum 32(2pt2), 195–204 (2013)CrossRef Zheng, Y., Cohen-Or, D., Mitra, N.J.: Smart variations: functional substructures for part compatibility. Comput. Graph. Forum 32(2pt2), 195–204 (2013)CrossRef
Metadata
Title
Part Detection for 3D Shapes via Multi-view Rendering
Authors
Youcheng Song
Zhengxing Sun
Mofei Song
Yunjie Wu
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-77380-3_59