Skip to main content
Top

2018 | OriginalPaper | Chapter

Object Proposal via Depth Connectivity Constrained Grouping

Authors : Yuantian Wang, Lei Huang, Tongwei Ren, Sheng-Hua Zhong, Yan Liu, Gangshan Wu

Published in: Advances in Multimedia Information Processing – PCM 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Object proposal aims to detect category-independent object candidates with a limited number of bounding boxes. In this paper, we propose a novel object proposal method on RGB-D images with the constraint of depth connectivity, which can improve the key techniques in grouping based object proposal effectively, including segment generation, hypothesis expansion and candidate ranking. Given an RGB-D image, we first generate segments using depth aware hierarchical segmentation. Next, we combine the segments into hypotheses hierarchically on each level, and further expand these hypotheses to object candidates using depth connectivity constrained region growing. Finally, we score the object candidates based on their color and depth features, and select the ones with the highest scores as the object proposal result. We validated the proposed method on the largest RGB-D image data set for object proposal, and our method is superior to the state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alexe, B., Deselaers, T., Ferrari, V.: Measuring the objectness of image windows. TPAMI 34, 2189–2202 (2012)CrossRef Alexe, B., Deselaers, T., Ferrari, V.: Measuring the objectness of image windows. TPAMI 34, 2189–2202 (2012)CrossRef
2.
go back to reference Arbeláez, P.: Boundary extraction in natural images using ultrametric contour maps. In: CVPR Workshop, p. 182 (2006) Arbeláez, P.: Boundary extraction in natural images using ultrametric contour maps. In: CVPR Workshop, p. 182 (2006)
3.
go back to reference Arbeláez, P., Pont-Tuset, J., Barron, J.T., Marques, F., Malik, J.: Multiscale combinatorial grouping. In: CVPR, pp. 328–335 (2014) Arbeláez, P., Pont-Tuset, J., Barron, J.T., Marques, F., Malik, J.: Multiscale combinatorial grouping. In: CVPR, pp. 328–335 (2014)
4.
go back to reference Carreira, J., Sminchisescu, C.: Constrained parametric min-cuts for automatic object segmentation. In: CVPR, pp. 3241–3248 (2010) Carreira, J., Sminchisescu, C.: Constrained parametric min-cuts for automatic object segmentation. In: CVPR, pp. 3241–3248 (2010)
5.
go back to reference Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46(1), 131–159 (2002)CrossRef Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46(1), 131–159 (2002)CrossRef
6.
go back to reference Chen, X., Ma, H., Wang, X., Zhao, Z.: Improving object proposals with multi-thresholding straddling expansion. In: CVPR, pp. 2587–2595 (2015) Chen, X., Ma, H., Wang, X., Zhao, Z.: Improving object proposals with multi-thresholding straddling expansion. In: CVPR, pp. 2587–2595 (2015)
7.
go back to reference Cheng, M.M., Zhang, Z., Lin, W.Y., Torr, P.H.S.: BING: binarized normed gradients for objectness estimation at 300fps. In: CVPR, pp. 3286–3293 (2014) Cheng, M.M., Zhang, Z., Lin, W.Y., Torr, P.H.S.: BING: binarized normed gradients for objectness estimation at 300fps. In: CVPR, pp. 3286–3293 (2014)
8.
go back to reference Hosang, J., Benenson, R., Dollár, P., Schiele, B.: What makes for effective detection proposals? TPAMI 38(4), 814–830 (2016)CrossRef Hosang, J., Benenson, R., Dollár, P., Schiele, B.: What makes for effective detection proposals? TPAMI 38(4), 814–830 (2016)CrossRef
9.
go back to reference Humayun, A., Li, F., Rehg, J.M.: RIGOR: reusing inference in graph cuts for generating object regions. In: CVPR, pp. 336–343 (2014) Humayun, A., Li, F., Rehg, J.M.: RIGOR: reusing inference in graph cuts for generating object regions. In: CVPR, pp. 336–343 (2014)
12.
go back to reference Liu, J., Ren, T., Bao, B.K., Bei, J.: Depth-aware layered edge for object proposal. In: ICME, pp. 1–6 (2016) Liu, J., Ren, T., Bao, B.K., Bei, J.: Depth-aware layered edge for object proposal. In: ICME, pp. 1–6 (2016)
13.
go back to reference Liu, J., Ren, T., Wang, Y., Zhong, S.H., Bei, J., Chen, S.: Object proposal on RGB-D images via elastic edge boxes. NEUCOM 236, 134–146 (2017) Liu, J., Ren, T., Wang, Y., Zhong, S.H., Bei, J., Chen, S.: Object proposal on RGB-D images via elastic edge boxes. NEUCOM 236, 134–146 (2017)
14.
go back to reference Luo, B., Li, H., Meng, F., Wu, Q., Huang, C.: Video object segmentation via global consistency aware query strategy. TMM PP(99), 1 (2017) Luo, B., Li, H., Meng, F., Wu, Q., Huang, C.: Video object segmentation via global consistency aware query strategy. TMM PP(99), 1 (2017)
15.
go back to reference Manen, S., Guillaumin, M., Gool, L.J.V.: Prime object proposals with randomized prim’s algorithm. In: ICCV, pp. 2536–2543 (2013) Manen, S., Guillaumin, M., Gool, L.J.V.: Prime object proposals with randomized prim’s algorithm. In: ICCV, pp. 2536–2543 (2013)
16.
go back to reference Qi, F., Zhao, D., Liu, S., Fan, X.: 3D visual saliency detection model with generated disparity map. Multimedia Tools Appl. 76(2), 3087–3103 (2017)CrossRef Qi, F., Zhao, D., Liu, S., Fan, X.: 3D visual saliency detection model with generated disparity map. Multimedia Tools Appl. 76(2), 3087–3103 (2017)CrossRef
17.
go back to reference Rantalankila, P., Kannala, J., Rahtu, E.: Generating object segmentation proposals using global and local search. In: CVPR, pp. 2417–2424 (2014) Rantalankila, P., Kannala, J., Rahtu, E.: Generating object segmentation proposals using global and local search. In: CVPR, pp. 2417–2424 (2014)
18.
go back to reference Ren, T., Qiu, Z., Liu, Y., Yu, T., Bei, J.: Soft-assigned bag of features for object tracking. MMSJ 21(2), 189–205 (2015) Ren, T., Qiu, Z., Liu, Y., Yu, T., Bei, J.: Soft-assigned bag of features for object tracking. MMSJ 21(2), 189–205 (2015)
19.
go back to reference Sang, J., Xu, C., Liu, J.: User-aware image tag refinement via ternary semantic analysis. IEEE Trans. Multimedia 14(3), 883–895 (2012)CrossRef Sang, J., Xu, C., Liu, J.: User-aware image tag refinement via ternary semantic analysis. IEEE Trans. Multimedia 14(3), 883–895 (2012)CrossRef
20.
go back to reference Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. IJCV 104(2), 154–171 (2013)CrossRef Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. IJCV 104(2), 154–171 (2013)CrossRef
21.
go back to reference Wang, C., Zhao, L., Liang, S., Zhang, L.: Object proposal by multi-branch hierarchical segmentation. In: CVPR, pp. 3873–3881 (2015) Wang, C., Zhao, L., Liang, S., Zhang, L.: Object proposal by multi-branch hierarchical segmentation. In: CVPR, pp. 3873–3881 (2015)
22.
go back to reference Xiao, Y., Lu, C., Tsougenis, E., Lu, Y., Tang, C.K.: Complexity-adaptive distance metric for object proposals generation. In: CVPR, pp. 778–786 (2015) Xiao, Y., Lu, C., Tsougenis, E., Lu, Y., Tang, C.K.: Complexity-adaptive distance metric for object proposals generation. In: CVPR, pp. 778–786 (2015)
23.
go back to reference Xu, X., Ge, L., Ren, T., Wu, G.: Adaptive integration of depth and color for objectnes estimation. In: ICME, pp. 1–6 (2015) Xu, X., Ge, L., Ren, T., Wu, G.: Adaptive integration of depth and color for objectnes estimation. In: ICME, pp. 1–6 (2015)
24.
go back to reference Zhang, H., Zha, Z.J., Yang, Y., Yan, S., Gao, Y., Chua, T.S.: Attribute-augmented semantic hierarchy: towards a unified framework for content-based image retrieval. TOMM 11(1s), 21 (2014)CrossRef Zhang, H., Zha, Z.J., Yang, Y., Yan, S., Gao, Y., Chua, T.S.: Attribute-augmented semantic hierarchy: towards a unified framework for content-based image retrieval. TOMM 11(1s), 21 (2014)CrossRef
25.
go back to reference Zhang, H., He, X., Porikli, F., Kneip, L.: Semantic context and depth-aware object proposal generation. In: ICIP (2016) Zhang, H., He, X., Porikli, F., Kneip, L.: Semantic context and depth-aware object proposal generation. In: ICIP (2016)
Metadata
Title
Object Proposal via Depth Connectivity Constrained Grouping
Authors
Yuantian Wang
Lei Huang
Tongwei Ren
Sheng-Hua Zhong
Yan Liu
Gangshan Wu
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-77383-4_4