Skip to main content
Top

2017 | OriginalPaper | Chapter

Unsupervised Multiple Object Cosegmentation via Ensemble MIML Learning

Authors : Weichen Yang, Zhengxing Sun, Bo Li, Jiagao Hu, Kewei Yang

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multiple foreground cosegmentation (MFC) has being a new research topic recently in computer vision. This paper proposes a framework of unsupervised multiple object cosegmentation, which is composed of three components: unsupervised label generation, saliency pseudo-annotation and cosegmentation based on MIML learning. Based on object detection, unsupervised label generation is done in terms of the two-stage object clustering method, to obtain accurate consistent label between common objects without any user intervention. Then, the object label is propagated to the object saliency coming from saliency detection method, to finish saliency pseudo-annotation. This makes an unsupervised MFC problem as a supervised multi-instance multi-label (MIML) learning problem. Finally, an ensemble MIML framework is introduced to achieve image cosegmentation based on random feature selection. The experimental results on data sets ICoseg and FlickrMFC demonstrated the effectiveness of the proposed approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kim, G., Xing, E.P.: On multiple foreground cosegmentation. In: IEEE CVPR, pp. 837–844 (2012) Kim, G., Xing, E.P.: On multiple foreground cosegmentation. In: IEEE CVPR, pp. 837–844 (2012)
2.
go back to reference Li, H., Meng, F.: Unsupervised multiclass region cosegmentation via ensemble clustering and energy minimization. IEEE Trans. Circ. Syst. Video Technol. 24(5), 789–801 (2014)CrossRef Li, H., Meng, F.: Unsupervised multiclass region cosegmentation via ensemble clustering and energy minimization. IEEE Trans. Circ. Syst. Video Technol. 24(5), 789–801 (2014)CrossRef
3.
go back to reference Li, K., Zhang, J., Tao, W.: Unsupervised co-segmentation for indefinite number of common foreground objects. IEEE Trans. Image Process. 25(4), 1898–1909 (2016)MathSciNetCrossRef Li, K., Zhang, J., Tao, W.: Unsupervised co-segmentation for indefinite number of common foreground objects. IEEE Trans. Image Process. 25(4), 1898–1909 (2016)MathSciNetCrossRef
4.
go back to reference Meng, F., Li, H.: Constrained directed graph clustering and segmentation propagation for multiple foregrounds cosegmentation. IEEE Trans. Circ. Syst. Video Technol. 25(11), 1735–1748 (2015)CrossRef Meng, F., Li, H.: Constrained directed graph clustering and segmentation propagation for multiple foregrounds cosegmentation. IEEE Trans. Circ. Syst. Video Technol. 25(11), 1735–1748 (2015)CrossRef
5.
go back to reference Li, L., Fei, X.: Unsupervised multi-class co-segmentation via joint object detection and segmentation with energy minimization. In: MIPPR, pp. 9812–9814 (2015) Li, L., Fei, X.: Unsupervised multi-class co-segmentation via joint object detection and segmentation with energy minimization. In: MIPPR, pp. 9812–9814 (2015)
6.
go back to reference Chang, H.S., Wang, Y.C.F.: Optimizing the decomposition for multiple foreground cosegmentation. Comput. Vis. Image Underst. 141, 18–27 (2015)CrossRef Chang, H.S., Wang, Y.C.F.: Optimizing the decomposition for multiple foreground cosegmentation. Comput. Vis. Image Underst. 141, 18–27 (2015)CrossRef
7.
go back to reference Rother, C., Minka, T.: Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs. In: IEEE CVPR, pp. 993–1000 (2006) Rother, C., Minka, T.: Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs. In: IEEE CVPR, pp. 993–1000 (2006)
8.
go back to reference Mukherjee, L., Singh, V., Dyer, C.R.: Half-integrality based algorithms for cosegmentation of images. In: IEEE CVPR, pp. 2028–2035 (2009) Mukherjee, L., Singh, V., Dyer, C.R.: Half-integrality based algorithms for cosegmentation of images. In: IEEE CVPR, pp. 2028–2035 (2009)
9.
go back to reference Kim, G., Xing, E.P., Fei-Fei, L., Kanade, T.: Distributed cosegmentation via submodular optimization on anisotropic diffusion. In: IEEE ICCV, pp. 169–176 (2011) Kim, G., Xing, E.P., Fei-Fei, L., Kanade, T.: Distributed cosegmentation via submodular optimization on anisotropic diffusion. In: IEEE ICCV, pp. 169–176 (2011)
10.
go back to reference Wang, F., Huang, Q., Ovsjanikov, M., Guibas, L.J.: Unsupervised multi-class joint image segmentation. In: IEEE CVPR, pp. 3142–3149 (2014) Wang, F., Huang, Q., Ovsjanikov, M., Guibas, L.J.: Unsupervised multi-class joint image segmentation. In: IEEE CVPR, pp. 3142–3149 (2014)
11.
go back to reference Ma, T., Jan Latecki, L.: Graph transduction learning with connectivity constraints with application to multiple foreground cosegmentation. In: IEEE CVPR, pp. 1955–1962(2013) Ma, T., Jan Latecki, L.: Graph transduction learning with connectivity constraints with application to multiple foreground cosegmentation. In: IEEE CVPR, pp. 1955–1962(2013)
12.
go back to reference Zhu, H., Lu, J., Cai, J., Zheng, J., Thalmann, N.M.: Multiple foreground recognition and cosegmentation: an object-oriented CRF model with robust higher-order potentials. In: IEEE WACV, pp. 485–492 (2014) Zhu, H., Lu, J., Cai, J., Zheng, J., Thalmann, N.M.: Multiple foreground recognition and cosegmentation: an object-oriented CRF model with robust higher-order potentials. In: IEEE WACV, pp. 485–492 (2014)
13.
go back to reference Zitnick, C.L., Dollár, P.: Edge boxes: locating object proposals from edges. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 391–405. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10602-1_26 Zitnick, C.L., Dollár, P.: Edge boxes: locating object proposals from edges. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 391–405. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10602-1_​26
14.
go back to reference Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE CVPR, pp. 3431–3440 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE CVPR, pp. 3431–3440 (2015)
16.
go back to reference Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: IEEE CVPR, pp. 2814–2821 (2014) Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: IEEE CVPR, pp. 2814–2821 (2014)
17.
go back to reference Cheng, M.M., Mitra, N.J., Huang, X., Torr, P.H., Hu, S.M.: Global contrast based salient region detection. IEEE TPAMI 37(3), 569–582 (2015)CrossRef Cheng, M.M., Mitra, N.J., Huang, X., Torr, P.H., Hu, S.M.: Global contrast based salient region detection. IEEE TPAMI 37(3), 569–582 (2015)CrossRef
18.
go back to reference Achanta, R., Smith, S.A.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE TPAMI 34(11), 2274–2282 (2012)CrossRef Achanta, R., Smith, S.A.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE TPAMI 34(11), 2274–2282 (2012)CrossRef
19.
go back to reference Zhou, Z.H., Zhang, M.L.: Multi-instance multi-label learning with application to scene classification. In: NIPS, pp. 1609–1616 (2006) Zhou, Z.H., Zhang, M.L.: Multi-instance multi-label learning with application to scene classification. In: NIPS, pp. 1609–1616 (2006)
20.
go back to reference Briggs, F., Fern, X.Z., Raich, R.: Rank-loss support instance machines for MIML instance annotation. In: ACM SIGKDD, pp. 534–542 (2012) Briggs, F., Fern, X.Z., Raich, R.: Rank-loss support instance machines for MIML instance annotation. In: ACM SIGKDD, pp. 534–542 (2012)
21.
go back to reference Batra, D., Kowdle, A.: iCoseg: interactive co-segmentation with intelligent scribble guidance. In: IEEE CVPR, pp. 3169–3176 (2010) Batra, D., Kowdle, A.: iCoseg: interactive co-segmentation with intelligent scribble guidance. In: IEEE CVPR, pp. 3169–3176 (2010)
22.
go back to reference Joulin, A., Bach, F., Ponce, J.: Discriminative clustering for image co-segmentation. In: IEEE CVPR, pp. 1943–1950 (2010) Joulin, A., Bach, F., Ponce, J.: Discriminative clustering for image co-segmentation. In: IEEE CVPR, pp. 1943–1950 (2010)
23.
go back to reference Vicente, S., Rother, C., Kolmogorov, V.: Object cosegmentation. In: IEEE CVPR, pp. 2217–2224 (2011) Vicente, S., Rother, C., Kolmogorov, V.: Object cosegmentation. In: IEEE CVPR, pp. 2217–2224 (2011)
24.
go back to reference Rubinstein, M., Joulin, A., Koft, J., Liu, C.: Object co-segmentation based on shortest path algorithm and saliency model. IEEE Trans. Multimedia 14(5), 1429–1441 (2012)CrossRef Rubinstein, M., Joulin, A., Koft, J., Liu, C.: Object co-segmentation based on shortest path algorithm and saliency model. IEEE Trans. Multimedia 14(5), 1429–1441 (2012)CrossRef
25.
go back to reference Rubinstein, M., Joulin, A., Kopf, J., Liu, C.: Unsupervised joint object discovery and segmentation in internet images. In: IEEE CVPR, pp. 1939–1946 (2013) Rubinstein, M., Joulin, A., Kopf, J., Liu, C.: Unsupervised joint object discovery and segmentation in internet images. In: IEEE CVPR, pp. 1939–1946 (2013)
Metadata
Title
Unsupervised Multiple Object Cosegmentation via Ensemble MIML Learning
Authors
Weichen Yang
Zhengxing Sun
Bo Li
Jiagao Hu
Kewei Yang
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-51814-5_33