Skip to main content

2017 | OriginalPaper | Buchkapitel

Uncertain Region Identification for Stereoscopic Foreground Cutout

verfasst von : Taotao Yang, Shuaicheng Liu, Chao Sun, Zhengning Wang, Bing Zeng

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a method that automatically segments the foreground objects for stereoscopic images. Given a stereo pair, a disparity map can be estimated, which encodes the depth information. Objects that stay close to the camera are considered as foreground while regions with larger depths are deemed as background. Although the raw disparity map is usually noisy, incomplete, and inaccurate, it facilitates an automatic generation of trimaps for both views, where the images are partitioned into three regions: definite foreground, definite background, and uncertain region. Our job is now reduced to labelling of pixels in the uncertain region, in which the number of unknown pixels has been decreased largely. We propose to use an MRF based energy minimization for labelling the unknown pixels, which involves both local and global color probabilities within and across views. Results are evaluated by objective metrics on a ground truth stereo segmentation dataset, which validates the effectiveness of our proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Lo, W., Baar, J., Knaus, C., Zwicker, M., Gross, M.: Stereoscopic 3D copy & paste. ACM Trans. Graph. 29(6), 147 (2010) Lo, W., Baar, J., Knaus, C., Zwicker, M., Gross, M.: Stereoscopic 3D copy & paste. ACM Trans. Graph. 29(6), 147 (2010)
2.
Zurück zum Zitat Tong, R., Zhang, Y., Cheng, K.: Stereopasting: interactive composition in stereoscopic images. IEEE Trans. Vis. Comput. Graph. 19(8), 1375–1385 (2013)CrossRef Tong, R., Zhang, Y., Cheng, K.: Stereopasting: interactive composition in stereoscopic images. IEEE Trans. Vis. Comput. Graph. 19(8), 1375–1385 (2013)CrossRef
3.
Zurück zum Zitat Du, S., Hu, S., Martin, R.: Changing perspective in stereoscopic images. IEEE Trans. Vis. Comput. Graph. 19(8), 1288–1297 (2013)CrossRef Du, S., Hu, S., Martin, R.: Changing perspective in stereoscopic images. IEEE Trans. Vis. Comput. Graph. 19(8), 1288–1297 (2013)CrossRef
4.
Zurück zum Zitat Niu, Y., Feng, W., Liu, F.: Enabling warping on stereoscopic images. ACM Trans. Graph. 31(6), 183 (2012)CrossRef Niu, Y., Feng, W., Liu, F.: Enabling warping on stereoscopic images. ACM Trans. Graph. 31(6), 183 (2012)CrossRef
5.
Zurück zum Zitat Zhang, F., Liu, F.: Casual stereoscopic panorama stitching. In: Proceedings of CVPR (2015) Zhang, F., Liu, F.: Casual stereoscopic panorama stitching. In: Proceedings of CVPR (2015)
6.
Zurück zum Zitat Basha, T., Moses, Y., Avidan, S.: Geometrically consistent stereo seam carving. In: Proceedings of ICCV, pp. 1816–1823 (2011) Basha, T., Moses, Y., Avidan, S.: Geometrically consistent stereo seam carving. In: Proceedings of ICCV, pp. 1816–1823 (2011)
7.
Zurück zum Zitat Pal, N., Pal, S.: A review on image segmentation techniques. Pattern Recogn. 26(9), 1277–1294 (1993)CrossRef Pal, N., Pal, S.: A review on image segmentation techniques. Pattern Recogn. 26(9), 1277–1294 (1993)CrossRef
8.
Zurück zum Zitat Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)CrossRef
9.
Zurück zum Zitat Price, B., Cohen, S.: StereoCut: consistent interactive object selection in stereo image pairs. In: Proceedings of ICCV, pp. 1148–1155 (2011) Price, B., Cohen, S.: StereoCut: consistent interactive object selection in stereo image pairs. In: Proceedings of ICCV, pp. 1148–1155 (2011)
10.
Zurück zum Zitat Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 328–341 (2008)CrossRef
11.
Zurück zum Zitat Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)CrossRef Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)CrossRef
12.
Zurück zum Zitat Kim, S.-H., Choi, J.-H., Kim, H.-B., Jang, J.-W.: A new snake algorithm for object segmentation in stereo images. In: Proceedings of ICME, vol. 1, pp. 13–16 (2004) Kim, S.-H., Choi, J.-H., Kim, H.-B., Jang, J.-W.: A new snake algorithm for object segmentation in stereo images. In: Proceedings of ICME, vol. 1, pp. 13–16 (2004)
13.
Zurück zum Zitat Ahn, J.-H., Kim, K., Byun, H.: Robust object segmentation using graph cut with object and background seed estimation. In: Proceedings of ICPR, vol. 2, pp. 361–364 (2006) Ahn, J.-H., Kim, K., Byun, H.: Robust object segmentation using graph cut with object and background seed estimation. In: Proceedings of ICPR, vol. 2, pp. 361–364 (2006)
15.
Zurück zum Zitat Tasli, H., Alatan, A.: User assisted stereo image segmentation. In: 3DTV-CON, pp. 1–4 (2012) Tasli, H., Alatan, A.: User assisted stereo image segmentation. In: 3DTV-CON, pp. 1–4 (2012)
16.
Zurück zum Zitat Bleyer, M., Rother, C., Kohli, P., Scharstein, D., Sinha, S.: Object stereojoint stereo matching and object segmentation. In: Proceedings of CVPR, pp. 3081–3088 (2011) Bleyer, M., Rother, C., Kohli, P., Scharstein, D., Sinha, S.: Object stereojoint stereo matching and object segmentation. In: Proceedings of CVPR, pp. 3081–3088 (2011)
17.
Zurück zum Zitat Joulin, A., Bach, F., Ponce, J.: Discriminative clustering for image co-segmentation. In: Proceedings of CVPR, pp. 1943–1950 (2010) Joulin, A., Bach, F., Ponce, J.: Discriminative clustering for image co-segmentation. In: Proceedings of CVPR, pp. 1943–1950 (2010)
18.
Zurück zum Zitat Hochbaum, D., Singh, V.: An efficient algorithm for co-segmentation. In: Proceedings of ICCV, pp. 269–276 (2009) Hochbaum, D., Singh, V.: An efficient algorithm for co-segmentation. In: Proceedings of ICCV, pp. 269–276 (2009)
19.
Zurück zum Zitat Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef
20.
Zurück zum Zitat Çiğla, C., Alatan, A.: Efficient graph-based image segmentation via speeded-up turbo pixels. In: Proceedings of ICIP, pp. 3013–3016 (2010) Çiğla, C., Alatan, A.: Efficient graph-based image segmentation via speeded-up turbo pixels. In: Proceedings of ICIP, pp. 3013–3016 (2010)
21.
Zurück zum Zitat Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)CrossRef Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)CrossRef
22.
Zurück zum Zitat Bai, X., Wang, J., Simons, D., Sapiro, G.: Video SnapCut: robust video object cutout using localized classifiers. ACM Trans. Graph. 28(3), 70 (2009)CrossRef Bai, X., Wang, J., Simons, D., Sapiro, G.: Video SnapCut: robust video object cutout using localized classifiers. ACM Trans. Graph. 28(3), 70 (2009)CrossRef
23.
Zurück zum Zitat Price, B., Morse, B., Cohen, S.: LIVEcut: learning-based interactive video segmentation by evaluation of multiple propagated cues. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 779–786 (2009) Price, B., Morse, B., Cohen, S.: LIVEcut: learning-based interactive video segmentation by evaluation of multiple propagated cues. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 779–786 (2009)
24.
Zurück zum Zitat Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)CrossRefMATH Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)CrossRefMATH
Metadaten
Titel
Uncertain Region Identification for Stereoscopic Foreground Cutout
verfasst von
Taotao Yang
Shuaicheng Liu
Chao Sun
Zhengning Wang
Bing Zeng
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-71598-8_35