Skip to main content

2018 | OriginalPaper | Buchkapitel

A Robust Image Reflection Separation Method Based on Sift-Edge Flow

verfasst von : Shaomin Du, Xiaohui Liang, Xiaochuan Wang

Erschienen in: Advances in Multimedia Information Processing – PCM 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motion computation is an important part for image reflection separation methods using image sequence. As the motion of background and reflection is separated on image edges, in this paper we present a robust image reflection separation method based on sift-edge flow. Edge motion is firstly computed using sift-edge flow. Based on it, the sparse motion field of image edges is clustered into two parts and refined by RANSAC, which are then used to interpolate the dense motion fields of the background and reflection. The initial image decomposition is conducted by warping the input images to reference image using the dense motion fields of background and reflection respectively. Finally, with the initial solution provided, the background and reflection images can be separated using alternating optimization. Experiment results showed that our method can achieve a robust performance compared with the state of art.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agrawal, A., Raskar, R., Nayar, S.K., Li, Y.: Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Trans. Graph. (TOG) 24(3), 828–835 (2005)CrossRef Agrawal, A., Raskar, R., Nayar, S.K., Li, Y.: Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Trans. Graph. (TOG) 24(3), 828–835 (2005)CrossRef
2.
Zurück zum Zitat Kong, N., Tai, Y.-W., Shin, J.S.: A physically-based approach to reflection separation: from physical modeling to constrained optimization. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 209–221 (2014)CrossRef Kong, N., Tai, Y.-W., Shin, J.S.: A physically-based approach to reflection separation: from physical modeling to constrained optimization. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 209–221 (2014)CrossRef
3.
Zurück zum Zitat Levin, A., Weiss, Y.: User assisted separation of reflections from a single image using a sparsity prior. IEEE Trans. Pattern Anal. Mach. Intell. 29(9), 1647–1654 (2007)CrossRef Levin, A., Weiss, Y.: User assisted separation of reflections from a single image using a sparsity prior. IEEE Trans. Pattern Anal. Mach. Intell. 29(9), 1647–1654 (2007)CrossRef
4.
Zurück zum Zitat Li, Y., Brown, M.S.: Exploiting reflection change for automatic reflection removal. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2432–2439 (2013) Li, Y., Brown, M.S.: Exploiting reflection change for automatic reflection removal. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2432–2439 (2013)
5.
Zurück zum Zitat Li, Y., Brown, M.S.: Single image layer separation using relative smoothness. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2752–2759 (2014) Li, Y., Brown, M.S.: Single image layer separation using relative smoothness. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2752–2759 (2014)
6.
Zurück zum Zitat Liu, C., Yuen, J., Torralba, A.: SIFT flow: dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 978–994 (2011)CrossRef Liu, C., Yuen, J., Torralba, A.: SIFT flow: dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 978–994 (2011)CrossRef
7.
Zurück zum Zitat Meer, P.: Robust techniques for computer vision. In: Emerging Topics in Computer Vision, pp. 107–190 (2004) Meer, P.: Robust techniques for computer vision. In: Emerging Topics in Computer Vision, pp. 107–190 (2004)
8.
Zurück zum Zitat Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2564–2571. IEEE (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2564–2571. IEEE (2011)
9.
Zurück zum Zitat Shih, Y., Krishnan, D., Durand, F., Freeman, W.T.: Reflection removal using ghosting cues. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3193–3201 (2015) Shih, Y., Krishnan, D., Durand, F., Freeman, W.T.: Reflection removal using ghosting cues. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3193–3201 (2015)
10.
Zurück zum Zitat Simon, C., Park, I.K.: Reflection removal for in-vehicle black box videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4231–4239 (2015) Simon, C., Park, I.K.: Reflection removal for in-vehicle black box videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4231–4239 (2015)
11.
Zurück zum Zitat Sinha, S.N., Kopf, J., Goesele, M., Scharstein, D., Szeliski, R.: Image-based rendering for scenes with reflections. ACM Trans. Graph. 31(4), 100:1–100:10 (2012)CrossRef Sinha, S.N., Kopf, J., Goesele, M., Scharstein, D., Szeliski, R.: Image-based rendering for scenes with reflections. ACM Trans. Graph. 31(4), 100:1–100:10 (2012)CrossRef
12.
Zurück zum Zitat Sun, C., Liu, S., Yang, T., Zeng, B., Wang, Z., Liu, G.: Automatic reflection removal using gradient intensity and motion cues. In: Proceedings of the 2016 ACM on Multimedia Conference, pp. 466–470. ACM (2016) Sun, C., Liu, S., Yang, T., Zeng, B., Wang, Z., Liu, G.: Automatic reflection removal using gradient intensity and motion cues. In: Proceedings of the 2016 ACM on Multimedia Conference, pp. 466–470. ACM (2016)
13.
Zurück zum Zitat Szeliski, R., Avidan, S., Anandan, P.: Layer extraction from multiple images containing reflections and transparency. In: IEEE Conference on Computer Vision and Pattern Recognition, Proceedings, vol. 1, pp. 246–253. IEEE (2000) Szeliski, R., Avidan, S., Anandan, P.: Layer extraction from multiple images containing reflections and transparency. In: IEEE Conference on Computer Vision and Pattern Recognition, Proceedings, vol. 1, pp. 246–253. IEEE (2000)
14.
Zurück zum Zitat Weinzaepfel, P., Revaud, J., Harchaoui, Z., Schmid, C.: DeepFlow: large displacement optical flow with deep matching. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1385–1392 (2013) Weinzaepfel, P., Revaud, J., Harchaoui, Z., Schmid, C.: DeepFlow: large displacement optical flow with deep matching. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1385–1392 (2013)
15.
Zurück zum Zitat Xue, T., Rubinstein, M., Liu, C., Freeman, W.T.: A computational approach for obstruction-free photography. ACM Trans. Graph. (TOG) 34(4), 79:1–79:11 (2015)CrossRef Xue, T., Rubinstein, M., Liu, C., Freeman, W.T.: A computational approach for obstruction-free photography. ACM Trans. Graph. (TOG) 34(4), 79:1–79:11 (2015)CrossRef
16.
Zurück zum Zitat Yang, J., Li, H., Dai, Y., Tan, R.T.: Robust optical flow estimation of double-layer images under transparency or reflection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1410–1419 (2016) Yang, J., Li, H., Dai, Y., Tan, R.T.: Robust optical flow estimation of double-layer images under transparency or reflection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1410–1419 (2016)
Metadaten
Titel
A Robust Image Reflection Separation Method Based on Sift-Edge Flow
verfasst von
Shaomin Du
Xiaohui Liang
Xiaochuan Wang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-77383-4_16

Neuer Inhalt