Skip to main content
Erschienen in: International Journal of Computer Vision 2/2013

01.06.2013

Error-Tolerant Image Compositing

verfasst von: Michael W. Tao, Micah K. Johnson, Sylvain Paris

Erschienen in: International Journal of Computer Vision | Ausgabe 2/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Gradient-domain compositing is an essential tool in computer vision and its applications, e.g., seamless cloning, panorama stitching, shadow removal, scene completion and reshuffling. While easy to implement, these gradient-domain techniques often generate bleeding artifacts where the composited image regions do not match. One option is to modify the region boundary to minimize such mismatches. However, this option may not always be sufficient or applicable, e.g., the user or algorithm may not allow the selection to be altered. We propose a new approach to gradient-domain compositing that is robust to inaccuracies and prevents color bleeding without changing the boundary location. Our approach improves standard gradient-domain compositing in two ways. First, we define the boundary gradients such that the produced gradient field is nearly integrable. Second, we control the integration process to concentrate residuals where they are less conspicuous. We show that our approach can be formulated as a standard least-squares problem that can be solved with a sparse linear system akin to the classical Poisson equation. We demonstrate results on a variety of scenes. The visual quality and run-time complexity compares favorably to other approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Note that for a 2D vector field u=(u x ,u y ), the curl is a scalar value that corresponds to the z component of the 3D curl applied to the 3D vector field (u x ,u y ,0).
 
Literatur
Zurück zum Zitat Agarwala, A. (2007). Efficient gradient-domain compositing using quadtrees. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference. Agarwala, A. (2007). Efficient gradient-domain compositing using quadtrees. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D. H., & Cohen, M. F. (2004). Interactive digital photomontage. In ACM transactions on graphics: Vol. 23. Proceedings of the ACM SIGGRAPH conference (pp. 294–302). Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D. H., & Cohen, M. F. (2004). Interactive digital photomontage. In ACM transactions on graphics: Vol. 23. Proceedings of the ACM SIGGRAPH conference (pp. 294–302).
Zurück zum Zitat Agrawal, A., Raskar, R., & Chellappa, R. (2006). What is the range of surface reconstructions from a gradient field? In Proceedings of the European conference on computer vision. Agrawal, A., Raskar, R., & Chellappa, R. (2006). What is the range of surface reconstructions from a gradient field? In Proceedings of the European conference on computer vision.
Zurück zum Zitat Aubert, G., & Kornprobst, P. (2002). Applied mathematical sciences: Vol. 147. Mathematical problems in image processing: partial differential equations and the calculus of variations. Berlin: Springer. MATH Aubert, G., & Kornprobst, P. (2002). Applied mathematical sciences: Vol. 147. Mathematical problems in image processing: partial differential equations and the calculus of variations. Berlin: Springer. MATH
Zurück zum Zitat Bae, S., Paris, S., & Durand, F. (2006). Two-scale tone management for photographic look. In ACM transactions on graphics: Vol. 25. Proceedings of the ACM SIGGRAPH conference (pp. 637–645). Bae, S., Paris, S., & Durand, F. (2006). Two-scale tone management for photographic look. In ACM transactions on graphics: Vol. 25. Proceedings of the ACM SIGGRAPH conference (pp. 637–645).
Zurück zum Zitat Bhat, P., Zitnick, C. L., Cohen, M., & Curless, B. (2009). Gradientshop: a gradient-domain optimization framework for image and video filtering. In ACM transactions on graphics. Bhat, P., Zitnick, C. L., Cohen, M., & Curless, B. (2009). Gradientshop: a gradient-domain optimization framework for image and video filtering. In ACM transactions on graphics.
Zurück zum Zitat Cho, T. S., Avidan, S., & Freeman, W. T. (2010). The patch transform. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1489–1501. CrossRef Cho, T. S., Avidan, S., & Freeman, W. T. (2010). The patch transform. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1489–1501. CrossRef
Zurück zum Zitat Drettakis, G., Bonneel, N., Dachsbacher, C., Lefebvre, S., Schwarz, M., & Viaud-Delmon, I. (2007). An interactive perceptual rendering pipeline using contrast and spatial masking. Rendering Techniques. Drettakis, G., Bonneel, N., Dachsbacher, C., Lefebvre, S., Schwarz, M., & Viaud-Delmon, I. (2007). An interactive perceptual rendering pipeline using contrast and spatial masking. Rendering Techniques.
Zurück zum Zitat Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008). Edge-preserving decompositions for multi-scale tone and detail manipulation. In ACM transactions on graphics: Vol. 27. Proceedings of the ACM SIGGRAPH conference. Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008). Edge-preserving decompositions for multi-scale tone and detail manipulation. In ACM transactions on graphics: Vol. 27. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Fattal, R., & Lischinski, D. (2009). Coordinates for instant image cloning. In ACM transactions on graphics: Vol. 28. Proceedings of the ACM SIGGRAPH conference. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Fattal, R., & Lischinski, D. (2009). Coordinates for instant image cloning. In ACM transactions on graphics: Vol. 28. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Finlayson, G. D., Hordley, S. D., Lu, C., & Drew, M. S. (2006). On the removal of shadows from images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 59–68. CrossRef Finlayson, G. D., Hordley, S. D., Lu, C., & Drew, M. S. (2006). On the removal of shadows from images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 59–68. CrossRef
Zurück zum Zitat Finlayson, G. D., Drew, M. S., & Lu, C. (2009). Entropy minimization for shadow removal. International Journal of Computer Vision, 85(1), 35–57. CrossRef Finlayson, G. D., Drew, M. S., & Lu, C. (2009). Entropy minimization for shadow removal. International Journal of Computer Vision, 85(1), 35–57. CrossRef
Zurück zum Zitat Georgiev, T. (2006). Covariant derivatives and vision. In Proceedings of the European conference on computer vision. Georgiev, T. (2006). Covariant derivatives and vision. In Proceedings of the European conference on computer vision.
Zurück zum Zitat Hays, J., & Efros, A. A. (2007). Scene completion using millions of photographs. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference. Hays, J., & Efros, A. A. (2007). Scene completion using millions of photographs. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Jia, J., Sun, J., Tang, C. K., & Shum, H. Y. (2006). Drag-and-drop pasting. In ACM transactions on graphics: Vol. 25. Proceedings of the ACM SIGGRAPH conference. Jia, J., Sun, J., Tang, C. K., & Shum, H. Y. (2006). Drag-and-drop pasting. In ACM transactions on graphics: Vol. 25. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Lalonde, J. F., Hoiem, D., Efros, A., Rother, C., Winn, J., & Criminisi, A. (2007). Photo clip art. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference. Lalonde, J. F., Hoiem, D., Efros, A., Rother, C., Winn, J., & Criminisi, A. (2007). Photo clip art. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Levin, A., Zomet, A., Peleg, S., & Weiss, Y. (2006). Seamless image stitching in the gradient domain. In Proceedings of the European conference on computer vision. Levin, A., Zomet, A., Peleg, S., & Weiss, Y. (2006). Seamless image stitching in the gradient domain. In Proceedings of the European conference on computer vision.
Zurück zum Zitat Perona, P., & Malik, J. (1990). Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 629–639. CrossRef Perona, P., & Malik, J. (1990). Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 629–639. CrossRef
Zurück zum Zitat Prez, P., Gangnet, M., & Blake, A. (2003). Poisson image editing. In ACM transactions on graphics: Vol. 22. Proceedings of the ACM SIGGRAPH conference. Prez, P., Gangnet, M., & Blake, A. (2003). Poisson image editing. In ACM transactions on graphics: Vol. 22. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Ramanarayanan, G., Ferwerda, J., Walter, B., & Bala, K. (2007). Visual equivalence: towards a new standard for image fidelity. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference. Ramanarayanan, G., Ferwerda, J., Walter, B., & Bala, K. (2007). Visual equivalence: towards a new standard for image fidelity. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Ramanarayanan, G., Bala, K., & Ferwerda, J. (2008). Perception of complex aggregates. In ACM transactions on graphics: Vol. 27. Proceedings of the ACM SIGGRAPH conference. Ramanarayanan, G., Bala, K., & Ferwerda, J. (2008). Perception of complex aggregates. In ACM transactions on graphics: Vol. 27. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Reddy, D., Agrawal, A., & Chellappa, R. (2009). Enforcing integrability by error correction using L-1 minimization. In Proceedings of the conference on computer vision and pattern recognition. Reddy, D., Agrawal, A., & Chellappa, R. (2009). Enforcing integrability by error correction using L-1 minimization. In Proceedings of the conference on computer vision and pattern recognition.
Zurück zum Zitat Sivic, J., Kaneva, B., Torralba, A., Avidan, S., & Freeman, W. T. (2008). Creating and exploring a large photorealistic virtual space. In Proceedings of the IEEE workshop on internet vision. Sivic, J., Kaneva, B., Torralba, A., Avidan, S., & Freeman, W. T. (2008). Creating and exploring a large photorealistic virtual space. In Proceedings of the IEEE workshop on internet vision.
Zurück zum Zitat Su, S., Durand, F., & Agrawala, M. (2005). De-emphasis of distracting image regions using texture power maps. In Proceedings of the ICCV workshop on texture analysis and synthesis. Su, S., Durand, F., & Agrawala, M. (2005). De-emphasis of distracting image regions using texture power maps. In Proceedings of the ICCV workshop on texture analysis and synthesis.
Zurück zum Zitat Tappen, M. F., Adelson, E. H., & Freeman, W. T. (2005). Recovering intrinsic images from a single image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1459–1472. CrossRef Tappen, M. F., Adelson, E. H., & Freeman, W. T. (2005). Recovering intrinsic images from a single image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1459–1472. CrossRef
Zurück zum Zitat Vangorp, P., Laurijssen, J., & Dutr, P. (2007). The influence of shape on the perception of material reflectance. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference. Vangorp, P., Laurijssen, J., & Dutr, P. (2007). The influence of shape on the perception of material reflectance. In ACM transactions on graphics: Vol. 26. Proceedings of the ACM SIGGRAPH conference.
Zurück zum Zitat Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(14), 600–612. CrossRef Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(14), 600–612. CrossRef
Zurück zum Zitat Whyte, O., Sivic, J., & Zisserman, A. (2009). Get out of my picture! Internet-based inpainting. In Proceedings of the British machine vision conference. Whyte, O., Sivic, J., & Zisserman, A. (2009). Get out of my picture! Internet-based inpainting. In Proceedings of the British machine vision conference.
Metadaten
Titel
Error-Tolerant Image Compositing
verfasst von
Michael W. Tao
Micah K. Johnson
Sylvain Paris
Publikationsdatum
01.06.2013
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 2/2013
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-012-0579-7

Weitere Artikel der Ausgabe 2/2013

International Journal of Computer Vision 2/2013 Zur Ausgabe