skip to main content
research-article
Free Access

Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

Published:23 February 2015Publication History
Skip Abstract Section

Abstract

The Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed to be ill-suited for representing edges, as well as for edge-aware operations such as edge-preserving smoothing and tone mapping. To tackle these tasks, a wealth of alternative techniques and representations have been proposed, for example, anisotropic diffusion, neighborhood filtering, and specialized wavelet bases. While these methods have demonstrated successful results, they come at the price of additional complexity, often accompanied by higher computational cost or the need to postprocess the generated results. In this paper, we show state-of-the-art edge-aware processing using standard Laplacian pyramids. We characterize edges with a simple threshold on pixel values that allow us to differentiate large-scale edges from small-scale details. Building upon this result, we propose a set of image filters to achieve edge-preserving smoothing, detail enhancement, tone mapping, and inverse tone mapping. The advantage of our approach is its simplicity and flexibility, relying only on simple point-wise nonlinearities and small Gaussian convolutions; no optimization or postprocessing is required. As we demonstrate, our method produces consistently high-quality results, without degrading edges or introducing halos.

References

  1. Aubert, G. and Kornprobst, P. Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Vol. 147 of Applied Mathematical Sciences. Springer, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Aubry, M., Paris, S., Hasinoff, S.W., Kautz, J., and Durand, F. Fast and Robust Pyramid-based Image Processing. Tech. Rep. MIT-CSAILTR-2011-049. MIT, 2011.Google ScholarGoogle Scholar
  3. Bae, S., Paris, S., and Durand, F. Two-scale tone management for photographic look. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3 (2006), 637--645. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Bhat, P., Zitnick, C.L., Cohen, M., and Curless, B. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Trans. Graph. 29 (2010), 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Buades, A., Coll, B., and Morel, J.-M. The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15 (2006), 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Burt, P.J. and Adelson, E.H. The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31 (1983), 4.Google ScholarGoogle ScholarCross RefCross Ref
  7. Chen, J., Paris, S., and Durand, F. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Criminisi, A., Sharp, T., Rother, C., and Perez, P. Geodesic image and video editing. ACM Trans. Graph. 29 (2010), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dippel, S., Stahl, M., Wiemker, R., and Blaffert, T. Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform. IEEE Trans. Med. Imaging 21 (2002), 4.Google ScholarGoogle ScholarCross RefCross Ref
  10. Durand, F. and Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. (Proc. SIGGRAPH) 27 (2008), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Fattal, R. Edge-avoiding wavelets and their applications. ACM Trans. Graph. (Proc. SIGGRAPH) 28 (2009), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Fattal, R., Lischinski, D., and Werman, M. Gradient domain high dynamic range compression. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Fattal, R., Agrawala, M., and Rusinkiewicz, S. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Fattal, R., Carroll, R., and Agrawala, M. Edge-based image coarsening. ACM Trans. Graph. 29 (2009), 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hadwiger, M., Sicat, R., Beyer, J., Krüger, J., and Möller, T. Sparse PDF maps for non-linear multiresolution image operations. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. He, K., Sun, J., and Tang, X. Guided image filtering. In Proceedings of European Conference on Computer Vision (Proc. ECCV) (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Heeger, D.J. and Bergen, J.R. Pyramid-based texture analysis/synthesis. In Proceedings of the ACM SIGGRAPH Conference (Proc. SIGGRAPH) (1995). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kass, M. and Solomon, J. Smoothed local histogram filters. ACM Tran. Graph. (Proc. SIGGRAPH) 29 (2010), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kimmel, R. Numerical Geometry of Images: Theory, Algorithms, and Applications. Springer, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Li, Y., Sharan, L., and Adelson, E.H. Compressing and companding high dynamic range images with subband architectures. ACM Trans. Graph. (Proc. SIGGRAPH) 24 (2005), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. Interactive local adjustment of tonal values. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Mantiuk, R., Myszkowski, K., and Seidel, H.-P. A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. 3 (2006), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Mantiuk, R., Mantiuk, R., Tomaszewska, A., and Heidrich, W. Color correction for tone mapping. Comput. Graph. Forum (Proc. Eurographics) 28 (2009), 2.Google ScholarGoogle ScholarCross RefCross Ref
  25. Masia, B., Agustin, S., Fleming, R.W., Sorkine, O., and Gutierrez, D. Evaluation of reverse tone mapping through varying exposure conditions. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Paris, S. and Durand, F. Tone-mapping code. http://people.csail.mit.edu/sparis/code/src/tone_mapping.zip.Google ScholarGoogle Scholar
  27. Paris, S., Kornprobst, P., Tumblin, J., and Durand, F. Bilateral filtering: Theory and applications. Found. Trends Comput. Graph. Vision 4, 1 (2009), 1--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Paris, S., Hasinoff, S.W., and Kautz, J. Local Laplacian Filters: Edge-aware image processing with a Laplacian pyramid. ACM Trans. Graph. (Proc. SIGGRAPH) 30 (2011), 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Perona, P. and Malik, J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12 (1990), 7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. Photographic tone reproduction for digital images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Subr, K., Soler, C., and Durand, F. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Sunkavalli, K., Johnson, M.K., Matusik, W., and Pfister, H. Multiscale image harmonization. ACM Trans. Graph. (Proc. SIGGRAPH) 29 (2010), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Szeliski, R. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Tomasi, C. and Manduchi, R. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision (Bombay, India, 1998). Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Tumblin, J. and Turk, G. Low curvature image simplifiers (LCIS): A boundary hierarchy for detail-preserving contrast reduction. In Proc. SIGGRAPH (1999). Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Vuylsteke, P. and Schoeters, E.P. Multiscale image contrast amplification (MUSICA). In Proc. SPIE, Volume 2167 (1994).Google ScholarGoogle Scholar
  37. Witkin, A. Scale-space filtering. In Proceedings of the International Joint Conference on Artificial Intelligence, Volume 2 (Karlsruhe, Federal Republic of Germany (a.k.a. West Germany), 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Witkin, A., Terzopoulos, D., and Kass, M. Signal matching through scale space. Int. J. Comput. Vision 1 (1987), 2.Google ScholarGoogle ScholarCross RefCross Ref
  39. Xu, L., Lu, C., Xu, Y., and Jia, J. Image smoothing via L0 gradient minimization. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 30 (2011), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Xu, L., Yan, Q., Xia, Y., and Jia, J. Structure extraction from texture via relative total variation. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Communications of the ACM
        Communications of the ACM  Volume 58, Issue 3
        March 2015
        83 pages
        ISSN:0001-0782
        EISSN:1557-7317
        DOI:10.1145/2739250
        • Editor:
        • Moshe Y. Vardi
        Issue’s Table of Contents

        Copyright © 2015 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 23 February 2015

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDFChinese translation

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format