Abstract
The Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed to be ill-suited for representing edges, as well as for edge-aware operations such as edge-preserving smoothing and tone mapping. To tackle these tasks, a wealth of alternative techniques and representations have been proposed, for example, anisotropic diffusion, neighborhood filtering, and specialized wavelet bases. While these methods have demonstrated successful results, they come at the price of additional complexity, often accompanied by higher computational cost or the need to postprocess the generated results. In this paper, we show state-of-the-art edge-aware processing using standard Laplacian pyramids. We characterize edges with a simple threshold on pixel values that allow us to differentiate large-scale edges from small-scale details. Building upon this result, we propose a set of image filters to achieve edge-preserving smoothing, detail enhancement, tone mapping, and inverse tone mapping. The advantage of our approach is its simplicity and flexibility, relying only on simple point-wise nonlinearities and small Gaussian convolutions; no optimization or postprocessing is required. As we demonstrate, our method produces consistently high-quality results, without degrading edges or introducing halos.
- Aubert, G. and Kornprobst, P. Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Vol. 147 of Applied Mathematical Sciences. Springer, 2002. Google ScholarDigital Library
- Aubry, M., Paris, S., Hasinoff, S.W., Kautz, J., and Durand, F. Fast and Robust Pyramid-based Image Processing. Tech. Rep. MIT-CSAILTR-2011-049. MIT, 2011.Google Scholar
- Bae, S., Paris, S., and Durand, F. Two-scale tone management for photographic look. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3 (2006), 637--645. Google ScholarDigital Library
- Bhat, P., Zitnick, C.L., Cohen, M., and Curless, B. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Trans. Graph. 29 (2010), 2. Google ScholarDigital Library
- Buades, A., Coll, B., and Morel, J.-M. The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15 (2006), 6. Google ScholarDigital Library
- Burt, P.J. and Adelson, E.H. The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31 (1983), 4.Google ScholarCross Ref
- Chen, J., Paris, S., and Durand, F. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3. Google ScholarDigital Library
- Criminisi, A., Sharp, T., Rother, C., and Perez, P. Geodesic image and video editing. ACM Trans. Graph. 29 (2010), 5. Google ScholarDigital Library
- Dippel, S., Stahl, M., Wiemker, R., and Blaffert, T. Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform. IEEE Trans. Med. Imaging 21 (2002), 4.Google ScholarCross Ref
- Durand, F. and Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarDigital Library
- Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. (Proc. SIGGRAPH) 27 (2008), 3. Google ScholarDigital Library
- Fattal, R. Edge-avoiding wavelets and their applications. ACM Trans. Graph. (Proc. SIGGRAPH) 28 (2009), 3. Google ScholarDigital Library
- Fattal, R., Lischinski, D., and Werman, M. Gradient domain high dynamic range compression. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarDigital Library
- Fattal, R., Agrawala, M., and Rusinkiewicz, S. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3. Google ScholarDigital Library
- Fattal, R., Carroll, R., and Agrawala, M. Edge-based image coarsening. ACM Trans. Graph. 29 (2009), 1. Google ScholarDigital Library
- Hadwiger, M., Sicat, R., Beyer, J., Krüger, J., and Möller, T. Sparse PDF maps for non-linear multiresolution image operations. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5. Google ScholarDigital Library
- He, K., Sun, J., and Tang, X. Guided image filtering. In Proceedings of European Conference on Computer Vision (Proc. ECCV) (2010). Google ScholarDigital Library
- Heeger, D.J. and Bergen, J.R. Pyramid-based texture analysis/synthesis. In Proceedings of the ACM SIGGRAPH Conference (Proc. SIGGRAPH) (1995). Google ScholarDigital Library
- Kass, M. and Solomon, J. Smoothed local histogram filters. ACM Tran. Graph. (Proc. SIGGRAPH) 29 (2010), 3. Google ScholarDigital Library
- Kimmel, R. Numerical Geometry of Images: Theory, Algorithms, and Applications. Springer, 2003. Google ScholarDigital Library
- Li, Y., Sharan, L., and Adelson, E.H. Compressing and companding high dynamic range images with subband architectures. ACM Trans. Graph. (Proc. SIGGRAPH) 24 (2005), 3. Google ScholarDigital Library
- Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. Interactive local adjustment of tonal values. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3. Google ScholarDigital Library
- Mantiuk, R., Myszkowski, K., and Seidel, H.-P. A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. 3 (2006), 3. Google ScholarDigital Library
- Mantiuk, R., Mantiuk, R., Tomaszewska, A., and Heidrich, W. Color correction for tone mapping. Comput. Graph. Forum (Proc. Eurographics) 28 (2009), 2.Google ScholarCross Ref
- Masia, B., Agustin, S., Fleming, R.W., Sorkine, O., and Gutierrez, D. Evaluation of reverse tone mapping through varying exposure conditions. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5. Google ScholarDigital Library
- Paris, S. and Durand, F. Tone-mapping code. http://people.csail.mit.edu/sparis/code/src/tone_mapping.zip.Google Scholar
- Paris, S., Kornprobst, P., Tumblin, J., and Durand, F. Bilateral filtering: Theory and applications. Found. Trends Comput. Graph. Vision 4, 1 (2009), 1--74. Google ScholarDigital Library
- Paris, S., Hasinoff, S.W., and Kautz, J. Local Laplacian Filters: Edge-aware image processing with a Laplacian pyramid. ACM Trans. Graph. (Proc. SIGGRAPH) 30 (2011), 4. Google ScholarDigital Library
- Perona, P. and Malik, J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12 (1990), 7. Google ScholarDigital Library
- Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. Photographic tone reproduction for digital images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3. Google ScholarDigital Library
- Subr, K., Soler, C., and Durand, F. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5. Google ScholarDigital Library
- Sunkavalli, K., Johnson, M.K., Matusik, W., and Pfister, H. Multiscale image harmonization. ACM Trans. Graph. (Proc. SIGGRAPH) 29 (2010), 3. Google ScholarDigital Library
- Szeliski, R. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3. Google ScholarDigital Library
- Tomasi, C. and Manduchi, R. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision (Bombay, India, 1998). Google ScholarDigital Library
- Tumblin, J. and Turk, G. Low curvature image simplifiers (LCIS): A boundary hierarchy for detail-preserving contrast reduction. In Proc. SIGGRAPH (1999). Google ScholarDigital Library
- Vuylsteke, P. and Schoeters, E.P. Multiscale image contrast amplification (MUSICA). In Proc. SPIE, Volume 2167 (1994).Google Scholar
- Witkin, A. Scale-space filtering. In Proceedings of the International Joint Conference on Artificial Intelligence, Volume 2 (Karlsruhe, Federal Republic of Germany (a.k.a. West Germany), 1983. Google ScholarDigital Library
- Witkin, A., Terzopoulos, D., and Kass, M. Signal matching through scale space. Int. J. Comput. Vision 1 (1987), 2.Google ScholarCross Ref
- Xu, L., Lu, C., Xu, Y., and Jia, J. Image smoothing via L0 gradient minimization. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 30 (2011), 5. Google ScholarDigital Library
- Xu, L., Yan, Q., Xia, Y., and Jia, J. Structure extraction from texture via relative total variation. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5. Google ScholarDigital Library
Index Terms
- Local Laplacian filters: edge-aware image processing with a Laplacian pyramid
Recommendations
Fast Local Laplacian Filters: Theory and Applications
Multiscale manipulations are central to image editing but also prone to halos. Achieving artifact-free results requires sophisticated edge-aware techniques and careful parameter tuning. These shortcomings were recently addressed by the local Laplacian ...
Local Laplacian filters: edge-aware image processing with a Laplacian pyramid
The Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed as being unable ...
Local Laplacian filters: edge-aware image processing with a Laplacian pyramid
SIGGRAPH '11: ACM SIGGRAPH 2011 papersThe Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed as being unable ...
Comments