Levent Karacan
Abstract
Recent years have witnessed the emergence of new image smoothing techniques which have provided new insights and raised new questions about the nature of this well-studied problem. Specifically, these models separate a given image into its structure and texture layers by utilizing non-gradient based definitions for edges or special measures that distinguish edges from oscillations. In this study, we propose an alternative yet simple image smoothing approach which depends on covariance matrices of simple image features, aka the region covariances. The use of second order statistics as a patch descriptor allows us to implicitly capture local structure and texture information and makes our approach particularly effective for structure extraction from texture. Our experimental results have shown that the proposed approach leads to better image decompositions as compared to the state-of-the-art methods and preserves prominent edges and shading well. Moreover, we also demonstrate the applicability of our approach on some image editing and manipulation tasks such as image abstraction, texture and detail enhancement, image composition, inverse halftoning and seam carving.
- Aujol, J.-F., Gilboa, G., Chan, T., and Osher, S. 2006. Structure-texture image decomposition--modeling, algorithms, and parameter selection. Int. J. Comput. Vision 67, 1, 111--136. Google Scholar
Digital Library
- Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
- Baek, J., and Jacobs, D. E. 2010. Accelerating spatially varying gaussian filters. ACM Trans. Graph. 29, 6. Google ScholarDigital Library
- Buades, A., Coll, B., and Morel, J.-M. 2005. A non-local algorithm for image denoising. In CVPR, vol. 2, 60--65. Google ScholarDigital Library
- Buades, A., Le, T. M., Morel, J.-M., and Vese, L. A. 2010. Fast cartoon + texture image filters. IEEE Trans. Image Process. 19, 8, 1978--1986. Google ScholarDigital Library
- Burt, P. J., and Adelson, E. H. 1983. The laplacian pyramid as a compact image code. IEEE Trans. Commun. 31, 4, 532--540.Google ScholarCross Ref
- Cherian, A., Sra, S., Banerjee, A., and Papanikolopoulos, N. 2011. Efficient similarity search for covariance matrices via the Jensen-Bregman LogDet divergence. In ICCV, 2399--2406. Google ScholarDigital Library
- Criminisi, A., Sharp, T., Rother, C., and Pérez, P. 2010. Geodesic image and video editing. ACM Trans. Graph. 29, 5. Google ScholarDigital Library
- Dowson, N., and Salvado, O. 2011. Hashed nonlocal means for rapid image filtering. IEEE Trans. on Pattern Analysis and Machine Intelligence 33, 3, 485--499. Google ScholarDigital Library
- Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3, 257--266. Google ScholarDigital Library
- Efros, A., and Leung, T. 1999. Texture synthesis by nonparametric sampling. In ICCV, 1033--1038. Google ScholarDigital Library
- Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3. Google ScholarDigital Library
- Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. 29, 6. Google ScholarDigital Library
- Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
- Gilboa, G., Sochen, N., and Zeevi, Y. 2002. Regularized shock filters and complex diffusion. In ECCV, 399--313. Google ScholarDigital Library
- Hong, X., Chang, H., Shan, S., Chen, X., and Gao, W. 2009. Sigma set: A small second order statistical region descriptor. In CVPR, 1802--1809.Google Scholar
- Kopf, J., and Lischinski, D. 2012. Digital reconstruction of halftoned color comics. ACM Trans. Graph. 31, 6. Google ScholarDigital Library
- Marr, D. 1982. Vision. W. H. Freeman and Company.Google Scholar
- Meyer, Y. 2001. Oscillating patterns in image processing and nonlinear evolution equations: the fifteenth Dean Jacqueline B. Lewis memorial lectures, vol. 22. Amer Mathematical Society. Google ScholarDigital Library
- Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 629--639. Google ScholarDigital Library
- Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. 2010. A comparative study of image retargeting. ACM Trans. Graph. 29, 6. Google ScholarDigital Library
- Rudin, L., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Phys. D. 60, 259--268. Google ScholarDigital Library
- Subr, K., Soler, C., and Durand, F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. 28, 5. Google ScholarDigital Library
- Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839--846. Google ScholarDigital Library
- Tuzel, O., Porikli, F., and Meer, P. 2006. Region covariance: A fast descriptor for detection and classification. ECCV, 589--600. Google ScholarDigital Library
- Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Realtime video abstraction. ACM Trans. Graph. 25, 3, 1221--1226. Google ScholarDigital Library
- Witkin, A. P. 1984. Scale-space filtering: A new approach to multi-scale description. In ICASSP, vol. 9, 150--153.Google ScholarCross Ref
- Xu, L., Lu, C., Xu, Y., and Jia, J. 2011. Image smoothing via L0 gradient minimization. ACM Trans. Graph. 30, 6. Google ScholarDigital Library
- Xu, L., Yan, Q., Xia, Y., and Jia, J. 2012. Structure extraction from texture via relative total variation. ACM Trans. Graph. 31, 6. Google ScholarDigital Library
- Zontak, M., Mosseri, I., and Irani, M. 2013. Separating signal from noise using patch recurrence across scales. In CVPR. Google ScholarDigital Library
Index Terms
- Structure-preserving image smoothing via region covariances
Recommendations
An effective edge-preserving smoothing method for image manipulation
This paper presents a novel and effective edge-preserving image smoothing method for edge-aware image manipulation. The method formulates the smoothing as a problem of minimizing a convex object function with a constraint and an efficient solution to ...
Structure-preserving texture filtering for adaptive image smoothing
AbstractExtracting meaningful structures from images with complicated texture patterns is challenging since it is hard to separate structure from texture with similar scale or intensity contrast. In this paper, we propose a structure-...
Iterative range-domain weighted filter for structural preserving image smoothing and de-noising
The filtering weights from both spatial domain and range domain in the bilateral filtering always restrict filtering output value highly related to very close neighboring pixels, which results in very small changes before and after filtering. In order ...
Comments