Li Xu
Qiong Yan
Skip Abstract Section
Abstract
It is ubiquitous that meaningful structures are formed by or appear over textured surfaces. Extracting them under the complication of texture patterns, which could be regular, near-regular, or irregular, is very challenging, but of great practical importance. We propose new inherent variation and relative total variation measures, which capture the essential difference of these two types of visual forms, and develop an efficient optimization system to extract main structures. The new variation measures are validated on millions of sample patches. Our approach finds a number of new applications to manipulate, render, and reuse the immense number of "structure with texture" images and drawings that were traditionally difficult to be edited properly.
- Arbelaez, P., Maire, M., Fowlkes, C., and Malik, J. 2011. Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 5, 898--916. Google Scholar
Digital Library
- Arnheim, R. 1956. Art and Visual Perception: A Psychology of the Creative Eye. University of California Press.Google Scholar
- Aujol, J.-F., Gilboa, G., Chan, T. F., and Osher, S. 2006. Structure-texture image decomposition - modeling, algorithms, and parameter selection. International Journal of Computer Vision 67, 1, 111--136. Google ScholarDigital Library
- Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3, 10. Google ScholarDigital Library
- Canny, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 6, 679--698. Google ScholarDigital Library
- Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3, 257--266. Google ScholarDigital Library
- Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341--346. Google ScholarDigital Library
- Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In ICCV, 1033--1038. Google ScholarDigital Library
- Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3. Google ScholarDigital Library
- Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. 29, 6, 145. Google ScholarDigital Library
- Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 3, 51. Google ScholarDigital Library
- Goferman, S., Zelnik-Manor, L., and Tal, A. 2010. Context-aware saliency detection. In CVPR, 2376--2383.Google Scholar
- Hays, J., Leordeanu, M., Efros, A. A., and Liu, Y. 2006. Discovering texture regularity as a higher-order correspondence problem. In ECCV (2), 522--535. Google ScholarDigital Library
- Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. 2001. Image analogies. In SIGGRAPH, 327--340. Google ScholarDigital Library
- Kass, M., and Solomon, J. 2010. Smoothed local histogram filters. ACM Trans. Graph. 29, 4. Google ScholarDigital Library
- Krishnan, D., and Szeliski, R. 2011. Multigrid and multilevel preconditioners for computational photography. ACM Trans. Graph. 30, 6. Google ScholarDigital Library
- Kwatra, V., Schödl, A., Essa, I. A., Turk, G., and Bobick, A. F. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277--286. Google ScholarDigital Library
- Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689--694. Google ScholarDigital Library
- Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646--653. Google ScholarDigital Library
- Liu, Y., Collins, R. T., and Tsin, Y. 2003. A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Trans. Pattern Anal. Mach. Intell. 26, 3, 354--371. Google ScholarDigital Library
- Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. ACM Trans. Graph. 23, 3, 368--376. Google ScholarDigital Library
- Liu, Y., Belkina, T., Hays, J., and Lublinerman, R. 2008. Image de-fencing. In CVPR.Google Scholar
- Malik, J., Belongie, S., Leung, T. K., and Shi, J. 2001. Contour and texture analysis for image segmentation. International Journal of Computer Vision 43, 1, 7--27. Google ScholarDigital Library
- Meyer, Y. 2001. Oscillating patterns in image processing and nonlinear evolution equations: the fifteenth Dean Jacqueline B. Lewis memorial lectures, vol. 22. American Mathematical Society. Google ScholarDigital Library
- Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In ECCV (4), 568--580. Google ScholarDigital Library
- Paris, S., Hasinoff, S. W., and Kautz, J. 2011. Local laplacian filters: Edge-aware image processing with a laplacian pyramid. ACM Trans. Graph. 30, 4, 68. Google ScholarDigital Library
- Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313--318. Google ScholarDigital Library
- Rudin, L., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena 60, 1--4, 259--268. Google ScholarDigital Library
- Subr, K., Soler, C., and Durand, F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. 28, 5. Google ScholarDigital Library
- Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. 25, 3, 1135--1143. Google ScholarDigital Library
- Tuceryan, M. 1994. Moment-based texture segmentation. Pattern Recognition Letters 15, 7, 659--668. Google ScholarDigital Library
- Vector Magic, Inc., 2010. Vector magic. http://vectormagic.com.Google Scholar
- Watson, G. S. 1983. Statistics on spheres. John Wiley and Sons.Google Scholar
- Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH, 479--488. Google ScholarDigital Library
- Wei, L., Lefebvre, S., Kwatra, V., Turk, G., et al. 2009. State of the art in example-based texture synthesis. In Eurographics' 09 State of the Art Report.Google Scholar
- Xu, L., Lu, C., Xu, Y., and Jia, J. 2011. Image smoothing via l0 gradient minimization. ACM Trans. Graph. 30, 6. Google ScholarDigital Library
- Yin, W., Goldfarb, D., and Osher, S. 2005. Image cartoon-texture decomposition and feature selection using the total variation regularized 11 functional. In VLSM, 73--84. Google ScholarDigital Library
Index Terms
- Structure extraction from texture via relative total variation
Recommendations
Multi-scale inherent variation features-based texture filtering
In order to smooth the multi-scale texture with strong gradient while maintaining the weak structure which is challenging for the existing texture filtering methods, we put forward a novel algorithm based on multi-scale inherent variation features. ...
Maximally Stable Texture Regions
ICPR '10: Proceedings of the 2010 20th International Conference on Pattern RecognitionIn this study, we propose to detect interest regions based on texture information of images. For this purpose, Maximally Stable Extremal Regions (MSER) approach is extended using the high dimensional texture features of image pixels. The regions with ...
Region covariance based total variation optimization for structure-texture decomposition
With conventional structure-preserving filters, it is not always easy to remove texture details and preserve important structures from images of high complexity. To enhance the performance of structure-texture decomposition, a new method based on region ...
Comments