Subhabrata Bhattacharya
Mubarak Shah
Abstract
This article presents an interactive application that enables users to improve the visual aesthetics of their digital photographs using several novel spatial recompositing techniques. This work differs from earlier efforts in two important aspects: (1) it focuses on both photo quality assessment and improvement in an integrated fashion, (2) it enables the user to make informed decisions about improving the composition of a photograph. The tool facilitates interactive selection of one or more than one foreground objects present in a given composition, and the system presents recommendations for where it can be relocated in a manner that optimizes a learned aesthetic metric while obeying semantic constraints. For photographic compositions that lack a distinct foreground object, the tool provides the user with crop or expansion recommendations that improve the aesthetic appeal by equalizing the distribution of visual weights between semantically different regions. The recomposition techniques presented in the article emphasize learning support vector regression models that capture visual aesthetics from user data and seek to optimize this metric iteratively to increase the image appeal. The tool demonstrates promising aesthetic assessment and enhancement results on variety of images and provides insightful directions towards future research.
- Avidan, S. and Shamir, A. 2007. Seam carving for content-aware image resizing. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. Google Scholar
Digital Library
- Boutell, M. and Luo, J. 2004. Bayesian fusion of camera metadata cues in semantic scene classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarDigital Library
- Cho, T. S., Butman, M., Avidan, S., and Freeman, W. T. 2008. The patch transform and its applications to image editing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google Scholar
- Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2006. Studying aesthetics in photographic images using a computational approach. In Proceedings of the European Conference on Computer Vision. Google ScholarDigital Library
- Datta, R., Li, J., and Wang, J. Z. 2007. Learning the consensus on visual quality for next-generation image management. In Proceedings of the ACM Multimedia Conference. Google ScholarDigital Library
- Hartley, R. and Zisserman, A. 2004. Multiple View Geometry in Computer Vision, 2nd Ed. Cambridge University Press. Google ScholarDigital Library
- Hoiem, D., Efros, A., and Hebert, M. 2007. Recovering surface layout from an image. Int. J.Comput Vis. 75, 1. Google ScholarDigital Library
- Joachims, T. 1999. Making large-scale SVM learning practical. In Advances in Kernel Methods: Support Vector Learning. MIT Press. Google ScholarDigital Library
- Jonas, P. 1976. Photographic Composition Simplified. Amphoto Publishers. 2, 6, 15.Google Scholar
- Ke, Y., Tang, X., and Jing, F. 2006. The design of high-level features for photo quality assessment. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarDigital Library
- Leyvand, T., Cohen-Or, D., Dror, G., and Lischinski, D. 2008. Data-driven enhancement of facial attractiveness. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. Google ScholarDigital Library
- Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., and Freeman, W. T. 2008. Automatic estimation and removal of noise from a single image. IEEE Trans. Patt. Anal. Mach. Intel. 30, 299--314. Google ScholarDigital Library
- Livio, M. 2002. The golden ratio and aesthetics. Plus Mag. Living Math.Google Scholar
- Luo, Y. and Tang, X. 2008. Photo and video quality evaluation: Focusing on the subject. In Proceedings of the European Conference on Computer Vision. Google ScholarDigital Library
- Mansoor, A., Haider, M., Mian, A., and Khan, S. 2009. A hybrid image quality measure for automatic image quality assessment. In Proceedings of the Scandinavian Conference on Image Analysis. Google ScholarDigital Library
- Nishiyama, M., Okabe, T., Sato, Y., and Sato, I. 2009. Sensation-based photo cropping. In Proceedings of the ACM Multimedia Conference. 669--672. Google ScholarDigital Library
- Sun, X., Yao, H., Ji, R., and Liu, S. 2009. Photo assessment based on computational visual attention model. In Proceedings of the ACM Multimedia Conference. 541--544. Google ScholarDigital Library
- Venkata, N. D., Kite, T. D., Geisler, W. S., Evans, B. L., and Bovik, A. C. 2000. Image quality assessment based on a degradation model. IEEE Trans. Image Process. 9, 2. Google ScholarDigital Library
- Walther, D. and Koch, C. 2006. Modeling attention to salient proto-objects. Neural Networks 19, 4. Google ScholarDigital Library
- You, J., Perkis, A., Hannuksela, M., and Gabbouj, M. 2009. Perceptual quality assessment based on visual attention analysis. In Proceedings of the ACM Multimedia Conference. Google ScholarDigital Library
- Zhang, Y., Xiao, J., and Shah, M. 2004. Region completion in single image. In Proceedings of EUROGRAPHICS.Google Scholar
Index Terms
- A holistic approach to aesthetic enhancement of photographs
Recommendations
A framework for photo-quality assessment and enhancement based on visual aesthetics
MM '10: Proceedings of the 18th ACM international conference on MultimediaWe present an interactive application that enables users to improve the visual aesthetics of their digital photographs using spatial recomposition. Unlike earlier work that focuses either on photo quality assessment or interactive tools for photo ...
Designing for Aesthetic Experience
C&C '21: Proceedings of the 13th Conference on Creativity and CognitionDigital ways of representing fine art are significantly changing the way art is put on display. New exhibition formats including digital projections of fine art allow us to rethink how we can use technology to create art experiences. However, ...
Towards category-based aesthetic models of photographs
MMM'12: Proceedings of the 18th international conference on Advances in Multimedia ModelingWe present a novel data-driven category-based approach to automatically assess the aesthetic appeal of photographs. In order to tackle this problem, a novel set of image segmentation methods based on <em>feature contrast</em> are introduced, such that <...
Comments