ABSTRACT
We present a non-photorealistic algorithm for retargeting large images to small size displays, particularly on mobile devices. This method adapts large images so that important objects in the image are still recognizable when displayed at a lower target resolution. Existing image manipulation techniques such as cropping works well for images containing a single important object, and down-sampling works well for images containing low frequency information. However, when these techniques are automatically applied to images with multiple objects, the image quality degrades and important information may be lost. Our algorithm addresses the case of multiple important objects in an image. The retargeting algorithm segments an image into regions, identifies important regions, removes them, fills the resulting gaps, resizes the remaining image, and re-inserts the important regions. Our approach lies in constructing a topologically constrained epitome of an image based on a visual attention model that is both comprehensible and size varying, making the method suitable for display-critical applications.
- http://www.adobe.com/. Adobe Photoshop.Google Scholar
- Bregler, C., 1998. Tracking people with twists and exponential maps. Google ScholarDigital Library
- Carpendale, M. S. T., and Montagnese, C. 2001. A framework for unifying presentation space. In UIST '01, 82--92. Google ScholarDigital Library
- Chen, L., Xie, X., Fan, X., Ma, W.-Y., Zhang, H.-J., and Zhou, H. 2002. A visual attention model for adapting images on small displays. Tech. Rep. MSR-TR-2002-125, Microsoft Research, Nov.Google Scholar
- Chen, L.-Q., Xie, X., Fan, X., Ma, W.-Y., Zhang, H.-J., and Zhou, H.-Q. 2003. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal, 353--364.Google Scholar
- Chen, L.-Q., Xie, X., Ma, W.-Y., AND Zhou, H.-Q. 2003. Image adaptation based on attention model for small-form factor devices. In Proceeding of the 9th International Conference on Multimedia Modeling, IEEE, 421--439.Google Scholar
- Drori, I., Cohen-Or, D., AND Yeshurun, H. 2003. Fragment-based image completion. ACM Transactions on Graphics 22, 3 (July), 303--312. Google ScholarDigital Library
- Fan, X., Xie, X., Zhou, H.-Q., and Ma, W.-Y. 2003. Looking into video frames on small displays. In Proceedings ACM Multimedia 2003. Short Paper. Google ScholarDigital Library
- http://www.gimp.org/. The GNU Image Manipulation Program.Google Scholar
- Harrison, P. 2001. A non-hierarchical procedure for re-synthesis of complex textures. In Proceedings of WSCG 2001, 190--197.Google Scholar
- Itti, L., Koch, C., AND Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. vol. 20, 1254--1259. Google ScholarDigital Library
- Jojic, N., Frey, B., and Kannan, A. 2003. Epitomic analysis of appearance and shape. In 9th IEEE International Conference on Computer Vision, 34--41. Google ScholarDigital Library
- Kosslyn, S. M. 1978. On the ontological status of visual mental images. In Theoretical issues in natural language processing, Association for Computational Linguistics, 167--171. Google ScholarDigital Library
- Liu, H., Xie, X., Ma, W.-Y., and Zhang, H.-J. 2003. Automatic browsing of large pictures on mobile devices. In Proceedings of the eleventh ACM international conference on Multimedia, ACM, 148--155. Google ScholarDigital Library
- Ma, Y.-F., and Zhang, H.-J. 2003. Contrast-based image attention analysis by using fuzzy growing. In Proceedings ACM Multimedia 2003, 374--381. Google ScholarDigital Library
- Ma, Y.-F., Lu, L., Zhang, H.-J., and Li, M. 2002. A user attention model for video summarization. In Proceedings of the tenth ACM international conference on Multimedia, ACM Press, 533--542. Google ScholarDigital Library
- May, J. 2000. Perceptual principles and computer graphics. In Computer Graphics Forum, vol. 19.Google ScholarCross Ref
- Meer, P., and Georgescu, B. 2001. Edge detection with embedded confidence. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 12. Google ScholarDigital Library
- Niblack, W., Barber, R., Equitz, W., Flickner, M., Glasman, E. H., Petkovic, D., Yanker, P., Faloutsos, C., and Taubin, G. 1993. The qbic project: Querying images by content, using color, texture, and shape. In Vol. 1908, SPIE, 173--187.Google Scholar
- Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3 (July), 313--318. Google ScholarDigital Library
- Rogers, S. 1995. Perceiving pictorial space. In Perception of Space and Motion, Chapter 4. Academic Press, Inc.Google Scholar
- Rowley, H. A., Baluja, S., and Kanade, T. 1996. Human face detection in visual scenes. In Advances in Neural Information Processing Systems, The MIT Press, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds., vol. 8, 875--881.Google Scholar
- Rushmeier, H., Barrett, H., Rheingans, P., Uselton, S., and Watson, A. 1997. Perceptual measures for effective visualizations. In VIS '97, IEEE Computer Society Press, 515--517. Google ScholarDigital Library
- Schneiderman, H., and Kanade, T. 2000. A statistical model for 3d object detection applied to faces and cars. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition - Volume 1, IEEE, 746--751.Google Scholar
- Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In User interface software and technology, ACM, 11--99. Google ScholarDigital Library
- Swain, M., and Ballard, D. 1991. Color indexing. International Journal on Computer Vision 7, 1, 11--32. Google ScholarDigital Library
Index Terms
- Automatic image retargeting
Recommendations
Retargeting Images and Video for Preserving Information Saliency
A nonphotorealistic algorithm for retargeting images adapts large images so that important objects in the image are still recognizable when displayed at a lower target resolution. Unlike existing image manipulation techniques such as cropping and ...
Saliency-based content-aware lifestyle image mosaics
We proposed a novel content-aware lifestyle image mosaic technique based on image saliency.A novel energy map for variable-size tile decomposition is proposed by combining NIF and GBVS.Saliency-weighted image retrieval is introduced to choose the tile ...
Aesthetic-guided outward image cropping
Image cropping is a commonly used post-processing operation for adjusting the scene composition of an input photography, therefore improving its aesthetics. Existing automatic image cropping methods are all bounded by the image border, thus have very ...
Comments