Abstract
This paper proposes a novel method to synthesize shallow depth-of-field images from two input photographs taken with different aperture values. The basic approach is to estimate the depth map of a given scene using a DFD (depth-from-defocus) algorithm and blur an input image according to the estimated depth map. The depth information estimated by DFD contains much noise and error, while the estimation is rather accurate along the edges of the image. To overcome the limitation, we propose a depth map filling algorithm using a set of initial depth maps and a segmented image. After depth map filling, the depth map can be fine tuned by applying segment clustering and user interaction. Since our method blurs an input image according to the estimated depth information, it generates physically plausible result images with shallow depth-of-field. In addition to depth-of-field control, the proposed method can be utilized for digital refocusing and detail control in image stylization.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
CombineZ5. http://www.hadleyweb.pwp.blueyonder.co.uk/
Depth-of-field adapter. http://en.wikipedia.org/wiki/Depth-of-field-adapter/
Depth of Field Generator Pro. http://www.dofpro.com/
Helicon Focus. http://heliconfilter.com/
Letus35. http://www.letus35.com/
SGPro. http://www.sgpro.co.uk/
Shallow depth of field tutorial. http://www.digicamhelp.com/processing-photos/advanced-editing/create-dof2.php
Simulating shallow depth of field with the GIMP. http://www.gimpguru.org/Tutorials/SimulatedDOF/
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Graph. 23, 294–302 (2004)
Cho, S., Tam, W.J., Speranza, F., Renaud, R., Hur, N., Lee, S.I.: Depth maps created from blur information using images with focus at near and at far. Proc. SPIE 6055, 462–473 (2006)
Christoudias, C., Georgescu, B., Meer, P.: Synergism in lowlevel vision. In: Proceedings of the 16th International Conference on Pattern Recognition, pp. 150–155. Quebec City, QC (2002)
Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24, 603–619 (2002)
Cosgrove, R.: Creating depth of field. Digit. Photogr. Buyer User, p. 89 (2003)
Forster, B., Ville, D.V.D., Berent, J., Sage, D., Unser, M.: Complex wavelets for extended depth-of-field: a new method for the fusion of multichannel microscopy images. Microsc. Res. Tech. 65, 33–42 (2004)
Forster, B., Ville, D.V.D., Berent, J., Sage, D., Unser, M.: Extended depth-of-focus for multi-channel microscopy images: a complex wavelet approach. In: Proceedings of the Second 2004 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 660–663. Arlington, VA (2004)
Lacey, R.: Creating depth of field in Paint Shop Pro. http://graphicssoft.about.com/od/paintshoppro/ss/∼rldepthoffield.htm
Lin, J., Zhang, C., Shi, Q.: Estimating the amount of defocus through a wavelet transform approach. Pattern Recogn. Lett. 25, 407–411 (2004)
London, B., Upton, J., Kobre, K., Brill, B.: Photography, 8th edn. Prentice Hall (2004)
Merklinger, H.M.: The ins and outs of focus. Internet edition is available in PDF at http://www.trenholm.org/hmmerk/
Ng, R.: Fourier slice photography. ACM Trans. Graph. 24, 735–744 (2005)
Ng, R., Levoy, M., Bredif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Stanford University Computer Science Tech. Rep. (2005)
Pentland, A.P.: A new sense for depth of field. IEEE Trans. Pattern Anal. Mach. Intell. 9, 523–531 (1987)
Raskar, R., Tumblin, J.: SIGGRAPH ’2005 course notes on computational photography, SIGGRAPH. ACM (2005)
Raskar, R., Tumblin, J., Levoy, M., Nayer, S.: SIGGRAPH ’2006 course notes on computational photography, SIGGRAPH. ACM (2006)
Ray, S.F.: Applied Photographic Optics, 3rd edn. Focal Press (1988)
Subbarao, M., Surya, G.: Depth from defocus: a spatial domain approach. Int. J. Comput. Vis. 13, 271–294 (1994)
Surya, G.: Three-dimensional scene recovery from image defocus. Ph.D. thesis, Department of Electrical Engineering, State University of New York (SUNY) at Stony Brook (1994)
Tucker, S.C., Cathey, W.T., Dowski, E.R.: Extended depth of field and aberration control for inexpensive digital microscope systems. Opt. Express 4, 467 (1999)
Watanabe, M., Nayar, S.K.: Rational filters for passive depth from defocus. Int. J. Comput. Vis. 27, 203–225 (1998)
Weiss, B.: Fast median and bilateral filtering. ACM Trans. Graph. 25, 519–526 (2006)
Winnemöller, H., Olsen, S.C., Gooch, B.: Real-time video abstraction. ACM Trans. Graph. 25, 1221–1226 (2006)
Ziou, D., Deschenes, F.: Depth from defocus estimation in spatial domain. Comput. Vis. Image Understand. 81, 143–165 (2001)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jeong, K., Kim, D., Park, SY. et al. Digital shallow depth-of-field adapter for photographs. Visual Comput 24, 281–294 (2008). https://doi.org/10.1007/s00371-007-0199-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-007-0199-3