Skip to main content
Top

2014 | OriginalPaper | Chapter

Introducing More Physics into Variational Depth–from–Defocus

Authors : Nico Persch, Christopher Schroers, Simon Setzer, Joachim Weickert

Published in: Pattern Recognition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Given an image stack that captures a static scene with different focus settings, variational depth–from–defocus methods aim at jointly estimating the underlying depth map and the sharp image. We show how one can improve existing approaches by incorporating important physical properties. Most formulations are based on an image formation model (forward operator) that explains the varying amount of blur depending on the depth. We present a novel forward operator: It approximates the thin–lens camera model from physics better than previous ones used for this task, since it preserves the maximum–minimum principle w.r.t. the unknown image intensities. This operator is embedded in a variational model that is minimised with a multiplicative variant of the Euler–Lagrange formalism. This offers two advantages: Firstly, it guarantees that the solution remains in the physically plausible positive range. Secondly, it allows a stable gradient descent evolution without the need to adapt the relaxation parameter. Experiments with synthetic and real–world images demonstrate that our model is highly robust under different initialisations. Last but not least, the experiments show that the physical constraints are essential for obtaining more accurate solutions, especially in the presence of strong depth changes.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aguet, F., Van De Ville, D., Unser, M.: Model-based 2.5-D deconvolution for extended depth of field in brightfield microscopy. IEEE Trans. Image Process. 17(7), 1144–1153 (2008)MathSciNetCrossRef Aguet, F., Van De Ville, D., Unser, M.: Model-based 2.5-D deconvolution for extended depth of field in brightfield microscopy. IEEE Trans. Image Process. 17(7), 1144–1153 (2008)MathSciNetCrossRef
2.
go back to reference Barsky, B.A., Kosloff, T.J.: Algorithms for rendering depth of field effects in computer graphics. In: Proceedings of WSEAS International Conference on Computers, pp. 999–1010. World Scientific and Engineering Academy and Society, Heraklion, July 2008 Barsky, B.A., Kosloff, T.J.: Algorithms for rendering depth of field effects in computer graphics. In: Proceedings of WSEAS International Conference on Computers, pp. 999–1010. World Scientific and Engineering Academy and Society, Heraklion, July 2008
3.
go back to reference Bhasin, S., Chaudhuri, S.: Depth from defocus in presence of partial self occlusion. In: Proceedings of IEEE International Conference on Computer Vision, vol. 1, pp. 488–493. Vancouver, Canada, July 2001 Bhasin, S., Chaudhuri, S.: Depth from defocus in presence of partial self occlusion. In: Proceedings of IEEE International Conference on Computer Vision, vol. 1, pp. 488–493. Vancouver, Canada, July 2001
4.
go back to reference Born, M., Wolf, E.: Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light, 4th edn. Pergamon Press, Oxford (1970) Born, M., Wolf, E.: Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light, 4th edn. Pergamon Press, Oxford (1970)
5.
go back to reference Cant, R., Langensieoen, C.: Creating depth of field effects without multiple samples. In: Proceeding of IEEE International Conference on Computer Modelling and Simulation, pp. 159–164. Cambridge, UK, Mar 2012 Cant, R., Langensieoen, C.: Creating depth of field effects without multiple samples. In: Proceeding of IEEE International Conference on Computer Modelling and Simulation, pp. 159–164. Cambridge, UK, Mar 2012
6.
go back to reference Chan, T.F., Wong, C.K.: Total variation blind deconvolution. IEEE Trans. Image Process. 7, 370–375 (1998)CrossRef Chan, T.F., Wong, C.K.: Total variation blind deconvolution. IEEE Trans. Image Process. 7, 370–375 (1998)CrossRef
7.
go back to reference Chaudhuri, S., Rajagopalan, A.: Depth from Defocus: A Real Aperture Imaging Approach. Springer, Berlin (1999) Chaudhuri, S., Rajagopalan, A.: Depth from Defocus: A Real Aperture Imaging Approach. Springer, Berlin (1999)
8.
go back to reference Cook, R.L., Porter, T., Carpenter, L.: Distributed ray tracing. In: Computer Graphics, SIGGRAPH ’84, pp. 137–145. ACM, Minneapolis, Jul 1984 Cook, R.L., Porter, T., Carpenter, L.: Distributed ray tracing. In: Computer Graphics, SIGGRAPH ’84, pp. 137–145. ACM, Minneapolis, Jul 1984
9.
go back to reference Favaro, P., Osher, S., Soatto, S., Vese, L.: 3D shape from anisotropic diffusion. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Madison, USA, Jun 2003 Favaro, P., Osher, S., Soatto, S., Vese, L.: 3D shape from anisotropic diffusion. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Madison, USA, Jun 2003
10.
go back to reference Favaro, P., Soatto, S.: Shape and radiance estimation from the information divergence of blurred images. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1842, pp. 755–768. Springer, Heidelberg (2000)CrossRef Favaro, P., Soatto, S.: Shape and radiance estimation from the information divergence of blurred images. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1842, pp. 755–768. Springer, Heidelberg (2000)CrossRef
11.
go back to reference Favaro, P., Soatto, S., Burger, M., Osher, S.: Shape from defocus via diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 518–531 (2008)CrossRef Favaro, P., Soatto, S., Burger, M., Osher, S.: Shape from defocus via diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 518–531 (2008)CrossRef
12.
go back to reference Gelfand, I.M., Fomin, S.V.: Calculus of Variations. Dover, New York (2000)MATH Gelfand, I.M., Fomin, S.V.: Calculus of Variations. Dover, New York (2000)MATH
13.
go back to reference Hong, L., Yu, J., Hong, C., Sui, W.: Depth estimation from defocus images based on oriented heat-flows. In: Proceedings of IEEE International Conference on Machine Vision, pp. 212–215. Dubai, UAE (2009) Hong, L., Yu, J., Hong, C., Sui, W.: Depth estimation from defocus images based on oriented heat-flows. In: Proceedings of IEEE International Conference on Machine Vision, pp. 212–215. Dubai, UAE (2009)
14.
go back to reference Jin, H., Favaro, P.: A variational approach to shape from defocus. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part II. LNCS, vol. 2351, pp. 18–30. Springer, Heidelberg (2002)CrossRef Jin, H., Favaro, P.: A variational approach to shape from defocus. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part II. LNCS, vol. 2351, pp. 18–30. Springer, Heidelberg (2002)CrossRef
15.
go back to reference Luenberger, D., Ye, Y.: Linear and Nonlinear Programming, 3rd edn. Springer, New York (2008)MATH Luenberger, D., Ye, Y.: Linear and Nonlinear Programming, 3rd edn. Springer, New York (2008)MATH
16.
go back to reference Namboodiri, V.P., Chaudhuri, S.: Use of linear diffusion in depth estimation based on defocus cue. In: Chanda, B., Chandran, S., Davis, L.S. (eds.) Proceedings of Indian Conference on Computer Vision, Graphics and Image Processing, pp. 133–138. Allied Publishers Private Limited, Kolkata (2004) Namboodiri, V.P., Chaudhuri, S.: Use of linear diffusion in depth estimation based on defocus cue. In: Chanda, B., Chandran, S., Davis, L.S. (eds.) Proceedings of Indian Conference on Computer Vision, Graphics and Image Processing, pp. 133–138. Allied Publishers Private Limited, Kolkata (2004)
17.
go back to reference Namboodiri, V.P., Chaudhuri, S.: On defocus, diffusion and depth estimation. Pattern Recogn. Lett. 28(3), 311–319 (2007)CrossRef Namboodiri, V.P., Chaudhuri, S.: On defocus, diffusion and depth estimation. Pattern Recogn. Lett. 28(3), 311–319 (2007)CrossRef
18.
go back to reference Namboodiri, V., Chaudhuri, S., Hadap, S.: Regularized depth from defocus. In: Proceedings of IEEE International Conference on Image Processing, San Diego, USA, pp. 1520–1523, Oct 2008 Namboodiri, V., Chaudhuri, S., Hadap, S.: Regularized depth from defocus. In: Proceedings of IEEE International Conference on Image Processing, San Diego, USA, pp. 1520–1523, Oct 2008
19.
go back to reference Pentland, A.P.: A new sense for depth of field. IEEE Trans. Pattern Anal. Mach. Intell. 9(4), 523–531 (1987)CrossRef Pentland, A.P.: A new sense for depth of field. IEEE Trans. Pattern Anal. Mach. Intell. 9(4), 523–531 (1987)CrossRef
20.
go back to reference Pharr, M., Humphreys, G.: Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann, San Francisco (2004) Pharr, M., Humphreys, G.: Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann, San Francisco (2004)
21.
go back to reference Rokita, P.: Fast generation of depth of field effects in computer graphics. Comput. Graph. 17(5), 593–595 (1993)CrossRef Rokita, P.: Fast generation of depth of field effects in computer graphics. Comput. Graph. 17(5), 593–595 (1993)CrossRef
22.
go back to reference Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)CrossRefMATH Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)CrossRefMATH
23.
go back to reference Subbarao, M.: Parallel depth recovery by changing camera parameters. In: Proceedings of IEEE International Conference on Computer Vision, Washington, USA, pp. 149–155, Dec 1988 Subbarao, M.: Parallel depth recovery by changing camera parameters. In: Proceedings of IEEE International Conference on Computer Vision, Washington, USA, pp. 149–155, Dec 1988
24.
go back to reference Sugimoto, S.A., Ichioka, Y.: Digital composition of images with increased depth of focus considering depth information. Appl. Optics 24(14), 2076–2080 (1985)CrossRef Sugimoto, S.A., Ichioka, Y.: Digital composition of images with increased depth of focus considering depth information. Appl. Optics 24(14), 2076–2080 (1985)CrossRef
25.
go back to reference Tikhonov, A.N.: Solution of incorrectly formulated problems and the regularization method. Sov. Math. Doklady 4, 1035–1038 (1963) Tikhonov, A.N.: Solution of incorrectly formulated problems and the regularization method. Sov. Math. Doklady 4, 1035–1038 (1963)
26.
go back to reference Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
27.
go back to reference Wei, Y., Dong, Z., Wu, C.: Global depth from defocus with fixed camera parameters. In: Proceedings of IEEE International Conference on Mechatronics and Automation, Changchun, China, pp. 1887–1892, Aug 2009 Wei, Y., Dong, Z., Wu, C.: Global depth from defocus with fixed camera parameters. In: Proceedings of IEEE International Conference on Mechatronics and Automation, Changchun, China, pp. 1887–1892, Aug 2009
28.
go back to reference Welk, M., Nagy, J.G.: Variational deconvolution of multi-channel images with inequality constraints. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 386–393. Springer, Heidelberg (2007)CrossRef Welk, M., Nagy, J.G.: Variational deconvolution of multi-channel images with inequality constraints. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 386–393. Springer, Heidelberg (2007)CrossRef
29.
go back to reference Whittaker, E.T.: A new method of graduation. Proc. Edinburgh Math. Soc. 41, 65–75 (1923) Whittaker, E.T.: A new method of graduation. Proc. Edinburgh Math. Soc. 41, 65–75 (1923)
Metadata
Title
Introducing More Physics into Variational Depth–from–Defocus
Authors
Nico Persch
Christopher Schroers
Simon Setzer
Joachim Weickert
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-11752-2_2

Premium Partner