Skip to main content

2015 | OriginalPaper | Buchkapitel

6. Bayesian Inverse Problems

verfasst von : T. J. Sullivan

Erschienen in: Introduction to Uncertainty Quantification

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter provides a general introduction, at the high level, to the backward propagation of uncertainty/information in the solution of inverse problems, and specifically a Bayesian probabilistic perspective on such inverse problems. Under the umbrella of inverse problems, we consider parameter estimation and regression. One specific aim is to make clear the connection between regularization and the application of a Bayesian prior. The filtering methods of Chapter 7 fall under the general umbrella of Bayesian approaches to inverse problems, but have an additional emphasis on real-time computational expediency.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Take a moment to reconcile the statement “there may exist minimizing sequences that do not have a limit in \( \mathcal{U} \)” with \( \mathcal{U} \) being a Banach space.
 
2
Here, the minimization is meant in the sense of positive semi-definite operators: for two operators A and B, we say that A ≤ B if B − A is a positive semi-definite operator.
 
Literatur
Zurück zum Zitat S. Amari and H. Nagaoka. Methods of Information Geometry, volume 191 of Translations of Mathematical Monographs. American Mathematical Society, Providence, RI; Oxford University Press, Oxford, 2000. Translated from the 1993 Japanese original by D. Harada. S. Amari and H. Nagaoka. Methods of Information Geometry, volume 191 of Translations of Mathematical Monographs. American Mathematical Society, Providence, RI; Oxford University Press, Oxford, 2000. Translated from the 1993 Japanese original by D. Harada.
Zurück zum Zitat S. N. Bernšteĭn. Sobranie sochinenii. Tom IV: Teoriya veroyatnostei. Matematicheskaya statistika. 1911–1946. Izdat. “Nauka”, Moscow, 1964. S. N. Bernšteĭn. Sobranie sochinenii. Tom IV: Teoriya veroyatnostei. Matematicheskaya statistika. 1911–1946. Izdat. “Nauka”, Moscow, 1964.
Zurück zum Zitat F. J. Beutler and W. L. Root. The operator pseudoinverse in control and systems identification. In Generalized inverses and applications (Proc. Sem., Math. Res. Center, Univ. Wisconsin, Madison, Wis., 1973), pages 397–494. Publ. Math. Res. Center Univ. Wisconsin, No. 32. Academic Press, New York, 1976. F. J. Beutler and W. L. Root. The operator pseudoinverse in control and systems identification. In Generalized inverses and applications (Proc. Sem., Math. Res. Center, Univ. Wisconsin, Madison, Wis., 1973), pages 397–494. Publ. Math. Res. Center Univ. Wisconsin, No. 32. Academic Press, New York, 1976.
Zurück zum Zitat E. J. Candès, J. Romberg, and T. Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory, 52(2):489–509, 2006a. doi: 10.1109/TIT.2005. 862083.CrossRefMathSciNetMATH E. J. Candès, J. Romberg, and T. Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory, 52(2):489–509, 2006a. doi: 10.1109/TIT.2005. 862083.CrossRefMathSciNetMATH
Zurück zum Zitat E. J. Candès, J. K. Romberg, and T. Tao. Stable signal recovery from incomplete and inaccurate measurements. Comm. Pure Appl. Math., 59 (8):1207–1223, 2006b. doi: 10.1002/cpa.20124.CrossRefMathSciNetMATH E. J. Candès, J. K. Romberg, and T. Tao. Stable signal recovery from incomplete and inaccurate measurements. Comm. Pure Appl. Math., 59 (8):1207–1223, 2006b. doi: 10.1002/cpa.20124.CrossRefMathSciNetMATH
Zurück zum Zitat I. Castillo and R. Nickl. Nonparametric Bernstein–von Mises theorems in Gaussian white noise. Ann. Statist., 41(4):1999–2028, 2013. doi: 10.1214/13-AOS1133.CrossRefMathSciNetMATH I. Castillo and R. Nickl. Nonparametric Bernstein–von Mises theorems in Gaussian white noise. Ann. Statist., 41(4):1999–2028, 2013. doi: 10.1214/13-AOS1133.CrossRefMathSciNetMATH
Zurück zum Zitat I. Castillo and R. Nickl. On the Bernstein–von Mises phenomenon for nonparametric Bayes procedures. Ann. Statist., 42(5):1941–1969, 2014. doi: 10.1214/14-AOS1246.CrossRefMathSciNetMATH I. Castillo and R. Nickl. On the Bernstein–von Mises phenomenon for nonparametric Bayes procedures. Ann. Statist., 42(5):1941–1969, 2014. doi: 10.1214/14-AOS1246.CrossRefMathSciNetMATH
Zurück zum Zitat V. Chandrasekaran, B. Recht, P. A. Parrilo, and A. S. Willsky. The convex geometry of linear inverse problems. Found. Comput. Math., 12(6): 805–849, 2012. doi: 10.1007/s10208-012-9135-7.CrossRefMathSciNetMATH V. Chandrasekaran, B. Recht, P. A. Parrilo, and A. S. Willsky. The convex geometry of linear inverse problems. Found. Comput. Math., 12(6): 805–849, 2012. doi: 10.1007/s10208-012-9135-7.CrossRefMathSciNetMATH
Zurück zum Zitat S. S. Chen, D. L. Donoho, and M. A. Saunders. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 20(1):33–61, 1998. doi: 10.1137/ S1064827596304010.CrossRefMathSciNet S. S. Chen, D. L. Donoho, and M. A. Saunders. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 20(1):33–61, 1998. doi: 10.1137/ S1064827596304010.CrossRefMathSciNet
Zurück zum Zitat S. L. Cotter, M. Dashti, J. C. Robinson, and A. M. Stuart. Bayesian inverse problems for functions and applications to fluid mechanics. Inverse Problems, 25(11):115008, 43, 2009. doi: 10.1088/0266-5611/25/11/115008. S. L. Cotter, M. Dashti, J. C. Robinson, and A. M. Stuart. Bayesian inverse problems for functions and applications to fluid mechanics. Inverse Problems, 25(11):115008, 43, 2009. doi: 10.1088/0266-5611/25/11/115008.
Zurück zum Zitat S. L. Cotter, M. Dashti, and A. M. Stuart. Approximation of Bayesian inverse problems for PDEs. SIAM J. Numer. Anal., 48(1):322–345, 2010. doi: 10.1137/090770734.CrossRefMathSciNetMATH S. L. Cotter, M. Dashti, and A. M. Stuart. Approximation of Bayesian inverse problems for PDEs. SIAM J. Numer. Anal., 48(1):322–345, 2010. doi: 10.1137/090770734.CrossRefMathSciNetMATH
Zurück zum Zitat M. Dashti, S. Harris, and A. Stuart. Besov priors for Bayesian inverse problems. Inverse Probl. Imaging, 6(2):183–200, 2012. doi: 10.3934/ipi. 2012.6.183.CrossRefMathSciNetMATH M. Dashti, S. Harris, and A. Stuart. Besov priors for Bayesian inverse problems. Inverse Probl. Imaging, 6(2):183–200, 2012. doi: 10.3934/ipi. 2012.6.183.CrossRefMathSciNetMATH
Zurück zum Zitat P. Diaconis. Bayesian numerical analysis. In Statistical decision theory and related topics, IV, Vol. 1 (West Lafayette, Ind., 1986), pages 163–175. Springer, New York, 1988. P. Diaconis. Bayesian numerical analysis. In Statistical decision theory and related topics, IV, Vol. 1 (West Lafayette, Ind., 1986), pages 163–175. Springer, New York, 1988.
Zurück zum Zitat P. W. Diaconis and D. Freedman. Consistency of Bayes estimates for nonparametric regression: normal theory. Bernoulli, 4(4):411–444, 1998. doi: 10.2307/3318659.CrossRefMathSciNetMATH P. W. Diaconis and D. Freedman. Consistency of Bayes estimates for nonparametric regression: normal theory. Bernoulli, 4(4):411–444, 1998. doi: 10.2307/3318659.CrossRefMathSciNetMATH
Zurück zum Zitat R. M. Dudley. Real Analysis and Probability, volume 74 of Cambridge Studies in Advanced Mathematics. Cambridge University Press, Cambridge, 2002. doi: 10.1017/CBO9780511755347. Revised reprint of the 1989 original. R. M. Dudley. Real Analysis and Probability, volume 74 of Cambridge Studies in Advanced Mathematics. Cambridge University Press, Cambridge, 2002. doi: 10.1017/CBO9780511755347. Revised reprint of the 1989 original.
Zurück zum Zitat T. A. El Moselhy and Y. M. Marzouk. Bayesian inference with optimal maps. J. Comput. Phys., 231(23):7815–7850, 2012. doi: 10.1016/j.jcp.2012. 07.022.CrossRefMathSciNetMATH T. A. El Moselhy and Y. M. Marzouk. Bayesian inference with optimal maps. J. Comput. Phys., 231(23):7815–7850, 2012. doi: 10.1016/j.jcp.2012. 07.022.CrossRefMathSciNetMATH
Zurück zum Zitat H. W. Engl, M. Hanke, and A. Neubauer. Regularization of Inverse Problems, volume 375 of Mathematics and its Applications. Kluwer Academic Publishers Group, Dordrecht, 1996. doi: 10.1007/978-94-009-1740-8. H. W. Engl, M. Hanke, and A. Neubauer. Regularization of Inverse Problems, volume 375 of Mathematics and its Applications. Kluwer Academic Publishers Group, Dordrecht, 1996. doi: 10.​1007/​978-94-009-1740-8.
Zurück zum Zitat G. Evensen. The ensemble Kalman filter for combined state and parameter estimation: Monte Carlo techniques for data assimilation in large systems. IEEE Control Syst. Mag., 29(3):83–104, 2009. doi: 10.1109/MCS.2009. 932223.CrossRefMathSciNet G. Evensen. The ensemble Kalman filter for combined state and parameter estimation: Monte Carlo techniques for data assimilation in large systems. IEEE Control Syst. Mag., 29(3):83–104, 2009. doi: 10.1109/MCS.2009. 932223.CrossRefMathSciNet
Zurück zum Zitat D. A. Freedman. On the asymptotic behavior of Bayes’ estimates in the discrete case. Ann. Math. Statist., 34:1386–1403, 1963.CrossRefMathSciNet D. A. Freedman. On the asymptotic behavior of Bayes’ estimates in the discrete case. Ann. Math. Statist., 34:1386–1403, 1963.CrossRefMathSciNet
Zurück zum Zitat D. A. Freedman. On the asymptotic behavior of Bayes estimates in the discrete case. II. Ann. Math. Statist., 36:454–456, 1965. D. A. Freedman. On the asymptotic behavior of Bayes estimates in the discrete case. II. Ann. Math. Statist., 36:454–456, 1965.
Zurück zum Zitat P. J. Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82(4):711–732, 1995. doi: 10.1093/biomet/82.4.711.CrossRefMathSciNetMATH P. J. Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82(4):711–732, 1995. doi: 10.1093/biomet/82.4.711.CrossRefMathSciNetMATH
Zurück zum Zitat J. Kaipio and E. Somersalo. Statistical and Computational Inverse Problems, volume 160 of Applied Mathematical Sciences. Springer-Verlag, New York, 2005. J. Kaipio and E. Somersalo. Statistical and Computational Inverse Problems, volume 160 of Applied Mathematical Sciences. Springer-Verlag, New York, 2005.
Zurück zum Zitat P. S. Laplace. Mémoire sur les formules qui sont fonctions des tres grand nombres et sur leurs application aux probabilités. In Oeuvres de Laplace, pages 301–345, 357–412. 1810. P. S. Laplace. Mémoire sur les formules qui sont fonctions des tres grand nombres et sur leurs application aux probabilités. In Oeuvres de Laplace, pages 301–345, 357–412. 1810.
Zurück zum Zitat M. Lassas, E. Saksman, and S. Siltanen. Discretization-invariant Bayesian inversion and Besov space priors. Inverse Probl. Imaging, 3(1):87–122, 2009. doi: 10.3934/ipi.2009.3.87.CrossRefMathSciNetMATH M. Lassas, E. Saksman, and S. Siltanen. Discretization-invariant Bayesian inversion and Besov space priors. Inverse Probl. Imaging, 3(1):87–122, 2009. doi: 10.3934/ipi.2009.3.87.CrossRefMathSciNetMATH
Zurück zum Zitat L. Le Cam. On some asymptotic properties of maximum likelihood estimates and related Bayes’ estimates. Univ. California Publ. Statist., 1: 277–329, 1953.MathSciNet L. Le Cam. On some asymptotic properties of maximum likelihood estimates and related Bayes’ estimates. Univ. California Publ. Statist., 1: 277–329, 1953.MathSciNet
Zurück zum Zitat L. Le Cam. Asymptotic Methods in Statistical Decision Theory. Springer Series in Statistics. Springer-Verlag, New York, 1986. doi: 10.1007/ 978-1-4612-4946-7.CrossRefMATH L. Le Cam. Asymptotic Methods in Statistical Decision Theory. Springer Series in Statistics. Springer-Verlag, New York, 1986. doi: 10.1007/ 978-1-4612-4946-7.CrossRefMATH
Zurück zum Zitat H. Leahu. On the Bernstein–von Mises phenomenon in the Gaussian white noise model. Electron. J. Stat., 5:373–404, 2011. doi: 10.1214/11-EJS611.CrossRefMathSciNetMATH H. Leahu. On the Bernstein–von Mises phenomenon in the Gaussian white noise model. Electron. J. Stat., 5:373–404, 2011. doi: 10.1214/11-EJS611.CrossRefMathSciNetMATH
Zurück zum Zitat D. V. Lindley. Making Decisions. John Wiley & Sons, Ltd., London, second edition, 1985. D. V. Lindley. Making Decisions. John Wiley & Sons, Ltd., London, second edition, 1985.
Zurück zum Zitat T. D. Morley. A Gauss–Markov theorem for infinite-dimensional regression models with possibly singular covariance. SIAM J. Appl. Math., 37(2): 257–260, 1979. doi: 10.1137/0137016.CrossRefMathSciNetMATH T. D. Morley. A Gauss–Markov theorem for infinite-dimensional regression models with possibly singular covariance. SIAM J. Appl. Math., 37(2): 257–260, 1979. doi: 10.1137/0137016.CrossRefMathSciNetMATH
Zurück zum Zitat R. Nickl. Statistical Theory, 2013. http://www.statslab.cam.ac.uk/~nickl/Site/_files/stat2013.pdf. R. Nickl. Statistical Theory, 2013. http://​www.​statslab.​cam.​ac.​uk/​~nickl/​Site/​_​files/​stat2013.​pdf.​
Zurück zum Zitat A. O’Hagan. Some Bayesian numerical analysis. In Bayesian statistics, 4 (Peñíscola, 1991), pages 345–363. Oxford Univ. Press, New York, 1992. A. O’Hagan. Some Bayesian numerical analysis. In Bayesian statistics, 4 (Peñíscola, 1991), pages 345–363. Oxford Univ. Press, New York, 1992.
Zurück zum Zitat H. Owhadi, C. Scovel, and T. J. Sullivan. Brittleness of Bayesian inference under finite information in a continuous world. Electron. J. Stat., 9:1–79, 2015. doi: 10.1214/15-EJS989.CrossRefMathSciNetMATH H. Owhadi, C. Scovel, and T. J. Sullivan. Brittleness of Bayesian inference under finite information in a continuous world. Electron. J. Stat., 9:1–79, 2015. doi: 10.1214/15-EJS989.CrossRefMathSciNetMATH
Zurück zum Zitat H. Poincaré. Calcul des Probabilities. Georges Carré, Paris, 1896. H. Poincaré. Calcul des Probabilities. Georges Carré, Paris, 1896.
Zurück zum Zitat M. Schober, D. Duvenaud, and P. Hennig. Probabilistic ODE solvers with Runge–Kutta means. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 739–747. Curran Associates, Inc., 2014. M. Schober, D. Duvenaud, and P. Hennig. Probabilistic ODE solvers with Runge–Kutta means. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 739–747. Curran Associates, Inc., 2014.
Zurück zum Zitat J. Skilling. Bayesian solution of ordinary differential equations. In Maximum Entropy and Bayesian Methods, pages 23–37, Seattle, 1991. Kluwer Academic Publishers. J. Skilling. Bayesian solution of ordinary differential equations. In Maximum Entropy and Bayesian Methods, pages 23–37, Seattle, 1991. Kluwer Academic Publishers.
Zurück zum Zitat B. T. Szabó, A. W. van der Vaart, and J. H. van Zanten. Honest Bayesian confidence sets for the L 2-norm. J. Statist. Plann. Inference, 2014. doi: 10.1016/j.jspi.2014.06.005. B. T. Szabó, A. W. van der Vaart, and J. H. van Zanten. Honest Bayesian confidence sets for the L 2-norm. J. Statist. Plann. Inference, 2014. doi: 10.1016/j.jspi.2014.06.005.
Zurück zum Zitat B. T. Szabó, A. W. van der Vaart, and J. H. van Zanten. Frequentist coverage of adaptive nonparametric Bayesian credible sets. Ann. Statist., 43(4):1391–1428, 8 2015. doi: 10.1214/14-AOS1270. B. T. Szabó, A. W. van der Vaart, and J. H. van Zanten. Frequentist coverage of adaptive nonparametric Bayesian credible sets. Ann. Statist., 43(4):1391–1428, 8 2015. doi: 10.1214/14-AOS1270.
Zurück zum Zitat A. Tarantola. Inverse Problem Theory and Methods for Model Parameter Estimation. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2005. doi: 10.1137/1.9780898717921. A. Tarantola. Inverse Problem Theory and Methods for Model Parameter Estimation. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2005. doi: 10.1137/1.9780898717921.
Zurück zum Zitat R. Tibshirani. Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B, 58(1):267–288, 1996.MathSciNetMATH R. Tibshirani. Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B, 58(1):267–288, 1996.MathSciNetMATH
Zurück zum Zitat A. N. Tikhonov. On the stability of inverse problems. C. R. (Doklady) Acad. Sci. URSS (N.S.), 39:176–179, 1943. A. N. Tikhonov. On the stability of inverse problems. C. R. (Doklady) Acad. Sci. URSS (N.S.), 39:176–179, 1943.
Zurück zum Zitat A. N. Tikhonov. On the solution of incorrectly put problems and the regularisation method. In Outlines Joint Sympos. Partial Differential Equations (Novosibirsk, 1963), pages 261–265. Acad. Sci. USSR Siberian Branch, Moscow, 1963. A. N. Tikhonov. On the solution of incorrectly put problems and the regularisation method. In Outlines Joint Sympos. Partial Differential Equations (Novosibirsk, 1963), pages 261–265. Acad. Sci. USSR Siberian Branch, Moscow, 1963.
Zurück zum Zitat R. von Mises. Mathematical Theory of Probability and Statistics. Edited and Complemented by Hilda Geiringer. Academic Press, New York, 1964.MATH R. von Mises. Mathematical Theory of Probability and Statistics. Edited and Complemented by Hilda Geiringer. Academic Press, New York, 1964.MATH
Metadaten
Titel
Bayesian Inverse Problems
verfasst von
T. J. Sullivan
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-23395-6_6