Skip to main content

2019 | OriginalPaper | Buchkapitel

Adaptive Importance Sampling with Forward-Backward Stochastic Differential Equations

verfasst von : Omar Kebiri, Lara Neureither, Carsten Hartmann

Erschienen in: Stochastic Dynamics Out of Equilibrium

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating functions, which appear relevant in the context of, e.g. molecular dynamics, and we discuss the construction of an optimal (i.e. minimum variance) change of measure by solving a stochastic control problem. We show that the associated semi-linear dynamic programming equations admit an equivalent formulation as a system of uncoupled forward-backward stochastic differential equations that can be solved efficiently by a least squares Monte Carlo algorithm. We illustrate the approach with a suitable numerical example and discuss the extension of the algorithm to high-dimensional systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
More precisely, \(\varphi |_{\mathcal {F}_{\tau }}\) is understood as the restriction of the measure \(Q^*\) defined by \(dQ^*=\varphi dP\) to the \(\sigma \)-algebra \({\mathcal {F}_{\tau }}\) that contains all measurable sets \(E\in {\mathcal E}\), with the property that for every \(t\geqslant 0\) the set \(E\cap \{\tau \leqslant t\}\) is an element of the \(\sigma \)-algebra \(\mathcal {F}_{t}=\sigma (X_s:0\leqslant s\leqslant t)\) that is generated by all trajectories \((X_s)_{0\leqslant s\leqslant t}\) of length t.
 
2
For the numerical computation, we add reflecting boundary conditions at \(x=-L\) for some \(L>0\), the precise value of which does not affect the results (assuming that it is sufficiently large, say, \(L>3\)) since the potential has a 4-th order growth.
 
Literatur
1.
Zurück zum Zitat Asmussen, A., Glynn, P.: Stochastic Simulation: Algorithms and Analysis. Springer, New York (2007) Asmussen, A., Glynn, P.: Stochastic Simulation: Algorithms and Analysis. Springer, New York (2007)
2.
Zurück zum Zitat Bahlali, K., Gherbal, B., Mezerdi, B.: Existence of optimal controls for systems driven by FBSDEs. Syst. Control Lett. 60, 344–349 (2011)MathSciNetCrossRef Bahlali, K., Gherbal, B., Mezerdi, B.: Existence of optimal controls for systems driven by FBSDEs. Syst. Control Lett. 60, 344–349 (2011)MathSciNetCrossRef
3.
Zurück zum Zitat Bahlali, K., Kebiri, O., Mtiraoui, A.: Existence of an optimal control for a system driven by a degenerate coupled forward-backward stochastic differential equations. C. R. Acad. Sci. Paris, Ser. I 355(1), 84–89 (2016)MathSciNetCrossRef Bahlali, K., Kebiri, O., Mtiraoui, A.: Existence of an optimal control for a system driven by a degenerate coupled forward-backward stochastic differential equations. C. R. Acad. Sci. Paris, Ser. I 355(1), 84–89 (2016)MathSciNetCrossRef
4.
Zurück zum Zitat Bender, C., Steiner, J.: Least-squares Monte Carlo for BSDEs. In: Carmona et al. (Eds.) Numerical Methods in Finance, pp. 257–289. Springer (2012) Bender, C., Steiner, J.: Least-squares Monte Carlo for BSDEs. In: Carmona et al. (Eds.) Numerical Methods in Finance, pp. 257–289. Springer (2012)
5.
Zurück zum Zitat Bensoussan, A., Boccardo, L., Murat, F.: Homogenization of elliptic equations with principal part not in divergence form and Hamiltonian with quadratic growth. Commun. Pure Appl. Math. 39, 769–805 (1986)MathSciNetCrossRef Bensoussan, A., Boccardo, L., Murat, F.: Homogenization of elliptic equations with principal part not in divergence form and Hamiltonian with quadratic growth. Commun. Pure Appl. Math. 39, 769–805 (1986)MathSciNetCrossRef
6.
Zurück zum Zitat Boué, M., Dupuis, P.: A variational representation for certain functionals of Brownian motion. Ann. Probab. 26(4), 1641–1659 (1998)MathSciNetCrossRef Boué, M., Dupuis, P.: A variational representation for certain functionals of Brownian motion. Ann. Probab. 26(4), 1641–1659 (1998)MathSciNetCrossRef
7.
Zurück zum Zitat Dai Pra, P., Meneghini, L., Runggaldier, W.J.: Connections between stochastic control and dynamic games. Math. Control Signals Systems 9, 303–326 (1996)MathSciNetCrossRef Dai Pra, P., Meneghini, L., Runggaldier, W.J.: Connections between stochastic control and dynamic games. Math. Control Signals Systems 9, 303–326 (1996)MathSciNetCrossRef
8.
Zurück zum Zitat Dupuis, P., Wang, H.: Importance sampling, large deviations, and differential games. Stoch. Int. J. Probab. Stoch. Proc. 76, 481–508 (2004)MathSciNetMATH Dupuis, P., Wang, H.: Importance sampling, large deviations, and differential games. Stoch. Int. J. Probab. Stoch. Proc. 76, 481–508 (2004)MathSciNetMATH
9.
Zurück zum Zitat Dupuis, P., Wang, H.: Subsolutions of an Isaacs equation and efficient schemes for importance sampling. Math. Oper. Res. 32, 723–757 (2007)MathSciNetCrossRef Dupuis, P., Wang, H.: Subsolutions of an Isaacs equation and efficient schemes for importance sampling. Math. Oper. Res. 32, 723–757 (2007)MathSciNetCrossRef
10.
Zurück zum Zitat Ellis, R.S.: Entropy, Large Deviations and Statistical Mechanics. Grundlehren der mathematischen Wissenschaften, vol. 271. Springer, New York (1985) Ellis, R.S.: Entropy, Large Deviations and Statistical Mechanics. Grundlehren der mathematischen Wissenschaften, vol. 271. Springer, New York (1985)
11.
Zurück zum Zitat Engelund, S., Rackwitz, R.: A benchmark study on importance sampling techniques in structural reliability. Struct. Saf. 12, 255–276 (1993)CrossRef Engelund, S., Rackwitz, R.: A benchmark study on importance sampling techniques in structural reliability. Struct. Saf. 12, 255–276 (1993)CrossRef
12.
Zurück zum Zitat Fleming, W.H., Mete Soner, H.: Controlled Markov Processes and Viscosity Solutions. Applications of mathematics, 2nd edn. Springer, New York (2006) Fleming, W.H., Mete Soner, H.: Controlled Markov Processes and Viscosity Solutions. Applications of mathematics, 2nd edn. Springer, New York (2006)
13.
Zurück zum Zitat Gobet, E., Lemor, J.-P., Warin, X.: A regression-based Monte Carlo method to solve backward stochastic differential equations. Ann. Appl. Probab. 15, 2172–2202 (2005)MathSciNetCrossRef Gobet, E., Lemor, J.-P., Warin, X.: A regression-based Monte Carlo method to solve backward stochastic differential equations. Ann. Appl. Probab. 15, 2172–2202 (2005)MathSciNetCrossRef
14.
Zurück zum Zitat Hartmann, C., Banisch, R., Sarich, M., Badowski, Th., Schütte, Ch.: Characterization of rare events in molecular dynamics. Entropy 16, 350–376 (2014)MathSciNetCrossRef Hartmann, C., Banisch, R., Sarich, M., Badowski, Th., Schütte, Ch.: Characterization of rare events in molecular dynamics. Entropy 16, 350–376 (2014)MathSciNetCrossRef
15.
Zurück zum Zitat Hartmann, C., Richter, L., Schütte, Ch., Zhang, W.: Variational characterization of free energy: theory and algorithms. Entropy 19, 626–653 (2017)CrossRef Hartmann, C., Richter, L., Schütte, Ch., Zhang, W.: Variational characterization of free energy: theory and algorithms. Entropy 19, 626–653 (2017)CrossRef
16.
Zurück zum Zitat Hartmann, C., Schütte, Ch.: Efficient rare event simulation by optimal nonequilibrium forcing. J. Stat. Mech. Theor. Exp. 2012, 11004 (2012) Hartmann, C., Schütte, Ch.: Efficient rare event simulation by optimal nonequilibrium forcing. J. Stat. Mech. Theor. Exp. 2012, 11004 (2012)
17.
18.
Zurück zum Zitat Kobylanski, M.: Backward stochastic differential equations and partial differential equations with quadratic growth. Ann. Probab. 28(2), 558–602 (2000)MathSciNetCrossRef Kobylanski, M.: Backward stochastic differential equations and partial differential equations with quadratic growth. Ann. Probab. 28(2), 558–602 (2000)MathSciNetCrossRef
19.
Zurück zum Zitat Oksendal, B.: Stochastic Differential Equations: An Introduction with Applications, 6th edn. Springer (2010) Oksendal, B.: Stochastic Differential Equations: An Introduction with Applications, 6th edn. Springer (2010)
20.
Zurück zum Zitat Pardoux, E., Peng, S.: Backward stochastic differential equations and quasilinear parabolic partial differential equations. In: Rozovskii, B.L., Sowers, R.B. (eds.) Stochastic Partial Differential Equations and their Applications. Lecture Notes in Control and Information Sciences, vol. 176, pp. 200–217. Springer, Berlin (1992) Pardoux, E., Peng, S.: Backward stochastic differential equations and quasilinear parabolic partial differential equations. In: Rozovskii, B.L., Sowers, R.B. (eds.) Stochastic Partial Differential Equations and their Applications. Lecture Notes in Control and Information Sciences, vol. 176, pp. 200–217. Springer, Berlin (1992)
21.
Zurück zum Zitat Peng, S.: Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27, 125–144 (1993)MathSciNetCrossRef Peng, S.: Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27, 125–144 (1993)MathSciNetCrossRef
22.
Zurück zum Zitat Pham, H.: Continuous-time stochastic control and optimization with financial applications. Stochastic modelling and applied probability. Springer, Heidelberg (2009)CrossRef Pham, H.: Continuous-time stochastic control and optimization with financial applications. Stochastic modelling and applied probability. Springer, Heidelberg (2009)CrossRef
24.
Zurück zum Zitat Rubinstein, R.Y., Kroese, D.P.: Simulation and the Monte Carlo Method. Wiley, Hoboken (2008) Rubinstein, R.Y., Kroese, D.P.: Simulation and the Monte Carlo Method. Wiley, Hoboken (2008)
26.
Zurück zum Zitat Turkedjiev, P.: Numerical methods for backward stochastic differential equations of quadratic and locally Lipschitz type, Dissertation, Humboldt-Universität zu Berlin, Mathematisch-Naturwissenschaftliche Fakultät II (2013) Turkedjiev, P.: Numerical methods for backward stochastic differential equations of quadratic and locally Lipschitz type, Dissertation, Humboldt-Universität zu Berlin, Mathematisch-Naturwissenschaftliche Fakultät II (2013)
27.
Zurück zum Zitat Vanden-Eijnden, E., Weare, J.: Rare event simulation of small noise diffusions. Commun. Pure Appl. Math. 65, 1770–1803 (2012)MathSciNetCrossRef Vanden-Eijnden, E., Weare, J.: Rare event simulation of small noise diffusions. Commun. Pure Appl. Math. 65, 1770–1803 (2012)MathSciNetCrossRef
28.
Zurück zum Zitat Wouters, J., Bouchet, F.: Rare event computation in deterministic chaotic systems using genealogical particle analysis. J. Phys. A 49, 374002 (2016)MathSciNetCrossRef Wouters, J., Bouchet, F.: Rare event computation in deterministic chaotic systems using genealogical particle analysis. J. Phys. A 49, 374002 (2016)MathSciNetCrossRef
29.
Zurück zum Zitat Zhang, W., Wang, H., Hartmann, C., Weber, M., Schütte, Ch.: Applications of the cross-entropy method to importance sampling and optimal control of diffusions. SIAM J. Sci. Comput. 36, A2654–A2672 (2014)MathSciNetCrossRef Zhang, W., Wang, H., Hartmann, C., Weber, M., Schütte, Ch.: Applications of the cross-entropy method to importance sampling and optimal control of diffusions. SIAM J. Sci. Comput. 36, A2654–A2672 (2014)MathSciNetCrossRef
Metadaten
Titel
Adaptive Importance Sampling with Forward-Backward Stochastic Differential Equations
verfasst von
Omar Kebiri
Lara Neureither
Carsten Hartmann
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-15096-9_7