Skip to main content
Log in

Convergence Properties of Two-Stage Stochastic Programming

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

This paper considers a procedure of two-stage stochastic programming in which the performance function to be optimized is replaced by its empirical mean. This procedure converts a stochastic optimization problem into a deterministic one for which many methods are available. Another strength of the method is that there is essentially no requirement on the distribution of the random variables involved. Exponential convergence for the probability of deviation of the empirical optimum from the true optimum is established using large deviation techniques. Explicit bounds on the convergence rates are obtained for the case of quadratic performance functions. Finally, numerical results are presented for the famous news vendor problem, which lends experimental evidence supporting exponential convergence.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. BIRGE, J. R., and LOUVEAUX, F., Introduction to Stochastic Programming, Springer Verlag, New York, NY, 1997.

    Google Scholar 

  2. KUSHNER, H. J., and CLARKE, D. S., Stochastic Approximation for Constrained and Unconstrained Systems, Springer Verlag, New York, NY, 1978.

    Google Scholar 

  3. MEKETON, M. S., Optimization in Simulation: A Survey of Recent Results, Proceedings of the 1987 Winter Simulation Conference, pp. 58-67, 1987.

  4. KING, A. J., and ROCKAFELLAR, R. T., Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming, Mathematics of Operations Research, Vol. 18, pp. 148-163, 1993.

    Google Scholar 

  5. ROBINSON, S.M., Analysis of Sample-Path Optimization, Mathematics of Operations Research, Vol. 21, pp. 513-528, 1996.

    Google Scholar 

  6. HUBER, P. J., Robust Estimation of a Location Parameter, Annals of Mathematical Statistics, Vol. 35, pp. 73-101, 1964.

    Google Scholar 

  7. HUBER, P. J., The Behavior of Maximum Likelihood Estimates under Nonstandard Conditions, Proceedings of the 5th Berkeley Symposium on Mathematical Statistics, pp. 221-233, 1967.

  8. DUPăCOVÁ, J., and WETS, R., Asymptotic Behavior of Statistical Estimators and of Optimal Solutions of Stochastic Optimization Problems, Annals of Statistics, Vol. 16, pp. 1517-1549, 1988.

    Google Scholar 

  9. SHAPIRO, A., Asymptotic Properties of Statistical Estimators in Stochastic Programming, Annals of Statistics, Vol. 17, pp. 841-858, 1989.

    Google Scholar 

  10. SHAPIRO, A., Asymptotic Analysis of Stochastic Programs, Annals of Operations Research, Vol. 30, pp. 169-186, 1991.

    Google Scholar 

  11. PLAMBECK, E. L., FU, B. R., ROBINSON, S. M., and SURI, R., Sample-Path Optimization of Convex Stochastic Functions, Mathematical Programming, Vol. 75, pp. 137-176, 1996.

    Google Scholar 

  12. KANKOVA, V., An Approximate Solution of a Stochastic Optimization Problem, Transactions of the 8th Conference on Information Theory, Statistical Decision Functions, and Random Processes, pp. 349-353, 1978.

  13. KANIOVSKI, Y. M., KING, A. J., and WETS, R. J., Probabilistic Bounds for the Solutions of Stochastic Programming Problems, Annals of Operations Research, Vol. 56, pp. 189-208, 1995.

    Google Scholar 

  14. SHIRYAYEV, A. N., Probability, Springer Verlag, New York, NY, 1984.

    Google Scholar 

  15. CHERNOFF, H., A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the Sum of Observations, Annals of Mathematical Statistics, Vol. 23, pp. 493-507, 1952.

    Google Scholar 

  16. DEMBO, A., and ZEITOUNI, O., Large Deviations Techniques, Jones and Bartlett, Boston, Massachusetts, 1993.

    Google Scholar 

  17. BUCKLEW, J. A., Large Deviation Techniques in Decision, Simulation, and Estimation, John Wiley, New York, NY, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dai, L., Chen, C.H. & Birge, J.R. Convergence Properties of Two-Stage Stochastic Programming. Journal of Optimization Theory and Applications 106, 489–509 (2000). https://doi.org/10.1023/A:1004649211111

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1004649211111

Navigation