First Order Convergence Analysis for Sparse Grid Method in Stochastic Two-Stage Linear Optimization Problem
- 1
Abstract
Stochastic two-stage linear optimization is an important and widely used optimization model. Efficiency of numerical integration of the second stage value function is critical. However, the second stage value function is piecewise linear convex, which imposes challenges for applying the modern efficient spare grid method. In this paper, we prove the first order convergence rate of the sparse grid method for this important stochastic optimization model, utilizing convexity analysis and measure theory. The result is two-folded: it establishes a theoretical foundation for applying the sparse grid method in stochastic programming, and extends the convergence theory of sparse grid integration method to piecewise linear and convex functions.
- J. R. Birge and F. Louveaux, “Introduction to Stochastic Programming,” Springer, New York, 1997.
- S. W. Wallace and W. T. Ziemba, Eds., “Applications of Stochastic Programming,” Society for Industrial and Applied Mathematics, 2005.
- A. J. King and R. J.-B Wets, “Epi-Convergency of Con- vex Stochastic Programs,” Stochastic and Stochastic Re- ports, Vol. 34, 1991, pp. 83-92.
- A. J. King and R. T. Rockafellar, “Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Pro- gramming,” Mathematics for Operations Research, Vol. 18, No. 1, 1993, pp. 148-162. doi:10.1287/moor.18.1.148
- A. Shapiro, “Asymptotic Analysis of Stochastic Programs,” Annals of Operations Resesrch, Vol. 30, No. 1, 1991, pp. 169-186. doi:10.1007/BF02204815
- J. Dupacova and R. Wets, “Asymptotic Behavior of Sta- tistical Estimators and of Optimal Solutions of Stochastic Optimization Problems,” Annals of Statistics, Vol. 16, No. 4, 1988, pp. 1517-1549. doi:10.1214/aos/1176351052
- T. Pennanen and M. Koivu, “Epi-Convergent Discretiza- tion of Stochastic Programs via Integration Quadratures,” Numerische Mathematik, Vol. 100, No. 1, 2005, pp. 141- 163. doi:10.1007/s00211-004-0571-4
- S. A. Smolyak, “Interpolation and Quadrature Formula for the Class and ,” Doklady Akademii Nauk SSSR, Vol. 131, 1960, pp. 1028-1031. (in Russian, Eng- lish Translation: Soviet Mathematica Doklady, Vol. 4, 1963, pp. 240-243).
- T. Gerstner and M. Griebel, “Numerical Integration Us- ing Sparse Grid,” Numerical Algorithms, Vol. 18, No. 3-4, 1998, pp. 209-232. doi:10.1023/A:1019129717644
- M. Chen and S. Mehrotra, “Epiconvergent Scenario Gen- eration Method for Stochastic Problems via Sparse Grid,” Stochastic Programming E-Print Series, Vol. 2008, No. 7, 2008.
- L. C. Evans, “Partial Differential Equations,” American Mathematical Society, Vol. 37, No. 3, 1998, pp. 363-367.
- G. W. Wasilkowsi and H. Wozniakowski, “Explicit Cost Bounds of Algorithms for Multivariate Tensor Product Problems,” Journal of Complexity, Vol. 11, No. 1, 1995, pp. 1-56. doi:10.1006/jcom.1995.1001
- H. Brass and G. H¨ammerlin, Eds., “Bounds for Peano kernels,” Vol. 112, Birkh?user, Basel, 1993, pp. 39-55.
- H. Wozniakowski, “Information-Based Complexity,” An- nual Review of Computer Science, Vol. 1, No. 1, 1986, pp. 319-380. doi:10.1146/annurev.cs.01.060186.001535