Research ArticleOpen AccessGoogle Scholar indexed
Global Convergence of Curve Search Methods for Unconstrained Optimization
Computer and Information Science, University of Michigan, Dearborn, MI, USA
School of Information Technology, Illinois State University, Normal, IL, USA
Mathematics and Computer Science, Central State University, Wilberforce, OH, USA
- 1 Computer and Information Science, University of Michigan, Dearborn, MI, USA
- 2 School of Information Technology, Illinois State University, Normal, IL, USA
- 3 Mathematics and Computer Science, Central State University, Wilberforce, OH, USA
Copy link · social · email
Abstract
In this paper we propose a new family of curve search methods for unconstrained optimization problems, which are based on searching a new iterate along a curve through the current iterate at each iteration, while line search methods are based on finding a new iterate on a line starting from the current iterate at each iteration. The global convergence and linear convergence rate of these curve search methods are investigated under some mild conditions. Numerical results show that some curve search methods are stable and effective in solving some large scale minimization problems.
KeywordsUnconstrained OptimizationCurve Search MethodGlobal ConvergenceConvergence Rate
- Vrahatis, M.N., Androulakis, G.S., Lambrinos, J.N. and Magoulas, G.D. (2002) A Class of Gradient Unconstrained Minimization Algorithms with Adaptive Stepsize. Journal of Computational and Applied Mathematics, 114, 367-386. http://dx.doi.org/10.1016/S0377-0427(99)00276-9
- Nocedal, J. and Wright, J.S. (1999) Numerical Optimization. Springer-Verlag New York, Inc., New York. http://dx.doi.org/10.1007/b98874
- Yuan, Y.X. (1993) Numerical Methods for Nonlinear Programming. Shanghai Scientific & Technical Publishers, Shanghai.
- McCormick, G.P. (1975) An Arc Method for Nonlinear Programming. SIAM Journal on Control, 13, 1194-1216. http://dx.doi.org/10.1137/0313075
- Zang, I. (1978) A New Arc Algorithm for Unconstrained Optimization. Mathematical Programming, 15, 36-52. http://dx.doi.org/10.1007/BF01608998
- Botsaris, C.A. (1978) Differential Gradient Methods. Journal of Mathematical Analysis and Applications, 63, 177-198. http://dx.doi.org/10.1016/0022-247X(78)90114-2
- Botsaris, C.A. (1978) A Curvilinear Optimization Method Based upon Iterative Estimation of the Eigensystem of the Hessian Matrix. Journal of Mathematical Analysis and Applications, 63, 396-411. http://dx.doi.org/10.1016/0022-247X(78)90085-9
- Botsaris, C.A. (1978) A Class of Methods for Unconstrained Minimization Based on Stable Numerical Integration Techniques. Journal of Mathematical Analysis and Applications, 63, 729-749. http://dx.doi.org/10.1016/0022-247X(78)90068-9
- Botsaris, C.A. and Jacobson, D.H. (1976) A Newton-Type Curvilinear Search Method for Optimization. Journal of Mathematical Analysis and Applications, 54, 217-229. http://dx.doi.org/10.1016/0022-247X(76)90246-8
- Flam, S.D. (1992) Solving Convex Programming by Means of Ordinary Differential Equations. Mathematics of Operations Research, 17, 290-302. http://dx.doi.org/10.1287/moor.17.2.290
- Syman, J.A. (1982) A New and Dynamic Method for Unconstrained Minimization. Applied Mathematical Modelling, 6, 449-462. http://dx.doi.org/10.1016/S0307-904X(82)80007-3
- Schropp, J. (1997) A Note on Minimization Problems and Multistep Methods. Numerische Mathematik, 78, 87-101. http://dx.doi.org/10.1007/s002110050305
- van Wyk, D.J. (1984) Differential Optimization Techniques. Applied Mathematical Modelling, 8, 419-424. http://dx.doi.org/10.1016/0307-904X(84)90048-9