Computational & Applied Mathematics
Print version ISSN 2238-3603
On-line version ISSN 1807-0302
ZHANG, Li. New versions of the Hestenes-Stiefel nonlinear conjugate gradient method based on the secant condition for optimization. Comput. Appl. Math. [online]. 2009, vol.28, n.1, pp.111-133. ISSN 2238-3603.
Based on the secant condition often satisfied by quasi-Newton methods, two new versions of the Hestenes-Stiefel (HS) nonlinear conjugate gradient method are proposed, which are descent methods even with inexact line searches. The search directions of the proposed methods have the form dk = - θkgk + βkHSdk-1, or dk = -gk + βkHSdk-1+ θkyk-1. When exact line searches are used, the proposed methods reduce to the standard HS method. Convergence properties of the proposed methods are discussed. These results are also extended to some other conjugate gradient methods such as the Polak-Ribiére-Polyak (PRP) method. Numerical results are reported.
Keywords : HS method; descent direction; global convergence.