An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion (Q2502232)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion |
scientific article |
Statements
An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion (English)
0 references
12 September 2006
0 references
The author considers the unconstrained optimization problem where the objective function is convex and continuously differentiable. He focuses on the gradient descent algorithm with backtracking, and describes an improved version which accelerates convergence. In particular, the acceleration is based on a modification of the steplength by multiplying it with a positive parameter. The resulting algorithm is proven to be linearly convergent, and numerical experimentation in section 4 shows a significant improvement in performance.
0 references
backtracking
0 references
gradient descent methods
0 references
numerical examples
0 references
convex programming
0 references
convergence acceleration
0 references
unconstrained optimization
0 references
algorithm
0 references