An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion (Q2502232)

From MaRDI portal
scientific article
Language Label Description Also known as
English
An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion
scientific article

    Statements

    An acceleration of gradient descent algorithm with backtracking for unconstrained opti\-mi\-za\-tion (English)
    0 references
    0 references
    12 September 2006
    0 references
    The author considers the unconstrained optimization problem where the objective function is convex and continuously differentiable. He focuses on the gradient descent algorithm with backtracking, and describes an improved version which accelerates convergence. In particular, the acceleration is based on a modification of the steplength by multiplying it with a positive parameter. The resulting algorithm is proven to be linearly convergent, and numerical experimentation in section 4 shows a significant improvement in performance.
    0 references
    0 references
    backtracking
    0 references
    gradient descent methods
    0 references
    numerical examples
    0 references
    convex programming
    0 references
    convergence acceleration
    0 references
    unconstrained optimization
    0 references
    algorithm
    0 references
    0 references
    0 references
    0 references