Adaptive augmented Lagrangian methods: algorithms and practical numerical experience
From MaRDI portal
Publication:2811487
DOI10.1080/10556788.2015.1071813zbMATH Open1339.49023arXiv1408.4500OpenAlexW1830979757MaRDI QIDQ2811487FDOQ2811487
Frank E. Curtis, Nicholas I. M. Gould, Daniel P. Robinson, Hao Jiang
Publication date: 10 June 2016
Published in: Optimization Methods \& Software (Search for Journal in Brave)
Abstract: In this paper, we consider augmented Lagrangian (AL) algorithms for solving large-scale nonlinear optimization problems that execute adaptive strategies for updating the penalty parameter. Our work is motivated by the recently proposed adaptive AL trust region method by Curtis, Jiang, and Robinson [Math. Prog., DOI: 10.1007/s10107-014-0784-y, 2013]. The first focal point of this paper is a new variant of the approach that employs a line search rather than a trust region strategy, where a critical algorithmic feature for the line search strategy is the use of convexified piecewise quadratic models of the AL function for computing the search directions. We prove global convergence guarantees for our line search algorithm that are on par with those for the previously proposed trust region method. A second focal point of this paper is the practical performance of the line search and trust region algorithm variants in Matlab software, as well as that of an adaptive penalty parameter updating strategy incorporated into the Lancelot software. We test these methods on problems from the CUTEst and COPS collections, as well as on challenging test problems related to optimal power flow. Our numerical experience suggests that the adaptive algorithms outperform traditional AL methods in terms of efficiency and reliability. As with traditional AL algorithms, the adaptive methods are matrix-free and thus represent a viable option for solving extreme-scale problems.
Full work available at URL: https://arxiv.org/abs/1408.4500
Recommendations
- An adaptive augmented Lagrangian method for large-scale constrained optimization
- Augmented Lagrangian method with alternating constraints for nonlinear optimization problems
- An adaptive indefinite linearized augmented Lagrangian method for convex optimization with linear constraints
- Augmented Lagrangian method with nonmonotone penalty parameters for constrained optimization
- An augmented Lagrangian trust region method for equality constrained optimization
nonlinear optimizationnon-convex optimizationlarge-scale optimizationmatrix-free methodssteering methodsadaptive augmented Lagrangian methods
Numerical mathematical programming methods (65K05) Numerical optimization and variational techniques (65K10) Large-scale problems in mathematical programming (90C06) Nonlinear programming (90C30) Numerical methods based on nonlinear programming (49M37) Newton-type methods (49M15) Numerical methods involving duality (49M29) Large-scale systems (93A15) Numerical methods based on necessary conditions (49M05)
Cites Work
- Numerical experiments with the Lancelot package (Release \(A\)) for large-scale nonlinear optimization
- Title not available (Why is that?)
- PENNON: A code for convex nonlinear and semidefinite programming
- GALAHAD, a library of thread-safe Fortran 90 packages for large-scale nonlinear optimization
- CUTEr and SifDec
- Practical Augmented Lagrangian Methods for Constrained Optimization
- CUTEst: a constrained and unconstrained testing environment with safe threads for mathematical optimization
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
- A dual algorithm for the solution of nonlinear variational problems via finite element approximation
- Benchmarking optimization software with performance profiles.
- Multiplier and gradient methods
- Augmented Lagrangian methods under the constant positive linear dependence constraint qualification
- A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple Bounds
- Improving ultimate convergence of an augmented Lagrangian method
- Trust Region Methods
- Nonlinear programming algorithms using trust regions and augmented Lagrangians with nonmonotone penalty parameters.
- A numerical study of limited memory BFGS methods
- Global Convergence of a Class of Trust Region Algorithms for Optimization with Simple Bounds
- Nonlinear stepsize control, trust regions and regularizations for unconstrained optimization
- On attraction of linearly constrained Lagrangian methods and of stabilized and quasi-Newton SQP methods to critical multipliers
- A line search exact penalty method using steering rules
- Real Analysis and Applications
- Automatic decrease of the penalty parameter in exact penalty function methods
- Augmented Lagrangian method with nonmonotone penalty parameters for constrained optimization
- Local convergence of exact and inexact augmented Lagrangian methods under the second-order sufficient optimality condition
- Steering exact penalty methods for nonlinear programming
- An adaptive augmented Lagrangian method for large-scale constrained optimization
- Adaptive augmented Lagrangian methods: algorithms and practical numerical experience
Cited In (9)
- Perturbed proximal primal-dual algorithm for nonconvex nonsmooth optimization
- Complexity and performance of an Augmented Lagrangian algorithm
- An alternating trust region algorithm for distributed linearly constrained nonlinear programs, application to the optimal power flow problem
- A Numerical Study of an Augmented Lagrangian Method for the Estimation of Parameters in Elliptic Systems
- A new augmented Lagrangian method for equality constrained optimization with simple unconstrained subproblem
- An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints
- A Solver for Nonconvex Bound-Constrained Quadratic Optimization
- Adaptive augmented Lagrangian methods: algorithms and practical numerical experience
- Complexity of an inexact proximal-point penalty method for constrained smooth non-convex optimization
Uses Software
This page was built for publication: Adaptive augmented Lagrangian methods: algorithms and practical numerical experience
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2811487)
