Implementing a smooth exact penalty function for equality-constrained nonlinear optimization
From MaRDI portal
Abstract: We develop a general equality-constrained nonlinear optimization algorithm based on a smooth penalty function proposed by Fletcher (1970). Although it was historically considered to be computationally prohibitive in practice, we demonstrate that the computational kernels required are no more expensive than other widely accepted methods for nonlinear optimization. The main kernel required to evaluate the penalty function and its derivatives is solving a structured linear system. We show how to solve this system efficiently by storing a single factorization each iteration when the matrices are available explicitly. We further show how to adapt the penalty function to the class of factorization-free algorithms by solving the linear system iteratively. The penalty function therefore has promise when the linear system can be solved efficiently, e.g., for PDE-constrained optimization problems where efficient preconditioners exist. We discuss extensions including handling simple constraints explicitly, regularizing the penalty function, and inexact evaluation of the penalty function and its gradients. We demonstrate the merits of the approach and its various features on some nonlinear programs from a standard test set, and some PDE-constrained optimization problems.
Recommendations
- Implementing a smooth exact penalty function for general constrained nonlinear optimization
- scientific article; zbMATH DE number 6796430
- A new class of exact penalty functions for equality constrained smooth optimization
- A New Exact Penalty Function
- New exact penalty functions for nonlinear constrained optimization problems
Cites work
- scientific article; zbMATH DE number 3869077 (Why is no real title available?)
- scientific article; zbMATH DE number 3914081 (Why is no real title available?)
- scientific article; zbMATH DE number 3934328 (Why is no real title available?)
- scientific article; zbMATH DE number 3725604 (Why is no real title available?)
- scientific article; zbMATH DE number 3520162 (Why is no real title available?)
- scientific article; zbMATH DE number 852536 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- scientific article; zbMATH DE number 5066287 (Why is no real title available?)
- scientific article; zbMATH DE number 3309655 (Why is no real title available?)
- A Flexible Inner-Outer Preconditioned GMRES Algorithm
- A line search exact penalty method using steering rules
- A quadratically convergent primal-dual algorithm with global convergence properties for solving optimization problems with equality constraints
- An Exact Potential Method for Constrained Maxima
- An exact penalty function method with global convergence properties for nonlinear programming problems
- Analysis of inexact trust-region SQP algorithms
- Automatic Preconditioning by Limited Memory Quasi-Newton Updating
- CUTEst: a constrained and unconstrained testing environment with safe threads for mathematical optimization
- Generalized Golub-Kahan bidiagonalization and stopping criteria
- Implementing a smooth exact penalty function for general constrained nonlinear optimization
- Incomplete Cholesky Factorizations with Limited Memory
- Inexact Newton Methods
- Inexact objective function evaluations in a trust-region algorithm for PDE-constrained optimization under uncertainty
- Iterative Solution of Nonlinear Equations in Several Variables
- Iterative solution of symmetric quasi-definite linear systems
- LNLQ: an iterative method for least-norm problems with an error minimization property
- LSLQ: an iterative method for linear least-squares with an error minimization property
- LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares
- Methods of conjugate gradients for solving linear systems
- Multiplier and gradient methods
- Necessary and sufficient conditions for a penalty method to be exact
- Newton's Method for Large Bound-Constrained Optimization Problems
- On the Stability of Cholesky Factorization for Symmetric Quasidefinite Systems
- Reduced order solution of structured linear systems arising in certain PDE-constrained optimization problems
- Regularization-robust preconditioners for time-dependent PDE-constrained optimization problems
- Scalable nonlinear programming via exact differentiable penalty functions and trust-region Newton methods
- Solution of Sparse Indefinite Systems of Linear Equations
- Superlinear convergence of a stabilized SQP method to a degenerate solution
- Symmetric Quasidefinite Matrices
- The N‐Step Iteration Procedures
- The Conjugate Gradient Method and Trust Regions in Large Scale Optimization
- The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables Separate
- Trust Region Methods
- Variational methods for the solution of problems of equilibrium and vibrations
Cited in
(10)- Hierarchical orthogonal factorization: sparse least squares problems
- CDOpt: a Python package for a class of Riemannian optimization
- Computing second-order points under equality constraints: revisiting Fletcher's augmented Lagrangian
- An exact penalty function optimization method and its application in stress constrained topology optimization and scenario based reliability design problems
- scientific article; zbMATH DE number 6796430 (Why is no real title available?)
- Implementing a smooth exact penalty function for general constrained nonlinear optimization
- Nonsmooth exact penalty methods for equality-constrained optimization: complexity and implementation
- scientific article; zbMATH DE number 1568997 (Why is no real title available?)
- scientific article; zbMATH DE number 6263697 (Why is no real title available?)
- A class of smooth exact penalty function methods for optimization problems with orthogonality constraints
This page was built for publication: Implementing a smooth exact penalty function for equality-constrained nonlinear optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3300857)