Harnessing Structure in Composite Nonsmooth Minimization

DOI10.1137/22M1505827MaRDI QIDQ6046827zbMATH OpenOpenAlexFDO

Authors Gilles Bareilles, Franck Iutzeler, Jérôme Malick

Publication date 6 September 2023

Published in SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2206.15053

zbMATH Keywords

manifold identificationmaximum eigenvalue minimizationnonsmooth optimizationpartial smoothnessproximal operatorsequential quadratic programming

Mathematics Subject Classification ID

Sensitivity analysis for optimization problems on manifolds (49Q12) Numerical optimization and variational techniques (65K10) Nonconvex programming, global optimization (90C26) Methods of successive quadratic programming type (90C55)

Abstract: We consider the problem of minimizing the composition of a nonsmooth function with a smooth mapping in the case where the proximity operator of the nonsmooth function can be explicitly computed. We first show that this proximity operator can provide the exact smooth substructure of minimizers, not only of the nonsmooth function, but also of the full composite function. We then exploit this proximal identification by proposing an algorithm which combines proximal steps with sequential quadratic programming steps. We show that our method locally identifies the optimal smooth substructure and then converges quadratically. We illustrate its behavior on two problems: the minimization of a maximum of quadratic functions and the minimization of the maximal eigenvalue of a parametrized matrix.

Cites work

• A \(\mathcal{VU}\)-algorithm for convex minimization
• A proximal method for composite minimization
• Active Sets, Nonsmoothness, and Sensitivity
• An algorithm for composite nonsmooth optimization problems
• An Introduction to Optimization on Smooth Manifolds
• Composite proximal bundle method
• Computing proximal points of nonconvex functions
• Geometrical interpretation of the predictor-corrector type algorithms in structured optimization problems
• scientific article; zbMATH DE number 439380 (Why is no real title available?)
• scientific article; zbMATH DE number 2155014 (Why is no real title available?)
• scientific article; zbMATH DE number 5060482 (Why is no real title available?)
• Julia: a fresh approach to numerical computing
• Majorization-minimization procedures and convergence of SQP methods for semi-algebraic and tame programs
• Newton acceleration on manifolds identified by proximal gradient methods
• Newton methods for nonsmooth convex minimization: connections among \(\mathcal U\)-Lagrangian, Riemannian Newton and SQP methods
• Nonsmooth optimization using Taylor-like models: error bounds, convergence, and termination criteria
• Nonsmooth optimization via quasi-Newton methods
• Numerical optimization. Theoretical and practical aspects. Transl. from the French
• On a Class of Nonsmooth Composite Functions
• On Eigenvalue Optimization
• Partial Smoothness, Tilt Stability, and Generalized Hessians
• Spectral bundle methods for non-convex maximum eigenvalue functions: second-order methods
• Survey Descent: A Multipoint Generalization of Gradient Descent for Nonsmooth Optimization
• The \U-Lagrangian of the Maximum Eigenvalue Function
• The multiproximal linearization method for convex composite problems
• The spectral bundle method with second-order information

Cited in

(1)

• Proximal gradient \(\mathcal{VU}\)-method with superlinear convergence for nonsmooth convex optimization

This page was built for publication: Harnessing Structure in Composite Nonsmooth Minimization

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6046827)