Sequential quadratic optimization for nonlinear equality constrained stochastic optimization
From MaRDI portal
Abstract: Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic, and constraint function and derivative values can be computed explicitly, but the objective function is stochastic. It is assumed in this setting that it is intractable to compute objective function and derivative values explicitly, although one can compute stochastic function and gradient estimates. As a starting point for this stochastic setting, an algorithm is proposed for the deterministic setting that is modeled after a state-of-the-art line-search SQP algorithm, but uses a stepsize selection scheme based on Lipschitz constants (or adaptively estimated Lipschitz constants) in place of the line search. This sets the stage for the proposed algorithm for the stochastic setting, for which it is assumed that line searches would be intractable. Under reasonable assumptions, convergence (resp.,~convergence in expectation) from remote starting points is proved for the proposed deterministic (resp.,~stochastic) algorithm. The results of numerical experiments demonstrate the practical performance of our proposed techniques.
Recommendations
- An adaptive stochastic sequential quadratic programming with differentiable exact augmented Lagrangians
- Constrained Optimization in the Presence of Noise
- A sequential quadratic programming algorithm for equality-constrained optimization without derivatives
- An inexact sequential quadratic optimization algorithm for nonlinear optimization
- A sequential equality constrained quadratic programming algorithm for inequality constrained optimization
Cites work
- A globally convergent method for nonlinear programming
- A trust region method based on interior point techniques for nonlinear programming.
- An inexact Newton method for nonconvex equality constrained optimization
- An Inexact SQP Method for Equality Constrained Optimization
- An Interior Point Algorithm for Large-Scale Nonlinear Programming
- Benchmarking optimization software with performance profiles.
- CUTE
- Exact penalty functions in nonlinear programming
- Exploiting negative curvature in deterministic and stochastic optimization
- Generalized stochastic Frank-Wolfe algorithm with stochastic ``substitute gradient for structured convex optimization
- scientific article; zbMATH DE number 107545 (Why is no real title available?)
- scientific article; zbMATH DE number 3583207 (Why is no real title available?)
- scientific article; zbMATH DE number 1239298 (Why is no real title available?)
- scientific article; zbMATH DE number 1243473 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- scientific article; zbMATH DE number 3309655 (Why is no real title available?)
- Introductory lectures on convex optimization. A basic course.
- Lectures on Stochastic Programming
- Line Search Filter Methods for Nonlinear Programming: Motivation and Global Convergence
- Multiplier and gradient methods
- Numerical solution of a nonlinear parabolic control problem by a reduced SQP method
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming
- Optimal solvers for PDE-constrained optimization
- Optimization methods for large-scale machine learning
- Practical Methods for Optimal Control and Estimation Using Nonlinear Programming
- Variational methods for the solution of problems of equilibrium and vibrations
Cited in
(29)- Quadratic Optimization With Similarity Constraint for Unimodular Sequence Synthesis
- An adaptive stochastic sequential quadratic programming with differentiable exact augmented Lagrangians
- Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programming
- A trust region method for noisy unconstrained optimization
- An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints
- Inexact restoration for minimization with inexact evaluation both of the objective function and the constraints
- A symmetric splitting sequential quadratic optimization algorithm for two-block nonlinearly constrained nonconvex optimization
- Worst-case complexity of an SQP method for nonlinear equality constrained stochastic optimization
- Accelerating stochastic sequential quadratic programming for equality constrained optimization using predictive variance reduction
- Constrained Optimization in the Presence of Noise
- Dual descent augmented Lagrangian method and alternating direction method of multipliers
- Fully stochastic trust-region sequential quadratic programming for equality-constrained optimization problems
- Stochastic nested primal-dual method for nonconvex constrained composition optimization
- Sequential quadratic optimization for stochastic optimization with deterministic nonlinear inequality and equality constraints
- A sequential quadratic programming method with high-probability complexity bounds for nonlinear equality-constrained stochastic optimization
- A partially feasible Jacobi-type distributed SQO method for two-block general linearly constrained smooth optimization
- Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees
- An SQP-type proximal gradient method for composite optimization problems with equality constraints
- Complexity analysis of inexact cubic-regularized primal-dual methods for finding second-order stationary points
- A two-phase stochastic momentum-based algorithm for nonconvex expectation-constrained optimization
- Fair machine learning through constrained stochastic optimization and an -constraint method
- A stochastic-gradient-based interior-point algorithm for solving smooth bound-constrained optimization problems
- Statistical inference of constrained stochastic optimization via sketched sequential quadratic programming
- Design guidelines for noise-tolerant optimization with applications in robust design
- Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimization
- A line-search filter adaptive regularization algorithm using cubics based on affine scaling interior-point methods for constrained optimization
- Stochastic interior-point methods for smooth conic optimization with applications
- Online covariance matrix estimation in sketched Newton methods
- A single-loop stochastic feasible interior-point algorithm for nonlinear inequality-constrained optimization
This page was built for publication: Sequential quadratic optimization for nonlinear equality constrained stochastic optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4989938)
