Techniques for gradient-based bilevel optimization with non-smooth lower level problems
From MaRDI portal
(Redirected from Publication:334266)
Abstract: We propose techniques for approximating bilevel optimization problems with non-smooth lower level problems that can have a non-unique solution. To this end, we substitute the expression of a minimizer of the lower level minimization problem with an iterative algorithm that is guaranteed to converge to a minimizer of the problem. Using suitable non-linear proximal distance functions, the update mappings of such an iterative algorithm can be differentiable, notwithstanding the fact that the minimization problem is non-smooth.
Recommendations
- Bilevel optimization with nonsmooth lower level problems
- A primal nonsmooth reformulation for bilevel optimization problems
- Methodology and first-order algorithms for solving nonsmooth and non-strongly convex bilevel optimization problems
- On solving simple bilevel programs with a nonconvex lower level program
- scientific article; zbMATH DE number 1322063
Cites work
- A bilevel optimization approach for parameter learning in variational models
- A first-order primal-dual algorithm for convex problems with applications to imaging
- Annotated Bibliography on Bilevel Programming and Mathematical Programs with Equilibrium Constraints
- Bilevel programming problems. Theory, algorithms and applications to energy networks
- Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
- Convex Analysis
- Descent Property and Global Convergence of the Fletcher—Reeves Method with Inexact Line Search
- Dynamic sampling schemes for optimal noise learning under multiple nonsmooth constraints
- Ergodic convergence to a zero of the sum of monotone operators in Hilbert space
- Evaluating Derivatives
- Function minimization by conjugate gradients
- Heavy-ball method in nonconvex optimization problems
- scientific article; zbMATH DE number 410743 (Why is no real title available?)
- scientific article; zbMATH DE number 3296905 (Why is no real title available?)
- Image denoising: learning the noise model via nonsmooth PDE-constrained optimization
- Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs
- iPiano: inertial proximal algorithm for nonconvex optimization
- Large margin methods for structured and interdependent output variables
- Mirror descent and nonlinear projected subgradient methods for convex optimization.
- On the ergodic convergence rates of a first-order primal-dual algorithm
- On the limited memory BFGS method for large scale optimization
- Splitting Algorithms for the Sum of Two Nonlinear Operators
- Stein Unbiased GrAdient estimator of the Risk (SUGAR) for Multiple Parameter Selection
- Techniques for gradient-based bilevel optimization with non-smooth lower level problems
- The generalized Mangasarian-Fromowitz constraint qualification and optimality conditions for bilevel programs
- The structure of optimal parameters for image restoration problems
Cited in
(32)- Uncertainty-safe large scale support vector machines
- A note on a bilevel problem for parameter learning for inverse problems with the wave equation
- Deep convolutional neural networks with spatial regularization, volume and star-shape priors for image segmentation
- Bilevel hyperparameter optimization for support vector classification: theoretical analysis and a solution method
- A non-convex non-smooth bi-level parameter learning for impulse and Gaussian noise mixture removing
- A non-convex denoising model for impulse and Gaussian noise mixture removing using bi-level parameter identification
- A primal nonsmooth reformulation for bilevel optimization problems
- Bilevel optimization with nonsmooth lower level problems
- Techniques for gradient-based bilevel optimization with non-smooth lower level problems
- Bilevel optimization: theory, algorithms, applications and a bibliography
- scientific article; zbMATH DE number 7626760 (Why is no real title available?)
- Beyond Backpropagation: Bilevel Optimization Through Implicit Differentiation and Equilibrium Propagation
- Optimality Conditions for Bilevel Imaging Learning Problems with Total Variation Regularization
- Convergence of a piggyback-style method for the differentiation of solutions of standard saddle-point problems
- Gradient-based solution algorithms for a class of bilevel optimization and optimal control problems with a nonsmooth lower level
- Modern regularization methods for inverse problems
- A regularized convolutional neural network for semantic image segmentation
- Bilevel Methods for Image Reconstruction
- Convex Bi-level Optimization Problems with Nonsmooth Outer Objective Function
- An Improved Unconstrained Approach for Bilevel Optimization
- Linearly convergent bilevel optimization with single-step inner methods
- Methodology and first-order algorithms for solving nonsmooth and non-strongly convex bilevel optimization problems
- Levenberg-Marquardt method and partial exact penalty parameter selection in bilevel optimization
- Bilevel optimization methods in imaging
- Derivative-free stochastic bilevel optimization for inverse problems
- An adaptively inexact method for bilevel learning using primal-dual-style differentiation
- Bilevel learning with inexact stochastic gradients
- Whiteness-based bilevel estimation of weighted TV parameter maps for image denoising
- An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning
- Unified smoothing approach for best hyperparameter selection problem using a bilevel optimization strategy
- Algorithmic unfolding for image reconstruction and localization problems in single-molecule fluorescence microscopy
- A primal-dual algorithm for image reconstruction with input-convex neural network regularizers
This page was built for publication: Techniques for gradient-based bilevel optimization with non-smooth lower level problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q334266)
