Techniques for gradient-based bilevel optimization with non-smooth lower level problems
From MaRDI portal
Publication:334266
DOI10.1007/S10851-016-0663-7zbMATH Open1352.65155arXiv1602.07080OpenAlexW2278603371MaRDI QIDQ334266FDOQ334266
Authors: Peter Ochs, René Ranftl, Thomas Brox, Thomas Pock 
Publication date: 1 November 2016
Published in: Journal of Mathematical Imaging and Vision (Search for Journal in Brave)
Abstract: We propose techniques for approximating bilevel optimization problems with non-smooth lower level problems that can have a non-unique solution. To this end, we substitute the expression of a minimizer of the lower level minimization problem with an iterative algorithm that is guaranteed to converge to a minimizer of the problem. Using suitable non-linear proximal distance functions, the update mappings of such an iterative algorithm can be differentiable, notwithstanding the fact that the minimization problem is non-smooth.
Full work available at URL: https://arxiv.org/abs/1602.07080
Recommendations
- Bilevel optimization with nonsmooth lower level problems
- A primal nonsmooth reformulation for bilevel optimization problems
- Methodology and first-order algorithms for solving nonsmooth and non-strongly convex bilevel optimization problems
- On solving simple bilevel programs with a nonconvex lower level program
- scientific article; zbMATH DE number 1322063
iterative algorithmbilevel optimizationnumerical exampleBregman proximity functionnon-smooth lower level problem
Cites Work
- iPiano: inertial proximal algorithm for nonconvex optimization
- Splitting Algorithms for the Sum of Two Nonlinear Operators
- On the limited memory BFGS method for large scale optimization
- Function minimization by conjugate gradients
- Title not available (Why is that?)
- Mirror descent and nonlinear projected subgradient methods for convex optimization.
- Convex Analysis
- A first-order primal-dual algorithm for convex problems with applications to imaging
- Image denoising: learning the noise model via nonsmooth PDE-constrained optimization
- A bilevel optimization approach for parameter learning in variational models
- Title not available (Why is that?)
- Evaluating Derivatives
- Descent Property and Global Convergence of the Fletcher—Reeves Method with Inexact Line Search
- Annotated Bibliography on Bilevel Programming and Mathematical Programs with Equilibrium Constraints
- Stein Unbiased GrAdient estimator of the Risk (SUGAR) for Multiple Parameter Selection
- The generalized Mangasarian-Fromowitz constraint qualification and optimality conditions for bilevel programs
- Ergodic convergence to a zero of the sum of monotone operators in Hilbert space
- Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
- Bilevel programming problems. Theory, algorithms and applications to energy networks
- Large margin methods for structured and interdependent output variables
- On the ergodic convergence rates of a first-order primal-dual algorithm
- Dynamic sampling schemes for optimal noise learning under multiple nonsmooth constraints
- Techniques for gradient-based bilevel optimization with non-smooth lower level problems
- Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs
- Heavy-ball method in nonconvex optimization problems
- The structure of optimal parameters for image restoration problems
Cited In (23)
- Deep convolutional neural networks with spatial regularization, volume and star-shape priors for image segmentation
- Bilevel hyperparameter optimization for support vector classification: theoretical analysis and a solution method
- Levenberg-Marquardt method and partial exact penalty parameter selection in bilevel optimization
- Linearly convergent bilevel optimization with single-step inner methods
- Title not available (Why is that?)
- Bilevel Methods for Image Reconstruction
- A non-convex non-smooth bi-level parameter learning for impulse and Gaussian noise mixture removing
- Methodology and first-order algorithms for solving nonsmooth and non-strongly convex bilevel optimization problems
- Optimality Conditions for Bilevel Imaging Learning Problems with Total Variation Regularization
- Bilevel optimization methods in imaging
- Uncertainty-safe large scale support vector machines
- A non-convex denoising model for impulse and Gaussian noise mixture removing using bi-level parameter identification
- Techniques for gradient-based bilevel optimization with non-smooth lower level problems
- An Improved Unconstrained Approach for Bilevel Optimization
- Modern regularization methods for inverse problems
- A note on a bilevel problem for parameter learning for inverse problems with the wave equation
- Gradient-based solution algorithms for a class of bilevel optimization and optimal control problems with a nonsmooth lower level
- Bilevel optimization: theory, algorithms, applications and a bibliography
- A primal nonsmooth reformulation for bilevel optimization problems
- Convex Bi-level Optimization Problems with Nonsmooth Outer Objective Function
- Convergence of a piggyback-style method for the differentiation of solutions of standard saddle-point problems
- A regularized convolutional neural network for semantic image segmentation
- Bilevel optimization with nonsmooth lower level problems
Uses Software
This page was built for publication: Techniques for gradient-based bilevel optimization with non-smooth lower level problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q334266)
