Linear convergence of iterative soft-thresholding
From MaRDI portal
Publication:734951
Abstract: In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized gradient methods and present a new convergence analysis. As main result we show that the algorithm converges with linear rate as soon as the underlying operator satisfies the so-called finite basis injectivity property or the minimizer possesses a so-called strict sparsity pattern. Moreover it is shown that the constants can be calculated explicitly in special cases (i.e. for compact operators). Furthermore, the techniques also can be used to establish linear convergence for related methods such as the iterative thresholding algorithm for joint sparsity and the accelerated gradient projection method.
Recommendations
- A new linear convergence result for the iterative soft thresholding algorithm
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
- Eventual linear convergence of the Douglas-Rachford iteration for basis pursuit
- Iterative thresholding algorithms
Cites work
- scientific article; zbMATH DE number 3504682 (Why is no real title available?)
- scientific article; zbMATH DE number 979133 (Why is no real title available?)
- scientific article; zbMATH DE number 2030293 (Why is no real title available?)
- scientific article; zbMATH DE number 936298 (Why is no real title available?)
- scientific article; zbMATH DE number 3257595 (Why is no real title available?)
- scientific article; zbMATH DE number 3345848 (Why is no real title available?)
- A generalized conditional gradient method and its connection to an iterative shrinkage method
- A new approach to variable selection in least squares problems
- A semismooth Newton method for Tikhonov functionals with sparsity constraints
- Accelerated projected gradient method for linear inverse problems with sparsity constraints
- An iterative algorithm for nonlinear inverse problems with joint sparsity constraints in vector-valued regimes and an application to color image inpainting
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
- Bregman Monotone Optimization Algorithms
- Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces
- Convergence rates and source conditions for Tikhonov regularization with sparsity constraints
- Convex programming in Hilbert space
- Coordinate and subspace optimization methods for linear least squares with non-quadratic regularization
- Global and Asymptotic Convergence Rate Estimates for a Class of Projected Gradient Processes
- Global uniqueness for a two-dimensional inverse boundary value problem
- Highly sparse representations from dictionaries are unique and independent of the sparseness measure
- Iterated Hard Shrinkage for Minimization Problems with Sparsity Constraints
- Least angle regression. (With discussion)
- Nonlinear iterative methods for linear ill-posed problems in Banach spaces
- Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints
- Recovery of Exact Sparse Representations in the Presence of Bounded Noise
- Regularization of ill-posed problems in Banach spaces: convergence rates
- Signal Recovery by Proximal Forward-Backward Splitting
- Stable recovery of sparse overcomplete representations in the presence of noise
- The Interior Radon Transform
Cited in
(72)- Descent gradient methods for nonsmooth minimization problems in ill-posed problems
- Convergence of iterative hard-thresholding algorithm with continuation
- Quadratic growth conditions and uniqueness of optimal solution to Lasso
- Modified Fejér sequences and applications
- A Barzilai-Borwein type method for minimizing composite functions
- Optimal convergence rates for sparsity promoting wavelet-regularization in Besov spaces
- Sparse Online Variational Bayesian Regression
- Modified iterations for data-sparse solution of linear systems
- Measurement matrix optimization via mutual coherence minimization for compressively sensed signals reconstruction
- Sensitivity analysis for mirror-stratifiable convex functions
- Flexible sparse regularization
- Variable metric inexact line-search-based methods for nonsmooth optimization
- Convergence of the forward-backward algorithm: beyond the worst-case with the help of geometry
- An adaptive accelerated proximal gradient method and its homotopy continuation for sparse optimization
- An iterative thresholding-like algorithm for inverse problems with sparsity constraints in Banach space
- A simple homotopy proximal mapping algorithm for compressive sensing
- A note on the minimization of a Tikhonov functional with \(\ell^1\)-penalty
- Iterative methods based on soft thresholding of hierarchical tensors
- Recursive SURE for iterative reweighted least square algorithms
- Non-convex sparse regularisation
- Sparse group fused Lasso for model segmentation: a hybrid approach
- Low-rank representation-based object tracking using multitask feature learning with joint sparsity
- Dualization of signal recovery problems
- Thresholding gradient methods in Hilbert spaces: support identification and linear convergence
- Convergence analysis of compressive sensing based on SCAD iterative thresholding algorithm
- Mean squared error bounds for the Rangan-Goyal soft thresholding algorithm
- An introduction to continuous optimization for imaging
- Iterative positive thresholding algorithm for non-negative sparse optimization
- Sparse frame DOA estimations via a rank-one correlation model for low SNR and limited snapshots
- Proximal splitting methods in signal processing
- Convergence rates of forward-Douglas-Rachford splitting method
- Linear convergence of inexact descent method and inexact proximal gradient algorithms for lower-order regularization problems
- Influence factors of sparse microwave imaging radar system performance: approaches to waveform design and platform motion analysis
- Local and global convergence of a general inertial proximal splitting scheme for minimizing composite functions
- Multilevel preconditioning and adaptive sparse solution of inverse problems
- A Projection Proximal-Point Algorithm for ℓ1Minimization
- Gradient iteration with \(\ell _{p}\)-norm constraints
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- Stability of the elastic net estimator
- Iterated Hard Shrinkage for Minimization Problems with Sparsity Constraints
- Elastic-Net Regularization: Iterative Algorithms and Asymptotic Behavior of Solutions
- Adaptive wavelet methods and sparsity reconstruction for inverse heat conduction problems
- Convergence rates of gradient methods for convex optimization in the space of measures
- Iterative thresholding compressed sensing MRI based on contourlet transform
- Fast global convergence of gradient methods for high-dimensional statistical recovery
- Scaling techniques for \(\epsilon\)-subgradient methods
- IMRO: A proximal quasi-Newton method for solving \(\ell_1\)-regularized least squares problems
- Optimization methods for regularization-based ill-posed problems: a survey and a multi-objective framework
- Frame soft shrinkage operators are proximity operators
- Structured iterative hard thresholding with on- and off-grid applications
- Necessary and sufficient conditions for linear convergence of \(\ell^1\)-regularization
- A new linear convergence result for the iterative soft thresholding algorithm
- Low complexity regularization of linear inverse problems
- Local linear convergence analysis of primal-dual splitting methods
- On the linear convergence of forward-backward splitting method. I: Convergence analysis
- Eigenvalue-free iterative shrinkage-thresholding algorithm for solving the linear inverse problems
- Deep neural networks for inverse problems with pseudodifferential operators: an application to limited-angle tomography
- Projected gradient iteration for nonlinear operator equation
- Activity identification and local linear convergence of forward-backward-type methods
- <formula formulatype="inline"><tex Notation="TeX">$L_{1/2}$</tex> </formula> Regularization: Convergence of Iterative Half Thresholding Algorithm
- An ADMM algorithm for second-order TV-based MR image reconstruction
- Between hard and soft thresholding: optimal iterative thresholding algorithms
- Minimization of non-smooth, non-convex functionals by iterative thresholding
- Fast thresholding algorithms with feedbacks for sparse signal recovery
- Efficient dictionary learning with sparseness-enforcing projections
- Joint super-resolution image reconstruction and parameter identification in imaging operator: analysis of bilinear operator equations, numerical solution, and application to magnetic particle imaging
- Cardinality minimization, constraints, and regularization: a survey
- Convergence Rate Analysis of Accelerated Forward-Backward Algorithm with Generalized Nesterov Momentum Scheme
- Lagrangian approach and shape gradient for inverse problem of breaking line identification in solid: contact with adhesion
- Resonator Networks, 2: Factorization Performance and Capacity Compared to Optimization-Based Methods
- Neural-network-based regularization methods for inverse problems in imaging
- Far field splitting by iteratively reweighted \(\ell^1\) minimization
This page was built for publication: Linear convergence of iterative soft-thresholding
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q734951)
