Modern regularization methods for inverse problems

DOI10.1017/S0962492918000016zbMath1431.65080arXiv1801.09922OpenAlexW2963399478WikidataQ129872549 ScholiaQ129872549MaRDI QIDQ5230515

Martin Benning, Martin Burger

Publication date: 28 August 2019

Published in: Acta Numerica (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1801.09922

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Research exposition (monographs, survey articles) pertaining to numerical analysis (65-02) Numerical solutions of ill-posed problems in abstract spaces; regularization (65J20) Numerical solution to inverse problems in abstract spaces (65J22)

Related Items

Continuous Time Limit of the Stochastic Ensemble Kalman Inversion: Strong Convergence Analysis, Learning physics-based models from data: perspectives from inverse problems and model reduction, WARPd: A Linearly Convergent First-Order Primal-Dual Algorithm for Inverse Problems with Approximate Sharpness Conditions, Point source regularization of the finite source reflector problem, Deep microlocal reconstruction for limited-angle tomography, Robust full-waveform inversion using \(q\)-statistics, Two-Layer Neural Networks with Values in a Banach Space, Consistency of Bayesian inference with Gaussian process priors for a parabolic inverse problem, Adaptive Tikhonov strategies for stochastic ensemble Kalman inversion, Two direct factorization methods for inverse scattering problems, Convergence acceleration of ensemble Kalman inversion in nonlinear settings, Shearlet-based regularization in statistical inverse learning with an application to x-ray tomography, Global-DGMRES method for matrix equationAXB = C, Parameter identification for elliptic boundary value problems: an abstract framework and applications, Task adapted reconstruction for inverse problems, Generalized conditional gradient method for elastic-net regularization, Variational regularization in inverse problems and machine learning, Optimization based methods for partially observed chaotic systems, Adaptively weighted difference model of anisotropic and isotropic total variation for image denoising, Strong maximum a posteriori estimation in Banach spaces with Gaussian priors, Relaxation approach for learning neural network regularizers for a class of identification problems, Full-waveform inversion using level set and cut elements for sharp-interface problems, Restoring severely out-of-focus blurred text images with deep image prior, Convex regularization in statistical inverse learning problems, On the identification of Lamé parameters in linear isotropic elasticity via a weighted self-guided TV-regularization method, Invertible residual networks in the context of regularization theory for linear inverse problems, Tikhonov Regularization within Ensemble Kalman Inversion, Sequential Model Correction for Nonlinear Inverse Problems, A deep learning enhanced inverse scattering framework for microwave imaging of piece-wise homogeneous targets, Regularising inverse problems with generative machine learning models, Numerical methods for identifying the diffusion coefficient in a nonlinear elliptic equation, Nonlinear eigenvalue problems for seminorms and applications, Applied harmonic analysis and data science. Abstracts from the workshop held November 28 -- December 4, 2021 (hybrid meeting), Consistency of Bayesian inference with Gaussian process priors in an elliptic inverse problem, Bregman Itoh-Abe methods for sparse optimisation, Morozov's discrepancy principle for \(\alpha\ell_1-\beta\ell_2\) sparsity regularization, Structural changes in nonlocal denoising models arising through bi-level parameter learning, Inverse potential problems for divergence of measures with total variation regularization, A reaction coefficient identification problem for fractional diffusion, Choice of the parameters in a primal-dual algorithm for Bregman iterated variational regularization, Less is often more: applied inverse problems using \(hp\)-forward models, Joint super-resolution image reconstruction and parameter identification in imaging operator: analysis of bilinear operator equations, numerical solution, and application to magnetic particle imaging, Data driven regularization by projection, A projected gradient method for αℓ ₁ − βℓ ₂ sparsity regularization ^**, Variational regularisation for inverse problems with imperfect forward operators and general noise models, Reconstruction Methods in THz Single-Pixel Imaging, Mini-workshop: Deep learning and inverse problems. Abstracts from the mini-workshop held March 4--10, 2018, $l_p$ Regularization for Ensemble Kalman Inversion, Unnamed Item, Unified models for second-order TV-type regularisation in imaging: a new perspective based on vector operators, Computed tomography reconstruction with uncertain view angles by iteratively updated model discrepancy, Linearized Krylov subspace Bregman iteration with nonnegativity constraint, Inexact derivative-free optimization for bilevel learning, Nonlinear spectral decompositions by gradient flows of one-homogeneous functionals, Unique reconstruction of simple magnetizations from their magnetic potential, Convergence Rates for Penalized Least Squares Estimators in PDE Constrained Regression Problems, An entropic Landweber method for linear ill-posed problems, A denoising model adapted for impulse and Gaussian noises using a constrained-PDE, Deep learning as optimal control problems: models and numerical methods, Solving inverse problems using data-driven models, Solution paths of variational regularization methods for inverse problems, An extended direct factorization method for inverse scattering with limited aperture data, Computed tomography with view angle estimation using uncertainty quantification, Remove the salt and pepper noise based on the high order total variation and the nuclear norm regularization, A geometric integration approach to nonsmooth, nonconvex optimisation, Accelerated Iterative Regularization via Dual Diagonal Descent, Inexact Newton regularization combined with two-point gradient methods for nonlinear ill-posed problems ^*, On the robustness of minimum norm interpolators and regularized empirical risk minimizers, Image reconstruction in light-sheet microscopy: spatially varying deconvolution and mixed noise, Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models, Semi-supervised learning-assisted imaging method for electrical capacitance tomography, Implicit regularization with strongly convex bias: Stability and acceleration

Uses Software

• iPiano
• Saga

Cites Work

• Nonlinear total variation based noise removal algorithms
• The Little Engine that Could: Regularization by Denoising (RED)
• Mathematical analysis of a inf-convolution model for image processing
• Locally sparse reconstruction using the \(\ell^{1,\infty}\)-norm
• Bilevel optimization for calibrating point spread functions in blind deconvolution
• A unified approach to convergence rates for \(\ell^{1}\)-regularization and lacking sparsity
• Some remarks on the staircasing phenomenon in total variation-based image denoising
• Infimal convolution regularisation functionals of BV and \(\mathrm{L}^p\) spaces. I: The finite \(p\) case
• Techniques for gradient-based bilevel optimization with non-smooth lower level problems
• Nonlinear spectral analysis via one-homogeneous functionals: overview and future prospects
• Infimal convolution regularizations with discrete \(\ell_1\)-type functionals
• Proximal alternating linearized minimization for nonconvex and nonsmooth problems
• Primal and dual Bregman methods with application to optical nanoscopy
• Regularization methods in Banach spaces.
• Regularization of linear inverse problems with total generalized variation
• On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
• Super-resolution from noisy data
• A Mumford-Shah level-set approach for the inversion and segmentation of SPECT/CT data
• Anisotropic total variation filtering
• Image super-resolution by TV-regularization and Bregman iteration
• Injectivity and \(\text{weak}^\star\)-to-weak continuity suffice for convergence rates in \(\ell^{1}\)-regularization
• Support recovery for sparse super-resolution of positive measures
• Bilevel parameter learning for higher-order total variation regularisation models
• Variational methods on the space of functions of bounded Hessian for convexification and denoising
• The structure of optimal parameters for image restoration problems
• Error estimation for Bregman iterations and inverse scale space methods in image restoration
• On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
• Radon transform inversion using the shearlet representation
• Discrepancy principles for Tikhonov regularization of ill-posed problems leading to optimal convergence rates
• On the choice of the regularization parameter for iterated Tikhonov regularization of ill-posed problems
• The truncated SVD as a method for regularization
• A posteriori parameter choice for general regularization methods for solving linear ill-posed problems
• Tikhonov-regularization of ill-posed linear operator equations on closed convex sets
• Extrapolation and the method of regularization for generalized inverses
• On gradients of functions definable in o-minimal structures
• Proximal minimization algorithm with \(D\)-functions
• Convergence rates of iterated Tikhonov regularized solutions of nonlinear ill-posed problems
• Image recovery via total variation minimization and related problems
• Denoising with higher order derivatives of bounded variation and an application to parameter estimation
• An algorithm for total variation minimization and applications
• A converse result for Banach space convergence rates in Tikhonov-type convex regularization of ill-posed linear equations
• A globally convergent algorithm for nonconvex optimization based on block coordinate update
• Bias reduction in variational regularization
• Existence of variational source conditions for nonlinear inverse problems in Banach spaces
• Statistical and computational inverse problems.
• Estimation techniques for distributed parameter systems
• Mirror descent and nonlinear projected subgradient methods for convex optimization.
• Recovering edges in ill-posed inverse problems: Optimality of curvelet frames.
• A convergence analysis of the Landweber iteration for nonlinear ill-posed problems
• A first-order primal-dual algorithm for convex problems with applications to imaging
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• Iteratively regularized Newton-type methods for general data misfit functionals and applications to Poisson data
• Higher-order TV methods -- enhancement via Bregman iteration
• Scale space and variational methods in computer vision. 4th international conference, SSVM 2013, Schloss Seggau, Leibnitz, Austria, June 2--6, 2013. Proceedings
• Nonsmooth optimization using Taylor-like models: error bounds, convergence, and termination criteria
• A combined first and second order variational approach for image reconstruction
• Local behavior of sparse analysis regularization: applications to risk estimation
• Discretization-invariant Bayesian inversion and Besov space priors
• Fast dual minimization of the vectorial total variation norm and applications to color image processing
• Nonparametric Bayesian posterior contraction rates for discretely observed scalar diffusions
• Non-smooth non-convex Bregman minimization: unification and new algorithms
• Image denoising: learning the noise model via nonsmooth PDE-constrained optimization
• Seismic data reconstruction via matrix completion
• Nonlinear inverse scale space methods
• Ground states and singular vectors of convex variational regularization methods
• Fast singular value thresholding without singular value decomposition
• On \(\ell^1\)-regularization in light of Nashed's ill-posedness concept
• Exact matrix completion via convex optimization
• The Mathematics of Computerized Tomography
• Mathematical Methods in Image Reconstruction
• A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics
• A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part II: Numerics
• Variable Metric Inexact Line-Search-Based Methods for Nonsmooth Optimization
• Posterior consistency and convergence rates for Bayesian inversion with hypoelliptic operators
• Inverse problems with Poisson data: statistical regularization theory, applications and algorithms
• Variational inequalities and higher order convergence rates for Tikhonov regularisation on Banach spaces
• Variational smoothness assumptions in convergence rate theory—an overview
• Multiscale Methods for Polyhedral Regularizations
• Regularization Properties of Mumford--Shah-Type Functionals with Perimeter and Norm Constraints for Linear Ill-Posed Problems
• A Bilevel Optimization Approach for Parameter Learning in Variational Models
• A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion
• iPiano: Inertial Proximal Algorithm for Nonconvex Optimization
• Inverse problems: A Bayesian perspective
• Introduction to Shearlets
• A Variational Approach for Sharpening High Dimensional Images
• Total variation regularization in measurement and image space for PET reconstruction
• Dynamic Sampling Schemes for Optimal Noise Learning Under Multiple Nonsmooth Constraints
• Robust Sparse Analysis Regularization
• Robust principal component analysis?
• Linear convergence rates for Tikhonov regularization with positively homogeneous functionals
• Well posedness and convergence of some regularisation methods for non-linear ill posed problems
• Optimal approximations by piecewise smooth functions and associated variational problems
• Analysis and Generalizations of the Linearized Bregman Method
• Linearized Bregman iterations for compressed sensing
• Convergence of the linearized Bregman iteration for ℓ₁-norm minimization
• A Singular Value Thresholding Algorithm for Matrix Completion
• Large‐Scale Inverse Problems and Quantification of Uncertainty
• A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science
• Necessary and sufficient conditions for linear convergence of ℓ1-regularization
• Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs
• Joint reconstruction via coupled Bregman iterations with applications to PET-MR imaging
• Variational Depth From Focus Reconstruction
• Blind image fusion for hyperspectral imaging with the directional total variation
• Sparsity-promoting and edge-preserving maximum a posteriori estimators in non-parametric Bayesian inverse problems
• Inverse scale space decomposition
• Convergence rates of convex variational regularization
• Inverse Problem Theory and Methods for Model Parameter Estimation
• An Anisotropic Inf-Convolution BV Type Model for Dynamic Reconstruction
• Equivalence of weak and strong modes of measures on topological vector spaces
• Nonlinear Proximal Point Algorithms Using Bregman Functions, with Applications to Convex Programming
• Error bounds for tikhonov regularization in hilbert scales
• Generalized Inverses in Reproducing Kernel Spaces: An Approach to Regularization of Linear Operator Equations
• Computational Methods for Inverse Problems
• Total Bounded Variation Regularization as a Bilaterally Constrained Optimization Problem
• Matching pursuits with time-frequency dictionaries
• Approximate inverse for linear and some nonlinear problems
• Inverse problems in spaces of measures
• An adaptive inverse scale space method for compressed sensing
• A Hyperelastic Regularization Energy for Image Registration
• Convergence rates inℓ¹-regularization if the sparsity assumption fails
• A primal–dual hybrid gradient method for nonlinear operators with applications to MRI
• A Guide to the TV Zoo
• EM-TV Methods for Inverse Problems with Poisson Noise
• Joint reconstruction of PET-MRI by exploiting structural similarity
• A Total Variation Spectral Framework for Scale and Texture Analysis
• On Infimal Convolution of TV-Type Functionals and Applications to Video and Image Reconstruction
• Color Bregman TV
• Convergence Rates of Approximate Least Squares Solutions of Linear Integral and Operator Equations of the First Kind
• Infimal Convolution of Oscillation Total Generalized Variation for the Recovery of Images with Structured Texture
• Multiscale Segmentation via Bregman Distances and Nonlinear Spectral Analysis
• CLEAR: Covariant LEAst-Square Refitting with Applications to Image Restoration
• On the convergence of a linesearch based proximal-gradient method for nonconvex optimization
• Sparse regularization on thin grids I: the Lasso
• Analysis versus synthesis in signal priors
• Sparsity and incoherence in compressive sampling
• Convergence Rates of General Regularization Methods for Statistical Inverse Problems and Applications
• Numerical methods for the design of large-scale nonlinear discrete ill-posed inverse problems
• Characterizations of Variational Source Conditions, Converse Results, and Maxisets of Spectral Regularization Methods
• Learning optimal spatially-dependent regularization parameters in total variation image denoising
• Sparse solutions to linear inverse problems with multiple measurement vectors
• Proximal-gradient algorithms for fractional programming
• Convergence rates for regularization functionals with polyconvex integrands
• Sparse spikes super-resolution on thin grids II: the continuous basis pursuit
• Higher Degree Total Variation (HDTV) Regularization for Image Recovery
• Analysis of regularized inversion of data corrupted by white Gaussian noise
• Towards a Mathematical Theory of Super‐resolution
• An iterative algorithm for nonlinear inverse problems with joint sparsity constraints in vector-valued regimes and an application to color image inpainting
• The Łojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems
• Optimally Sparse Multidimensional Representation Using Shearlets
• A note on logarithmic convergence rates for nonlinear Tikhonov regularization
• Bregman Iterative Algorithms for $\ell_1$-Minimization with Applications to Compressed Sensing
• Error estimates for non-quadratic regularization and the relation to enhancement
• Variational, Geometric, and Level Set Methods in Computer Vision
• Ridge Regression: Biased Estimation for Nonorthogonal Problems
• On the stability of the functional optimization problem
• State Constraints in Convex Control Problems of Bolza
• An Iterative Regularization Method for Total Variation-Based Image Restoration
• Image Processing and Analysis
• Regularization of ill-posed problems in Banach spaces: convergence rates
• Consistency and rates of convergence of nonlinear Tikhonov regularization with random noise
• A Descent Lemma Beyond Lipschitz Gradient Continuity: First-Order Methods Revisited and Applications
• An introduction to continuous optimization for imaging
• MAP estimators and their consistency in Bayesian nonparametric inverse problems
• Total Generalized Variation
• A variational formulation for frame-based inverse problems
• An Iteration Formula for Fredholm Integral Equations of the First Kind
• A method for the solution of certain non-linear problems in least squares
• Choose Your Path Wisely: Gradient Descent in a Bregman Distance Framework
• Learning Filter Functions in Regularisers by Minimising Quotients
• Inverse acoustic and electromagnetic scattering theory
• Inverse problems for partial differential equations
• Compressed sensing
• Sparse Image and Signal Processing
• An introduction to frames and Riesz bases
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Hierarchical models in statistical inverse problems and the Mumford–Shah functional
• Designing Optimal Spectral Filters for Inverse Problems
• Adapting to Unknown Smoothness via Wavelet Shrinkage
• Infimal Convolution of Data Discrepancies for Mixed Noise Removal
• Convergence Rates for Maximum Entropy Regularization
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• Spectral Decompositions Using One-Homogeneous Functionals
• Inertial Proximal Alternating Linearized Minimization (iPALM) for Nonconvex and Nonsmooth Problems
• Multicontrast MRI Reconstruction with Structure-Guided Total Variation
• Approximation of functional depending on jumps by elliptic functional via t-convergence
• The iteratively regularized Gauss–Newton method with convex constraints and applications in 4Pi microscopy
• Sparsity-promoting Bayesian inversion
• Continuous dependence on data for solutions of partial differential equations with a prescribed bound
• On Debiasing Restoration Algorithms: Applications to Total-Variation and Nonlocal-Means
• A Survey in Mathematics for Industry : Open problems in the qualitative approach to inverse electromagnetic scattering theory
• Nonlinear iterative methods for linear ill-posed problems in Banach spaces
• Maximuma posterioriprobability estimates in infinite-dimensional Bayesian inverse problems
• Global Convergence of Splitting Methods for Nonconvex Composite Optimization
• Mathematical Foundations of Infinite-Dimensional Statistical Models
• Convergence rates for Tikhonov regularisation of non-linear ill-posed problems
• Inverse Total Variation Flow
• Nonparametric statistical inverse problems
• Total Variation Regularization for Image Denoising, I. Geometric Theory
• A Variational Approach to Removing Multiplicative Noise
• The Discontinuity Set of Solutions of the TV Denoising Problem and Some Extensions
• On inverse problems in secondary oil recovery
• Reconstruction in the inverse crack problem by variational methods
• Convergence results for the Bayesian inversion theory
• Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
• Decoding by Linear Programming
• Stable recovery of sparse overcomplete representations in the presence of noise
• Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
• Characterizations of Łojasiewicz inequalities: Subgradient flows, talweg, convexity
• A New Approach to Source Conditions in Regularization with General Residual Term
• Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems with Random Noise
• Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization
• Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints
• Iterative methods for nonlinear ill-posed problems in Banach spaces: convergence and applications to parameter identification problems
• Iterative total variation schemes for nonlinear inverse problems
• Model Reduction for Large-Scale Systems with High-Dimensional Parametric Input Space
• On Tikhonov functionals penalized by Bregman distances
• Identification of Parameters in Distributed Parameter Systems by Regularization
• Remarks on choosing a regularization parameter using the quasi-optimality and ratio criterion
• An A Posteriori Parameter Choice for Ordinary and Iterated Tikhonov Regularization of Ill-Posed Problems Leading to Optimal Convergence Rates
• THE INVERSE SCATTERING PROBLEM FOR TIME-HARMONIC ACOUSTIC WAVES IN AN INHOMOGENEOUS MEDIUM
• An a Posteriori Parameter Choice for Tikhonov Regularization in Hilbert Scales Leading to Optimal Convergence Rates
• A Technique for the Numerical Solution of Certain Integral Equations of the First Kind
• An Algorithm for Least-Squares Estimation of Nonlinear Parameters
• Splitting Algorithms for the Sum of Two Nonlinear Operators
• Approximation of generalized inverses by iterated regularization
• On the principle of iterative regularization
• Superresolution via Sparsity Constraints
• Entropic Proximal Mappings with Applications to Nonlinear Programming
• Iteration methods for convexly constrained ill-posed problems in hilbert space
• Analysis of Discrete Ill-Posed Problems by Means of the L-Curve
• An iterative method for solving incorrectly posed problems
• Regularization and approximation of linear operator equations in reproducing kernel spaces
• Algorithms for the regularization of ill-conditioned least squares problems
• Methods for solving monotonic variational inequalities, based on the principle of iterative regularization
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration
• Inverse problems with structural prior information
• Maximum Entropy Regularization for Fredholm Integral Equations of the First Kind
• Analysis of bounded variation penalty methods for ill-posed problems
• An Introduction to Inverse Scattering and Inverse Spectral Problems
• Some Newton-type methods for the regularization of nonlinear ill-posed problems
• Logarithmic convergence rates of the iteratively regularized Gauss - Newton method for an inverse potential and an inverse scattering problem
• Proximal Minimization Methods with Generalized Bregman Functions
• Regularization of linear least squares problems by total bounded variation
• Learning regularization functionals a supervised training approach
• Edge-preserving and scale-dependent properties of total variation regularization
• Structural Properties of Solutions to Total Variation Regularization Problems
• ESSENTIAL SMOOTHNESS, ESSENTIAL STRICT CONVEXITY, AND LEGENDRE FUNCTIONS IN BANACH SPACES
• ANALYSIS OF OPTICAL FLOW MODELS IN THE FRAMEWORK OF THE CALCULUS OF VARIATIONS
• Large noise in variational regularization
• A function space framework for structural total variation regularization with applications in inverse problems
• Dynamic MRI reconstruction from undersampled data with an anatomical prescan
• First Order Methods Beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems
• Vector-Valued Image Processing by Parallel Level Sets