Optimization methods for regularization-based ill-posed problems: a survey and a multi-objective framework

DOI10.1007/s11704-016-5552-0zbMath1405.94024OpenAlexW2520385699MaRDI QIDQ1712546

Hao Li, Xiangming Jiang, Maoguo Gong

Publication date: 22 January 2019

Published in: Frontiers of Computer Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s11704-016-5552-0

zbMATH Keywords

multi-objective optimizationregularizationill-posed problemsignal processingevolutionary algorithm

Mathematics Subject Classification ID

Multi-objective and goal programming (90C29) Approximation methods and heuristics in mathematical programming (90C59) Signal theory (characterization, reconstruction, filtering, etc.) (94A12)

Uses Software

• PDCO
• UTV
• NESTA
• MOEA/D
• SPEA2
• LSMR
• TwIST

Cites Work

• Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit
• IDR(s): A Family of Simple and Fast Algorithms for Solving Large Nonsymmetric Systems of Linear Equations
• Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction
• Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models
• Fast Solution of $\ell _{1}$-Norm Minimization Problems When the Solution May Be Sparse
• Variational Methods for Denoising Matrix Fields
• Handbook of Mathematical Methods in Imaging
• Elastic-net regularization: error estimates and active set methods
• Rank Degeneracy
• Computing the Generalized Singular Value Decomposition
• An A Posteriori Parameter Choice for Ordinary and Iterated Tikhonov Regularization of Ill-Posed Problems Leading to Optimal Convergence Rates
• Two-Point Step Size Gradient Methods
• Robust methods in inverse theory
• Approximation of generalized inverses by iterated regularization
• Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
• A class of iterative processes for solving degenerate systems of linear algebraic equations
• The Restricted Singular Value Decomposition: Properties and Applications
• Image Selective Smoothing and Edge Detection by Nonlinear Diffusion
• The Modified Truncated SVD Method for Regularization in General Form
• Analysis of Discrete Ill-Posed Problems by Means of the L-Curve
• An iterative method for solving incorrectly posed problems
• A simulation study of ridge and other regression estimators
• Generalizing the Singular Value Decomposition
• A Simulation Study of Alternatives to Ordinary Least Squares
• Atomic Decomposition by Basis Pursuit
• A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration
• The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems
• Optimal a Posteriori Parameter Choice for Tikhonov Regularization for Solving Nonlinear Ill-Posed Problems
• Analysis of bounded variation penalty methods for ill-posed problems
• Rank-Deficient and Discrete Ill-Posed Problems
• Image Decomposition and Restoration Using Total Variation Minimization and theH¹
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• A new approach to variable selection in least squares problems
• Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal
• High-Order Total Variation-Based Image Restoration
• Sparse Reconstruction by Separable Approximation
• A Subband Adaptive Iterative Shrinkage/Thresholding Algorithm
• Shifting Inequality and Recovery of Sparse Signals
• A Random Algorithm for Low-Rank Decomposition of Large-Scale Matrices With Missing Entries
• Decomposition of images by the anisotropic Rudin-Osher-Fatemi model
• Convergence rates of convex variational regularization
• A Statistical View of Some Chemometrics Regression Tools
• Error bounds for tikhonov regularization in hilbert scales
• Computational Methods for Inverse Problems
• Sparse Approximate Solutions to Linear Systems
• Iterative Methods for Total Variation Denoising
• Matching pursuits with time-frequency dictionaries
• Iterative Solution Methods
• A General Heuristic for Choosing the Regularization Parameter in Ill-Posed Problems
• Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization
• L 1/2 regularization
• A Guide to the TV Zoo
• The critical level of discrepancy in regularization methods
• New Bounds for Restricted Isometry Constants
• Dense Error Correction Via $\ell^1$-Minimization
• A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators
• Aspects of Total Variation RegularizedL¹Function Approximation
• Parameter selection for total-variation-based image restoration using discrepancy principle
• Higher Degree Total Variation (HDTV) Regularization for Image Recovery
• Heuristic Parameter-Choice Rules for Convex Variational Regularization Based on Error Estimates
• Efficient Reconstruction of Piecewise Constant Images Using Nonsmooth Nonconvex Minimization
• Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ ¹ minimization
• Second-order Cone Programming Methods for Total Variation-Based Image Restoration
• Efficient Minimization Methods of Mixed l2-l1 and l1-l1 Norms for Image Restoration
• Deblurring and Denoising of Images by Nonlocal Functionals
• Signal Recovery by Proximal Forward-Backward Splitting
• Error estimates for non-quadratic regularization and the relation to enhancement
• A framework for studying the regularizing properties of Krylov subspace methods
• A Numerical Method for Solving Fredholm Integral Equations of the First Kind Using Singular Values
• On the Numerical Solution of Ill-Conditioned Linear Systems with Applications to Ill-Posed Problems
• Some Comments on C P
• An Iterative Regularization Method for Total Variation-Based Image Restoration
• Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares
• Regularization of ill-posed problems in Banach spaces: convergence rates
• An Iteration Formula for Fredholm Integral Equations of the First Kind
• Methods of conjugate gradients for solving linear systems
• Independent Component Analysis and Blind Signal Separation
• Compressed sensing
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
• Nearly unbiased variable selection under minimax concave penalty
• Nonlinear total variation based noise removal algorithms
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Projected nonstationary iterated Tikhonov regularization
• Large-scale Tikhonov regularization via reduction by orthogonal projection
• On the approximation ability of evolutionary optimization with application to minimum set cover
• Domain decomposition methods with graph cuts algorithms for total variation minimization
• An implementable proximal point algorithmic framework for nuclear norm minimization
• Survey of multi-objective optimization methods for engineering
• A survey on multi-objective evolutionary algorithms for many-objective problems
• A new method for TSVD regularization truncated parameter selection
• Adaptive choice of the Tikhonov regularization parameter to solve ill-posed linear algebraic equations via Liapunov optimizing control
• An analysis on recombination in multi-objective evolutionary optimization
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Vector extrapolation applied to truncated singular value decomposition and truncated iteration
• A statistical perspective on ill-posed inverse problems (with discussion)
• Numerical regularization for atmospheric inverse problems
• Duality-based algorithms for total-variation-regularized image restoration
• Iterative thresholding for sparse approximations
• Linear convergence of iterative soft-thresholding
• Enhancing sparsity by reweighted \(\ell _{1}\) minimization
• Multi-parameter Tikhonov regularization -- an augmented approach
• Automatic stopping rule for iterative methods in discrete ill-posed problems
• A tree of generalizations of the ordinary singular value decomposition
• A truncated projected SVD method for linear discrete ill-posed problems
• Tikhonov regularization via flexible Arnoldi reduction
• An a posteriori parameter choice for Tikhonov regularization in the presence of modeling error
• Iterative regularization methods for nonlinear ill-posed problems
• Minimization of Tikhonov functionals in Banach spaces
• Wavelets and curvelets for image deconvolution: a combined approach
• A fast randomized algorithm for the approximation of matrices
• UPRE method for total variation parameter selection
• Multiobjective problem solving from nature. From concepts to applications
• Sparsest solutions of underdetermined linear systems via \( \ell _q\)-minimization for \(0<q\leqslant 1\)
• Extensions of compressed sensing
• Vector extrapolation enhanced TSVD for linear discrete ill-posed problems
• Adaptive total variation image deblurring: a majorization-minimization approach
• Discrepancy principles for Tikhonov regularization of ill-posed problems leading to optimal convergence rates
• The rate of convergence of conjugate gradients
• The truncated SVD as a method for regularization
• Estimation of the mean of a multivariate normal distribution
• Accelerated Landweber iterations for the solution of ill-posed equations
• Tikhonovs regularization method for ill-posed problems. A comparison of different methods for the determination of the regularization parameter
• Multiple objective decision making - methods and applications. A state- of-the-art survey. In collaboration with Sudhakar R. Paidy and Kwangsun Yoon
• Nonstationary iterated Tikhonov regularization
• TV based image restoration with local constraints
• An algorithm for total variation minimization and applications
• On the regularizing properties of the GMRES method
• A parameter choice method for Tikhonov regularization
• Regularization, GSVD and truncated GSVD
• Least angle regression. (With discussion)
• An iterative algorithm for fitting nonconvex penalized generalized linear models with grouped predictors
• Trade-off analysis approach for interactive nonlinear multiobjective optimization
• Thresholding-based iterative selection procedures for model selection and shrinkage
• Old and new parameter choice rules for discrete ill-posed problems
• Two new efficient iterative regularization methods for image restoration problems
• Rescaling the GSVD with application to ill-posed problems
• A new nonlocal total variation regularization algorithm for image denoising
• Fast dual minimization of the vectorial total variation norm and applications to color image processing
• Randomized methods for rank-deficient linear systems
• Efficient algorithm for isotropic and anisotropic total variation deblurring and denoising
• Iterative total variation regularization with non-quadratic fidelity
• Image restoration with discrete constrained total variation. I: Fast and exact optimization
• A primal-dual active-set algorithm for bilaterally constrained total variation deblurring and piecewise constant Mumford-Shah segmentation problems
• Alternating Krylov subspace image restoration methods
• A family of rules for parameter choice in Tikhonov regularization of ill-posed problems with inexact noise level
• Stopping rules for iterative methods in nonnegatively constrained deconvolution
• A TV based restoration model with local constraints
• On the discrepancy principle for iterative and parametric methods to solve linear ill-posed equations
• Multiobjective evolutionary algorithms and applications.
• An affine scaling methodology for best basis selection
• Regularized Regression and Density Estimation based on Optimal Transport
• A modified truncated singular value decomposition method for discrete ill-posed problems
• Randomized algorithms for the low-rank approximation of matrices
• A Singular Value Thresholding Algorithm for Matrix Completion
• Compressive sensing principles and iterative sparse recovery for inverse and ill-posed problems
• NESTA: A Fast and Accurate First-Order Method for Sparse Recovery
• Alternating Direction Algorithms for $\ell_1$-Problems in Compressive Sensing
• Over-relaxation of the fast iterative shrinkage-thresholding algorithm with variable stepsize
• LSMR: An Iterative Algorithm for Sparse Least-Squares Problems
• Efficient determination of multiple regularization parameters in a generalized L-curve framework
• Nonlocal Operators with Applications to Image Processing
• A Fast Total Variation Minimization Method for Image Restoration
• A New Total Variation Method for Multiplicative Noise Removal
• The Split Bregman Method for L1-Regularized Problems
• An Improved Fast Iterative Shrinkage Thresholding Algorithm for Image Deblurring
• The Restricted Singular Value Decomposition of Matrix Triplets
• High-order total variation minimization for interior SPECT
• The discrepancy principle for a class of regularization methods
• Convergence rates for Tikhonov regularisation of non-linear ill-posed problems
• An EM algorithm for wavelet-based image restoration
• Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
• Decoding by Linear Programming
• Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?