Comparing parameter choice methods for regularization of ill-posed problems

DOI10.1016/J.MATCOM.2011.01.016zbMath1220.65063OpenAlexW2104489368MaRDI QIDQ551477

Yong-Cai Geng, Sumit K. Garg

Publication date: 20 July 2011

Published in: Mathematics and Computers in Simulation (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.matcom.2011.01.016

zbMATH Keywords

stabilityinverse problemnumerical examplesTikhonov regularizationill-posed problemregularization parameterparameter choice methodsspectral cut-off regularization

Mathematics Subject Classification ID

Numerical solutions to equations with linear operators (65J10) Numerical solutions of ill-posed problems in abstract spaces; regularization (65J20) Linear operators and ill-posed problems, regularization (47A52) Numerical solution to inverse problems in abstract spaces (65J22)

Related Items (66)

Numerical differentiation by a Tikhonov regularization method based on the discrete cosine transform ⋮ A parameter choice strategy for the inversion of multiple observations ⋮ A stopping criterion for iterative regularization methods ⋮ Fractional Tikhonov regularization to improve the performance of extreme learning machines ⋮ Semi-heuristic parameter choice rules for Tikhonov regularisation with operator perturbations ⋮ Parameter choices for sparse regularization with the ℓ1 norm ^* ⋮ Hyperspectral imagery denoising using a spatial-spectral domain mixing prior ⋮ Parameter determination for Tikhonov regularization problems in general form ⋮ Метод расширенных нормальных уравнений для задач регуляризации Тихонова с дифференцирующим оператором ⋮ Heuristic Parameter Choice in Tikhonov Method from Minimizers of the Quasi-Optimality Function ⋮ Adaptivity and Oracle Inequalities in Linear Statistical Inverse Problems: A (Numerical) Survey ⋮ A probabilistic oracle inequality and quantification of uncertainty of a modified discrepancy principle for statistical inverse problems ⋮ Automatic fidelity and regularization terms selection in variational image restoration ⋮ A machine learning approach to optimal Tikhonov regularization I: Affine manifolds ⋮ Scattered data fitting by minimal surface ⋮ Compact discrepancy and chi-squared principles for over-determined inverse problems ⋮ Choice of regularization parameter based on the regularized solution reconstruction in adaptive signal correction problem ⋮ On regularizing effects of MINRES and MR-II for large scale symmetric discrete ill-posed problems ⋮ On an unsupervised method for parameter selection for the elastic net ⋮ Some notes about the continuous-in-time financial model ⋮ Convergence of regularization methods with filter functions for a regularization parameter chosen with GSURE and mildly ill-posed inverse problems ⋮ Empirical risk minimization as parameter choice rule for general linear regularization methods ⋮ Radial basis function approximation of noisy scattered data on the sphere ⋮ On the Convergence of a Heuristic Parameter Choice Rule for Tikhonov Regularization ⋮ Embedded techniques for choosing the parameter in Tikhonov regularization ⋮ Vector-valued spline method for the spherical multiple-shell electro-magnetoencephalography problem ⋮ Robust GCV choice of the regularization parameter for correlated data ⋮ On the variational data assimilation problem solving and sensitivity analysis ⋮ A GCV based Arnoldi-Tikhonov regularization method ⋮ Parameter choice methods using minimization schemes ⋮ Determination of regularization parameter via solving a multi-objective optimization problem ⋮ A numerical comparison of some heuristic stopping rules for nonlinear Landweber iteration ⋮ Adaptive minimax optimality in statistical inverse problems via SOLIT—Sharp Optimal Lepskiĭ-Inspired Tuning ⋮ Krylov methods for inverse problems: Surveying classical, and introducing new, algorithmic approaches ⋮ Local RBF-based penalized least-squares approximation on the sphere with noisy scattered data ⋮ A Bayesian interpretation of the L-curve ⋮ Noise Level Free Regularization of General Linear Inverse Problems under Unconstrained White Noise ⋮ A family of rules for parameter choice in Tikhonov regularization of ill-posed problems with inexact noise level ⋮ Approximation of the Tikhonov regularization parameter through Aitken's extrapolation ⋮ A predictor-corrector iterated Tikhonov regularization for linear ill-posed inverse problems ⋮ Old and new parameter choice rules for discrete ill-posed problems ⋮ Some results on the regularization of LSQR for large-scale discrete ill-posed problems ⋮ Heuristic Parameter Choice Rules for Tikhonov Regularization with Weakly Bounded Noise ⋮ Stopping rules for iterative methods in nonnegatively constrained deconvolution ⋮ Adaptive choice of the Tikhonov regularization parameter to solve ill-posed linear algebraic equations via Liapunov optimizing control ⋮ Stochastic reaction networks with input processes: analysis and application to gene expression inference ⋮ Comparison of a-posteriori parameter choice rules for linear discrete ill-posed problems ⋮ Sparse approximation of fitting surface by elastic net ⋮ Vector extrapolation applied to truncated singular value decomposition and truncated iteration ⋮ Comparison of parameter choices in regularization algorithms in case of different information about noise level ⋮ Unbiased predictive risk estimation of the Tikhonov regularization parameter: convergence with increasing rank approximations of the singular value decomposition ⋮ Regularization parameter determination for discrete ill-posed problems ⋮ Automatic stopping rule for iterative methods in discrete ill-posed problems ⋮ A simplified L-curve method as error estimator ⋮ Improving the robustness of recursive consequent parameters learning in evolving neuro-fuzzy systems ⋮ On application of asymptotic generalized discrepancy principle to the analysis of epidemiology models ⋮ GCV for Tikhonov regularization via global Golub–Kahan decomposition ⋮ Matrix forms of iterative algorithms to solve large-scale discrete ill-posed problems with an application to image restoration ⋮ Automatic parameter selection based on residual whiteness for convex non-convex variational restoration ⋮ An iterative method to compute minimum norm solutions of ill-posed problems in Hilbert spaces ⋮ Simple stopping criteria for the LSQR method applied to discrete ill-posed problems ⋮ Extension of GKB‐FP algorithm to large‐scale general‐form Tikhonov regularization ⋮ Parameter Choices for Fast Harmonic Spline Approximation ⋮ Regularized functional matching pursuit for the spherical multiple-shell electro-magnetoencephalography problem ⋮ Oracle-type posterior contraction rates in Bayesian inverse problems ⋮ Variational image restoration with constraints on noise whiteness

Uses Software

• Regularization tools
• gss
• ErresTools
• corner.m

Cites Work

• Risk hull method and regularization by projections of ill-posed inverse problems
• Robust GCV choice of the regularization parameter for correlated data
• Parameter choice methods using minimization schemes
• Computation of spherical harmonic coefficients from gravity gradiometry data to be acquired by the GOCE satellite: regularization issues
• A note on the computation of the generalized cross-validation function for ill-conditioned least squares problems
• Parameter tuning in pointwise adaptation using a propagation approach
• Frequency-dependent data weighting in global gravity field modeling from satellite data contaminated by non-stationary noise
• An a posteriori parameter choice for Tikhonov regularization in the presence of modeling error
• Iterative regularization methods for nonlinear ill-posed problems
• On the convergence of the quasioptimality criterion for (iterated) Tikhonov regularization
• On the discrepancy principle for some Newton type methods for solving nonlinear inverse problems
• Error estimates for linear systems with applications to regularization
• Error estimates for the regularization of least squares problems
• A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem
• Asymptotic optimality of \(C_ L\) and generalized cross-validation in ridge regression with application to spline smoothing
• A posteriori parameter choice for general regularization methods for solving linear ill-posed problems
• Asymptotic optimality for \(C_ p\), \(C_ L\), cross-validation and generalized cross-validation: Discrete index set
• A fast ``Monte-Carlo cross-validation procedure for large least squares problems with noisy data
• Approximation of method of regularization estimators
• Regularization of ill-posed problems: Optimal parameter choice in finite dimensions
• Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
• Regularization methods for large-scale problems
• Regularization tools: A Matlab package for analysis and solution of discrete ill-posed problems
• Asymptotic optimality of generalized cross-validation for choosing the regularization parameter
• Asymptotic equivalence of nonparametric regression and white noise
• Inverse acoustic and electromagnetic scattering theory.
• Generalized cross validation for wavelet thresholding
• Nonparametric regression with correlated errors.
• Adaptive estimation of linear functionals in Hilbert scales from indirect white noise observa\-tions
• Statistical and computational inverse problems.
• On an a posteriori parameter choice strategy for Tikhonov regularization of nonlinear ill-posed problems
• Improved estimates of statistical regularization parameters in Fourier differentiation and smoothing
• Selection criteria for scatterplot smoothers
• Oracle inequalities for inverse problems
• \(L\)-curve curvature bounds via Lanczos bidiagonalization
• Limitations of the \(L\)-curve method in ill-posed problems
• A GCV based method for nonlinear ill-posed problems
• Regularization methods for the stable solution of inverse problems
• Exploiting residual information in the parameter choice for discrete ill-posed problems
• An adaptive pruning algorithm for the discrete L-curve criterion
• Gaussian measure in Hilbert space and applications in numerical analysis
• Numerical differentiation procedures for non-exact data
• Choosing Regularization Parameters in Iterative Methods for Ill-Posed Problems
• Inverse problems as statistics
• When is the optimal regularization parameter insensitive to the choice of the loss function?
• The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing
• A cautionary note about crossvalidatory choice
• A Lepskij-type stopping rule for regularized Newton methods
• Regularization without preliminary knowledge of smoothness and error behaviour
• On Minimization Strategies for Choice of the Regularization Parameter in Ill-Posed Problems
• About the Balancing Principle for Choice of the Regularization Parameter
• Robust generalized cross-validation for choosing the regularization parameter
• Regularization of some linear ill-posed problems with discretized random noisy data
• On the choice of the regularization parameter in ill-posed problems with approximately given noise level of data
• Modern statistical estimation via oracle inequalities
• Some considerations concerning regularization and parameter choice algorithms
• A Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing Splines
• Making robust the cross-validatory choice of smoothing parameter in spline smoothing regression
• Nonparametric statistical inverse problems
• Residual periodograms for choosing regularization parameters for ill-posed problems
• Strong robust generalized cross-validation for choosing the regularization parameter
• The quasi-optimality criterion for classical inverse problems
• The convergence of a new heuristic parameter selection criterion for general regularization methods
• Regularization independent of the noise level: an analysis of quasi-optimality
• Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems with Random Noise
• Recent results on the quasi-optimality principle
• Asymptotic convergence rate of arcangeli's method for III-posed problems
• Optimal Choice of a Truncation Level for the Truncated SVD Solution of Linear First Kind Integral Equations When Data are Noisy
• Remarks on choosing a regularization parameter using the quasi-optimality and ratio criterion
• An A Posteriori Parameter Choice for Ordinary and Iterated Tikhonov Regularization of Ill-Posed Problems Leading to Optimal Convergence Rates
• Convergence Rates for Regularized Solutions
• Smoothing Spline Models with Correlated Random Errors
• A Technique for the Numerical Solution of Certain Integral Equations of the First Kind
• Justification of the choice of regularization parameter according to quasi-optimality and quotient criteria
• Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
• Bayesian analysis in inverse problems
• Analysis of Discrete Ill-Posed Problems by Means of the L-Curve
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• The Computation of Generalized Cross-Validation Functions Through Householder Tridiagonalization with Applications to the Fitting of Interaction Spline Models
• The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems
• Optimal a Posteriori Parameter Choice for Tikhonov Regularization for Solving Nonlinear Ill-Posed Problems
• Asymptotic behaviour of the minimum bound method for choosing the regularization parameter
• Comparisons of parameter choice methods for regularization with discrete noisy data
• Geometry of linear ill-posed problems in variable Hilbert scales
• Smoothers and theC_p, Generalized Maximum Likelihood, and Extended Exponential Criteria
• On the best rate of adaptive estimation in some inverse problems
• On the iteratively regularized Gauss-Newton method for solving nonlinear ill-posed problems
• ON APPLICATION OF GENERALIZED DISCREPANCY PRINCIPLE TO ITERATIVE METHODS FOR NONLINEAR ILL-POSED PROBLEMS
• On a Problem of Adaptive Estimation in Gaussian White Noise
• Non-convergence of the L-curve regularization parameter selection method
• Computational Methods for Inverse Problems
• Generalized Arcangeli’s discrepancy principles for a class of regularization methods for solving ill-posed problems
• Confidence Intervals for Nonparametric Curve Estimates
• On the discrepancy principle and generalised maximum likelihood for regularisation
• A Regularization Parameter in Discrete Ill-Posed Problems
• A General Heuristic for Choosing the Regularization Parameter in Ill-Posed Problems
• The use of monotonicity for choosing the regularization parameter in ill-posed problems
• NEW RULE FOR CHOICE OF THE REGULARIZATION PARAMETER IN (ITERATED) TIKHONOV METHOD
• On the quasioptimal regularization parameter choices for solving ill-posed problems
• Optimal regularization for ill-posed problems in metric spaces
• Convergence rate for the Bayesian approach to linear inverse problems
• Extensions and Applications of the Householder Algorithm for Solving Linear Least Squares Problems
• Use of the regularization method in non-linear problems
• LR algorithm with Laguerre shift for symmetric tridiagonal matrices
• Smoothing noisy data with spline functions
• Smoothing spline ANOVA models
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Comparing parameter choice methods for regularization of ill-posed problems