Comparing parameter choice methods for regularization of ill-posed problems

DOI10.1016/j.matcom.2011.01.016zbMath1220.65063OpenAlexW2104489368MaRDI QIDQ551477

Yong-Cai Geng, Sumit K. Garg

Publication date: 20 July 2011

Published in: Mathematics and Computers in Simulation (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.matcom.2011.01.016

zbMATH Keywords

stabilityinverse problemnumerical examplesTikhonov regularizationill-posed problemregularization parameterparameter choice methodsspectral cut-off regularization

Mathematics Subject Classification ID

Numerical solutions to equations with linear operators (65J10) Numerical solutions of ill-posed problems in abstract spaces; regularization (65J20) Linear operators and ill-posed problems, regularization (47A52) Numerical solution to inverse problems in abstract spaces (65J22)

Related Items

Numerical differentiation by a Tikhonov regularization method based on the discrete cosine transform, A parameter choice strategy for the inversion of multiple observations, A stopping criterion for iterative regularization methods, Fractional Tikhonov regularization to improve the performance of extreme learning machines, Semi-heuristic parameter choice rules for Tikhonov regularisation with operator perturbations, Parameter choices for sparse regularization with the ℓ1 norm ^*, Hyperspectral imagery denoising using a spatial-spectral domain mixing prior, Parameter determination for Tikhonov regularization problems in general form, Метод расширенных нормальных уравнений для задач регуляризации Тихонова с дифференцирующим оператором, Heuristic Parameter Choice in Tikhonov Method from Minimizers of the Quasi-Optimality Function, Adaptivity and Oracle Inequalities in Linear Statistical Inverse Problems: A (Numerical) Survey, A probabilistic oracle inequality and quantification of uncertainty of a modified discrepancy principle for statistical inverse problems, Automatic fidelity and regularization terms selection in variational image restoration, A machine learning approach to optimal Tikhonov regularization I: Affine manifolds, Scattered data fitting by minimal surface, Compact discrepancy and chi-squared principles for over-determined inverse problems, Choice of regularization parameter based on the regularized solution reconstruction in adaptive signal correction problem, On regularizing effects of MINRES and MR-II for large scale symmetric discrete ill-posed problems, On an unsupervised method for parameter selection for the elastic net, Some notes about the continuous-in-time financial model, Convergence of regularization methods with filter functions for a regularization parameter chosen with GSURE and mildly ill-posed inverse problems, Empirical risk minimization as parameter choice rule for general linear regularization methods, Radial basis function approximation of noisy scattered data on the sphere, On the Convergence of a Heuristic Parameter Choice Rule for Tikhonov Regularization, Embedded techniques for choosing the parameter in Tikhonov regularization, Vector-valued spline method for the spherical multiple-shell electro-magnetoencephalography problem, Robust GCV choice of the regularization parameter for correlated data, On the variational data assimilation problem solving and sensitivity analysis, A GCV based Arnoldi-Tikhonov regularization method, Parameter choice methods using minimization schemes, Determination of regularization parameter via solving a multi-objective optimization problem, A numerical comparison of some heuristic stopping rules for nonlinear Landweber iteration, Adaptive minimax optimality in statistical inverse problems via SOLIT—Sharp Optimal Lepskiĭ-Inspired Tuning, Krylov methods for inverse problems: Surveying classical, and introducing new, algorithmic approaches, Local RBF-based penalized least-squares approximation on the sphere with noisy scattered data, A Bayesian interpretation of the L-curve, Noise Level Free Regularization of General Linear Inverse Problems under Unconstrained White Noise, A family of rules for parameter choice in Tikhonov regularization of ill-posed problems with inexact noise level, Approximation of the Tikhonov regularization parameter through Aitken's extrapolation, A predictor-corrector iterated Tikhonov regularization for linear ill-posed inverse problems, Old and new parameter choice rules for discrete ill-posed problems, Some results on the regularization of LSQR for large-scale discrete ill-posed problems, Heuristic Parameter Choice Rules for Tikhonov Regularization with Weakly Bounded Noise, Stopping rules for iterative methods in nonnegatively constrained deconvolution, Adaptive choice of the Tikhonov regularization parameter to solve ill-posed linear algebraic equations via Liapunov optimizing control, Stochastic reaction networks with input processes: analysis and application to gene expression inference, Comparison of a-posteriori parameter choice rules for linear discrete ill-posed problems, Sparse approximation of fitting surface by elastic net, Vector extrapolation applied to truncated singular value decomposition and truncated iteration, Comparison of parameter choices in regularization algorithms in case of different information about noise level, Unbiased predictive risk estimation of the Tikhonov regularization parameter: convergence with increasing rank approximations of the singular value decomposition, Regularization parameter determination for discrete ill-posed problems, Automatic stopping rule for iterative methods in discrete ill-posed problems, A simplified L-curve method as error estimator, Improving the robustness of recursive consequent parameters learning in evolving neuro-fuzzy systems, On application of asymptotic generalized discrepancy principle to the analysis of epidemiology models, GCV for Tikhonov regularization via global Golub–Kahan decomposition, Matrix forms of iterative algorithms to solve large-scale discrete ill-posed problems with an application to image restoration, Automatic parameter selection based on residual whiteness for convex non-convex variational restoration, An iterative method to compute minimum norm solutions of ill-posed problems in Hilbert spaces, Simple stopping criteria for the LSQR method applied to discrete ill-posed problems, Extension of GKB‐FP algorithm to large‐scale general‐form Tikhonov regularization, Parameter Choices for Fast Harmonic Spline Approximation, Regularized functional matching pursuit for the spherical multiple-shell electro-magnetoencephalography problem, Oracle-type posterior contraction rates in Bayesian inverse problems, Variational image restoration with constraints on noise whiteness

Uses Software

• Regularization tools
• gss
• ErresTools
• corner.m

Cites Work

• Geometry of linear ill-posed problems in variable Hilbert scales
• Smoothers and theC_p, Generalized Maximum Likelihood, and Extended Exponential Criteria
• On the best rate of adaptive estimation in some inverse problems
• On the iteratively regularized Gauss-Newton method for solving nonlinear ill-posed problems
• ON APPLICATION OF GENERALIZED DISCREPANCY PRINCIPLE TO ITERATIVE METHODS FOR NONLINEAR ILL-POSED PROBLEMS
• On a Problem of Adaptive Estimation in Gaussian White Noise
• Non-convergence of the L-curve regularization parameter selection method
• Computational Methods for Inverse Problems
• Generalized Arcangeli’s discrepancy principles for a class of regularization methods for solving ill-posed problems
• Confidence Intervals for Nonparametric Curve Estimates
• On the discrepancy principle and generalised maximum likelihood for regularisation
• A Regularization Parameter in Discrete Ill-Posed Problems
• A General Heuristic for Choosing the Regularization Parameter in Ill-Posed Problems
• The use of monotonicity for choosing the regularization parameter in ill-posed problems
• NEW RULE FOR CHOICE OF THE REGULARIZATION PARAMETER IN (ITERATED) TIKHONOV METHOD
• On the quasioptimal regularization parameter choices for solving ill-posed problems
• Optimal regularization for ill-posed problems in metric spaces
• Convergence rate for the Bayesian approach to linear inverse problems
• Extensions and Applications of the Householder Algorithm for Solving Linear Least Squares Problems
• Use of the regularization method in non-linear problems
• LR algorithm with Laguerre shift for symmetric tridiagonal matrices
• Smoothing noisy data with spline functions
• Smoothing spline ANOVA models
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Risk hull method and regularization by projections of ill-posed inverse problems
• Robust GCV choice of the regularization parameter for correlated data
• Parameter choice methods using minimization schemes
• Computation of spherical harmonic coefficients from gravity gradiometry data to be acquired by the GOCE satellite: regularization issues
• A note on the computation of the generalized cross-validation function for ill-conditioned least squares problems
• Parameter tuning in pointwise adaptation using a propagation approach
• Frequency-dependent data weighting in global gravity field modeling from satellite data contaminated by non-stationary noise
• An a posteriori parameter choice for Tikhonov regularization in the presence of modeling error
• Iterative regularization methods for nonlinear ill-posed problems
• On the convergence of the quasioptimality criterion for (iterated) Tikhonov regularization
• On the discrepancy principle for some Newton type methods for solving nonlinear inverse problems
• Error estimates for linear systems with applications to regularization
• Error estimates for the regularization of least squares problems
• A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem
• Asymptotic optimality of \(C_ L\) and generalized cross-validation in ridge regression with application to spline smoothing
• A posteriori parameter choice for general regularization methods for solving linear ill-posed problems
• Asymptotic optimality for \(C_ p\), \(C_ L\), cross-validation and generalized cross-validation: Discrete index set
• A fast ``Monte-Carlo cross-validation procedure for large least squares problems with noisy data
• Approximation of method of regularization estimators
• Regularization of ill-posed problems: Optimal parameter choice in finite dimensions
• Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
• Regularization methods for large-scale problems
• Regularization tools: A Matlab package for analysis and solution of discrete ill-posed problems
• Asymptotic optimality of generalized cross-validation for choosing the regularization parameter
• Asymptotic equivalence of nonparametric regression and white noise
• Inverse acoustic and electromagnetic scattering theory.
• Generalized cross validation for wavelet thresholding
• Nonparametric regression with correlated errors.
• Adaptive estimation of linear functionals in Hilbert scales from indirect white noise observa\-tions
• Statistical and computational inverse problems.
• On an a posteriori parameter choice strategy for Tikhonov regularization of nonlinear ill-posed problems
• Improved estimates of statistical regularization parameters in Fourier differentiation and smoothing
• Selection criteria for scatterplot smoothers
• Oracle inequalities for inverse problems
• \(L\)-curve curvature bounds via Lanczos bidiagonalization
• Limitations of the \(L\)-curve method in ill-posed problems
• A GCV based method for nonlinear ill-posed problems
• Regularization methods for the stable solution of inverse problems
• Exploiting residual information in the parameter choice for discrete ill-posed problems
• An adaptive pruning algorithm for the discrete L-curve criterion
• Gaussian measure in Hilbert space and applications in numerical analysis
• Numerical differentiation procedures for non-exact data
• Choosing Regularization Parameters in Iterative Methods for Ill-Posed Problems
• Inverse problems as statistics
• When is the optimal regularization parameter insensitive to the choice of the loss function?
• The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing
• A cautionary note about crossvalidatory choice
• A Lepskij-type stopping rule for regularized Newton methods
• Regularization without preliminary knowledge of smoothness and error behaviour
• On Minimization Strategies for Choice of the Regularization Parameter in Ill-Posed Problems
• About the Balancing Principle for Choice of the Regularization Parameter
• Robust generalized cross-validation for choosing the regularization parameter
• Regularization of some linear ill-posed problems with discretized random noisy data
• On the choice of the regularization parameter in ill-posed problems with approximately given noise level of data
• Modern statistical estimation via oracle inequalities
• Some considerations concerning regularization and parameter choice algorithms
• A Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing Splines
• Making robust the cross-validatory choice of smoothing parameter in spline smoothing regression
• Nonparametric statistical inverse problems
• Residual periodograms for choosing regularization parameters for ill-posed problems
• Strong robust generalized cross-validation for choosing the regularization parameter
• The quasi-optimality criterion for classical inverse problems
• The convergence of a new heuristic parameter selection criterion for general regularization methods
• Regularization independent of the noise level: an analysis of quasi-optimality
• Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems with Random Noise
• Recent results on the quasi-optimality principle
• Asymptotic convergence rate of arcangeli's method for III-posed problems
• Optimal Choice of a Truncation Level for the Truncated SVD Solution of Linear First Kind Integral Equations When Data are Noisy
• Remarks on choosing a regularization parameter using the quasi-optimality and ratio criterion
• An A Posteriori Parameter Choice for Ordinary and Iterated Tikhonov Regularization of Ill-Posed Problems Leading to Optimal Convergence Rates
• Convergence Rates for Regularized Solutions
• Smoothing Spline Models with Correlated Random Errors
• A Technique for the Numerical Solution of Certain Integral Equations of the First Kind
• Justification of the choice of regularization parameter according to quasi-optimality and quotient criteria
• Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
• Bayesian analysis in inverse problems
• Analysis of Discrete Ill-Posed Problems by Means of the L-Curve
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• The Computation of Generalized Cross-Validation Functions Through Householder Tridiagonalization with Applications to the Fitting of Interaction Spline Models
• The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems
• Optimal a Posteriori Parameter Choice for Tikhonov Regularization for Solving Nonlinear Ill-Posed Problems
• Asymptotic behaviour of the minimum bound method for choosing the regularization parameter
• Comparisons of parameter choice methods for regularization with discrete noisy data