Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization

DOI10.1137/S0036144597321909zbMath0913.65032MaRDI QIDQ4210364

Arnold Neumaier

Publication date: 21 September 1998

Published in: SIAM Review (Search for Journal in Brave)

zbMATH Keywords

regularizationerror boundsTikhonov regularizationgeneralized cross validationill-posedgeneralized maximum likelihoodill-conditioned

Mathematics Subject Classification ID

Numerical solutions to overdetermined systems, pseudoinverses (65F20)

Related Items (50)

Efficient emulators for scattering using eigenvector continuation ⋮ Fast estimation of multivariate spatiotemporal Hawkes processes and network reconstruction ⋮ A heuristic for optimizing stochastic activity networks with applications to statistical digital circuit sizing ⋮ A hybrid of adjustable trust-region and nonmonotone algorithms for unconstrained optimization ⋮ Alternating direction method of multipliers for \(\ell_{1}\)-\(\ell_{2}\)-regularized logistic regression model ⋮ Stable Likelihood Computation for Gaussian Random Fields ⋮ An optimal subgradient algorithm for large-scale bound-constrained convex optimization ⋮ A sketched finite element method for elliptic models ⋮ An optimal subgradient algorithm with subspace search for costly convex optimization problems ⋮ Numerical linear algebra in data assimilation ⋮ Optimal subgradient algorithms for large-scale convex optimization in simple domains ⋮ An inverse problem in modelling liquid metal spraying ⋮ A regularised estimator for long-range dependent processes ⋮ APPROXIMATING SMOOTH, MULTIVARIATE FUNCTIONS ON IRREGULAR DOMAINS ⋮ A rational Arnoldi approach for ill-conditioned linear systems ⋮ The convergence of the perturbed Newton method and its application for ill-conditioned problems ⋮ Object selection in credit scoring using covariance matrix of parameters estimations ⋮ Structured penalties for functional linear models -- partially empirical eigenvectors for regression ⋮ Uncertainty quantification for nonlinear difference equations with dependent random inputs via a stochastic Galerkin projection technique ⋮ Solving inverse source problems by the orthogonal solution and kernel correction algorithm (OSKCA) with applications in fluorescence tomography ⋮ Fast hybrid numerical-asymptotic boundary element methods for high frequency screen and aperture problems based on least-squares collocation ⋮ A discrete least squares collocation method for two-dimensional nonlinear time-dependent partial differential equations ⋮ Sparse identification of truncation errors ⋮ A box regularized particle filter for state estimation with severely ambiguous and non-linear measurements ⋮ The Lagrange method for the regularization of discrete ill-posed problems ⋮ GARCH modelling of covariance in dynamical estimation of inverse solutions ⋮ The numerical rank of a matrix and its applications ⋮ Regularization using a parameterized trust region subproblem ⋮ Preconditioning linear systems via matrix function evaluation ⋮ Adaptive non-linear high gain observer based sensorless speed estimation of an induction motor ⋮ On the covariance-Hessian relation in evolution strategies ⋮ Sparse discretization matrices for Volterra integral operators with applications to numerical differentiation ⋮ Methods for Modal Model Quality Improvement — Measurement Data Pre-processing for Model Identification Process (part I) ⋮ Regression based automatic face annotation for deformable model building ⋮ Interactive planning and sensing in unknown static environments with task-driven sensor placement ⋮ On efficiency of nonmonotone Armijo-type line searches ⋮ Optimization-Based Approach for Joint X-Ray Fluorescence and Transmission Tomographic Inversion ⋮ Quasi-boundary value methods for regularizing the backward parabolic equation under the optimal control framework ⋮ A wavelet-based method for solving discrete first-kind Fredholm equations with piecewise constant solutions ⋮ Trust-region and other regularisations of linear least-squares problems ⋮ Accelerated first-order methods for large-scale convex optimization: nearly optimal complexity under strong convexity ⋮ Optimal subgradient methods: computational properties for large-scale linear inverse problems ⋮ On the Sensitivity of Singular and Ill-Conditioned Linear Systems ⋮ Frames and Numerical Approximation ⋮ Numerical differentiation from a viewpoint of regularization theory ⋮ Inverse problems in dynamic cognitive modeling ⋮ Numerical analysis of non-uniform sampling problem ⋮ The best approximate solution of the inconsistent linear system via a quadratic penalty function ⋮ Wavelet domain signal deconvolution with singularity-preserving regularization ⋮ Spatially adaptive splines for statistical linear inverse problems

This page was built for publication: Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization