The residual method for regularizing ill-posed problems (Q425458): Difference between revisions

In signal or image processing (particularly, in compressed sensing) the main considered tool is the residual method. A deeper mathematical frame within Banach or topological vectorial spaces is still missing in contrast to the equivalent (at some point) Tikhonov regularization. Drawing a parallel between these two methods, we can imagine the missing mathematical gap within the residual method. The paper aims to fill that lack ``as much as possible''. Specifically, the existence (well-posedness), stability and convergence (rates) are discussed. Three main examples are given. First, one deals with regularization on $L_p$-spaces and shows the equivalence between Tikhonov and residual methods. Secondly, one deals with regularization of probability measures. The last example regards the compressed sensing.

0 references

reviewed by

Ştefan M. Şoltuz

0 references

zbMATH Keywords

ill-posed problems

0 references

residual method

0 references

sparsity

0 references

stability

0 references

convergence

0 references

signal processing

0 references

Banach space

0 references

$L_p$ space

0 references

image processing

0 references

compressed sensing

0 references

Tikhonov regularization

0 references

MaRDI profile type

MaRDI publication profile

0 references

cites work

Analysis of bounded variation penalty methods for ill-posed problems

0 references

Minimization of Tikhonov functionals in Banach spaces

0 references

An extension of the variational inequality approach for obtaining convergence rates in regularization of nonlinear ill-posed problems

0 references

Q4792091

0 references

Regularization with non-convex separable constraints

0 references

Convergence rates of convex variational regularization

0 references

The restricted isometry property and its implications for compressed sensing

0 references

Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information

0 references

Stable signal recovery from incomplete and inaccurate measurements

0 references

Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?

0 references

A variational formulation for frame-based inverse problems

0 references

Q3999276

0 references

An iterative thresholding algorithm for linear inverse problems with a sparsity constraint

0 references

Restricted Isometry Constants Where $\ell ^{p}$ Sparse Recovery Can Fail for $0≪ p \leq 1$

0 references

For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution

0 references

For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution

0 references

Stable recovery of sparse overcomplete representations in the presence of noise

0 references

Q4085497

0 references

Sparse and Redundant Representations

0 references

Q4895893

0 references

Convergence rates for Tikhonov regularisation of non-linear ill-posed problems

0 references

A New Approach to Source Conditions in Regularization with General Residual Term

0 references

Q3414549

0 references

Sparsest solutions of underdetermined linear systems via $ \ell _q$-minimization for $0<q\leqslant 1$

0 references

Recovery of Exact Sparse Representations in the Presence of Bounded Noise

0 references

A class of Wasserstein metrics for probability distributions

0 references

Well-posedness and convergence rates for sparse regularization with sublinear $l^q$ penalty term

0 references

Generalized Bregman distances and convergence rates for non-convex regularization methods

0 references

Non-convex sparse regularisation

0 references

Sparse regularization with l q penalty term

0 references

Necessary and sufficient conditions for linear convergence of ℓ1-regularization

0 references

Q3334886

0 references

Q3504998

0 references

Approximate source conditions for nonlinear ill-posed problems—chances and limitations

0 references

A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators

0 references

Convergence rates for Tikhonov regularization based on range inclusions

0 references

0 references

0 references

0 references

0 references

0 references

Convergence rates and source conditions for Tikhonov regularization with sparsity constraints

0 references

An Introduction to Banach Space Theory

0 references

Q4875411

0 references

Regularization of ill-posed problems in Banach spaces: convergence rates

0 references

Error estimates for non-quadratic regularization and the relation to enhancement

0 references

Optimal a Posteriori Parameter Choice for Tikhonov Regularization for Solving Nonlinear Ill-Posed Problems

0 references

Variational methods in imaging

0 references

Q3951141

0 references

Well posedness and convergence of some regularisation methods for non-linear ill posed problems

0 references

Q4339231

0 references

Convergence criterion of the residual method

0 references

Q4210942

0 references

Q4125663

0 references

Just relax: convex programming methods for identifying sparse signals in noise

0 references

Some tendencies in the Tikhonov regularization of ill-posed problems

0 references

Strong convergence results related to strict convexity

0 references

Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces

0 references

On Tikhonov regularization with non-convex sparsity constraints

0 references

Identifiers

zbMATH Open document ID

1247.65076

0 references

Mathematics Subject Classification ID

0 references

0 references

0 references

0 references

0 references

0 references

0 references

0 references

0 references

journals/amc/GrasmairHS11

0 references

DOI

10.1016/J.AMC.2011.08.009

0 references

Sitelinks

Mathematics(1 entry)

mardi Publication:425458

@@ Property / DOI @@
-.1016/j.amc.2011.08.009
@@ Property / DOI: 10.1016/j.amc.2011.08.009 / rank @@
-Normal rank
@@ Property / review text @@
+In signal or image processing (particularly, in compressed sensing) the main considered tool is the residual method. A deeper mathematical frame within Banach or topological vectorial spaces is still missing in contrast to the equivalent (at some point) Tikhonov regularization. Drawing a parallel between these two methods, we can imagine the missing mathematical gap within the residual method. The paper aims to fill that lack ``as much as possible''. Specifically, the existence (well-posedness), stability and convergence (rates) are discussed. Three main examples are given. First, one deals with regularization on \(L_p\)-spaces and shows the equivalence between Tikhonov and residual methods. Secondly, one deals with regularization of probability measures. The last example regards the compressed sensing.
+Normal rank
@@ Property / reviewed by @@
+Ştefan M. Şoltuz
@@ Property / reviewed by: Ştefan M. Şoltuz / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+J20
@@ Property / Mathematics Subject Classification ID: 65J20 / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+J15
@@ Property / Mathematics Subject Classification ID: 65J15 / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+A08
@@ Property / Mathematics Subject Classification ID: 94A08 / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+A12
@@ Property / Mathematics Subject Classification ID: 94A12 / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+J06
@@ Property / Mathematics Subject Classification ID: 47J06 / rank @@
+Normal rank
@@ Property / zbMATH DE Number @@
+6043889
@@ Property / zbMATH DE Number: 6043889 / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+ill-posed problems
@@ Property / zbMATH Keywords: ill-posed problems / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+residual method
@@ Property / zbMATH Keywords: residual method / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+sparsity
@@ Property / zbMATH Keywords: sparsity / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+stability
@@ Property / zbMATH Keywords: stability / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+convergence
@@ Property / zbMATH Keywords: convergence / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+signal processing
@@ Property / zbMATH Keywords: signal processing / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+Banach space
@@ Property / zbMATH Keywords: Banach space / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+\(L_p\) space
@@ Property / zbMATH Keywords: \(L_p\) space / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+image processing
@@ Property / zbMATH Keywords: image processing / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+compressed sensing
@@ Property / zbMATH Keywords: compressed sensing / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+Tikhonov regularization
@@ Property / zbMATH Keywords: Tikhonov regularization / rank @@
+Normal rank
@@ Property / Wikidata QID @@
+Q41100922
@@ Property / Wikidata QID: Q41100922 / rank @@
+Normal rank
@@ Property / MaRDI profile type @@
+MaRDI publication profile
@@ Property / MaRDI profile type: MaRDI publication profile / rank @@
+Normal rank
@@ Property / OpenAlex ID @@
+W2060993709
@@ Property / OpenAlex ID: W2060993709 / rank @@
+Normal rank
@@ Property / arXiv ID @@
+.1187
@@ Property / arXiv ID: 0905.1187 / rank @@
+Normal rank
@@ Property / cites work @@
+Analysis of bounded variation penalty methods for ill-posed problems
+Normal rank
@@ Property / cites work @@
+Minimization of Tikhonov functionals in Banach spaces
+Normal rank
@@ Property / cites work @@
+An extension of the variational inequality approach for obtaining convergence rates in regularization of nonlinear ill-posed problems
+Normal rank
@@ Property / cites work @@
+Q4792091
@@ Property / cites work: Q4792091 / rank @@
+Normal rank
@@ Property / cites work @@
+Regularization with non-convex separable constraints
+Normal rank
@@ Property / cites work @@
+Convergence rates of convex variational regularization
+Normal rank
@@ Property / cites work @@
+The restricted isometry property and its implications for compressed sensing
+Normal rank
@@ Property / cites work @@
+Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
+Normal rank
@@ Property / cites work @@
+Stable signal recovery from incomplete and inaccurate measurements
+Normal rank
@@ Property / cites work @@
+Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
+Normal rank
@@ Property / cites work @@
+A variational formulation for frame-based inverse problems
+Normal rank
@@ Property / cites work @@
+Q3999276
@@ Property / cites work: Q3999276 / rank @@
+Normal rank
@@ Property / cites work @@
+An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
+Normal rank
@@ Property / cites work @@
+Restricted Isometry Constants Where $\ell ^{p}$ Sparse Recovery Can Fail for $0≪ p \leq 1$
+Normal rank
@@ Property / cites work @@
+For most large underdetermined systems of equations, the minimal 𝓁<sub>1</sub>‐norm near‐solution approximates the sparsest near‐solution
+Normal rank
@@ Property / cites work @@
+For most large underdetermined systems of linear equations the minimal 𝓁<sub>1</sub>‐norm solution is also the sparsest solution
+Normal rank
@@ Property / cites work @@
+Stable recovery of sparse overcomplete representations in the presence of noise
+Normal rank
@@ Property / cites work @@
+Q4085497
@@ Property / cites work: Q4085497 / rank @@
+Normal rank
@@ Property / cites work @@
+Sparse and Redundant Representations
@@ Property / cites work: Sparse and Redundant Representations / rank @@
+Normal rank
@@ Property / cites work @@
+Q4895893
@@ Property / cites work: Q4895893 / rank @@
+Normal rank
@@ Property / cites work @@
+Convergence rates for Tikhonov regularisation of non-linear ill-posed problems
+Normal rank
@@ Property / cites work @@
+A New Approach to Source Conditions in Regularization with General Residual Term
+Normal rank
@@ Property / cites work @@
+Q3414549
@@ Property / cites work: Q3414549 / rank @@
+Normal rank
@@ Property / cites work @@
+Sparsest solutions of underdetermined linear systems via \( \ell _q\)-minimization for \(0<q\leqslant 1\)
+Normal rank
@@ Property / cites work @@
+Recovery of Exact Sparse Representations in the Presence of Bounded Noise
+Normal rank
@@ Property / cites work @@
+A class of Wasserstein metrics for probability distributions
+Normal rank
@@ Property / cites work @@
+Well-posedness and convergence rates for sparse regularization with sublinear \(l^q\) penalty term
+Normal rank
@@ Property / cites work @@
+Generalized Bregman distances and convergence rates for non-convex regularization methods
+Normal rank
@@ Property / cites work @@
+Non-convex sparse regularisation
@@ Property / cites work: Non-convex sparse regularisation / rank @@
+Normal rank
@@ Property / cites work @@
+Sparse regularization with                     <i>                       l                       <sup>q</sup>                     </i>                     penalty term
+Normal rank
@@ Property / cites work @@
+Necessary and sufficient conditions for linear convergence of ℓ1-regularization
+Normal rank
@@ Property / cites work @@
+Q3334886
@@ Property / cites work: Q3334886 / rank @@
+Normal rank
@@ Property / cites work @@
+Q3504998
@@ Property / cites work: Q3504998 / rank @@
+Normal rank
@@ Property / cites work @@
+Approximate source conditions for nonlinear ill-posed problems—chances and limitations
+Normal rank
@@ Property / cites work @@
+A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators
+Normal rank
@@ Property / cites work @@
+Convergence rates for Tikhonov regularization based on range inclusions
+Normal rank
@@ Property / cites work @@
+Q5588901
@@ Property / cites work: Q5588901 / rank @@
+Normal rank
@@ Property / cites work @@
+Q3951472
@@ Property / cites work: Q3951472 / rank @@
+Normal rank
@@ Property / cites work @@
+Q3226265
@@ Property / cites work: Q3226265 / rank @@
+Normal rank
@@ Property / cites work @@
+Q5541833
@@ Property / cites work: Q5541833 / rank @@
+Normal rank
@@ Property / cites work @@
+Q4188284
@@ Property / cites work: Q4188284 / rank @@
+Normal rank
@@ Property / cites work @@
+Convergence rates and source conditions for Tikhonov regularization with sparsity constraints
+Normal rank
@@ Property / cites work @@
+An Introduction to Banach Space Theory
@@ Property / cites work: An Introduction to Banach Space Theory / rank @@
+Normal rank
@@ Property / cites work @@
+Q4875411
@@ Property / cites work: Q4875411 / rank @@
+Normal rank
@@ Property / cites work @@
+Regularization of ill-posed problems in Banach spaces: convergence rates
+Normal rank
@@ Property / cites work @@
+Error estimates for non-quadratic regularization and the relation to enhancement
+Normal rank
@@ Property / cites work @@
+Optimal a Posteriori Parameter Choice for Tikhonov Regularization for Solving Nonlinear Ill-Posed Problems
+Normal rank
@@ Property / cites work @@
+Variational methods in imaging
@@ Property / cites work: Variational methods in imaging / rank @@
+Normal rank
@@ Property / cites work @@
+Q3951141
@@ Property / cites work: Q3951141 / rank @@
+Normal rank
@@ Property / cites work @@
+Well posedness and convergence of some regularisation methods for non-linear ill posed problems
+Normal rank
@@ Property / cites work @@
+Q4339231
@@ Property / cites work: Q4339231 / rank @@
+Normal rank
@@ Property / cites work @@
+Convergence criterion of the residual method
@@ Property / cites work: Convergence criterion of the residual method / rank @@
+Normal rank
@@ Property / cites work @@
+Q4210942
@@ Property / cites work: Q4210942 / rank @@
+Normal rank
@@ Property / cites work @@
+Q4125663
@@ Property / cites work: Q4125663 / rank @@
+Normal rank
@@ Property / cites work @@
+Just relax: convex programming methods for identifying sparse signals in noise
+Normal rank
@@ Property / cites work @@
+Some tendencies in the Tikhonov regularization of ill-posed problems
+Normal rank
@@ Property / cites work @@
+Strong convergence results related to strict convexity
+Normal rank
@@ Property / cites work @@
+Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces
+Normal rank
@@ Property / cites work @@
+On Tikhonov regularization with non-convex sparsity constraints
+Normal rank
@@ Property / DBLP publication ID @@
+journals/amc/GrasmairHS11
@@ Property / DBLP publication ID: journals/amc/GrasmairHS11 / rank @@
+Normal rank
@@ Property / DOI @@
+.1016/J.AMC.2011.08.009
@@ Property / DOI: 10.1016/J.AMC.2011.08.009 / rank @@
+Normal rank
@@ links / mardi / name / links / mardi / name @@
+Publication:425458