Continuous-Domain Solutions of Linear Inverse Problems With Tikhonov Versus Generalized TV Regularization

DOI10.1109/TSP.2018.2860549MaRDI QIDQ4622369zbMATH OpenOpenAlexWikidataFDO

Authors Harshit Gupta, Julien Fageot, M. Unser

Publication date 12 February 2019

Published in IEEE Transactions on Signal Processing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1802.01344

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Signal theory (characterization, reconstruction, filtering, etc.) (94A12)

Abstract: We consider linear inverse problems that are formulated in the continuous domain. The object of recovery is a function that is assumed to minimize a convex objective functional. The solutions are constrained by imposing a continuous-domain regularization. We derive the parametric form of the solution (representer theorems) for Tikhonov (quadratic) and generalized total-variation (gTV) regularizations. We show that, in both cases, the solutions are splines that are intimately related to the regularization operator. In the Tikhonov case, the solution is smooth and constrained to live in a fixed subspace that depends on the measurement operator. By contrast, the gTV regularization results in a sparse solution composed of only a few dictionary elements that are upper-bounded by the number of measurements and independent of the measurement operator. Our findings for the gTV regularization resonates with the minimization of the $l_1$ norm, which is its discrete counterpart and also produces sparse solutions. Finally, we find the experimental solutions for some measurement models in one dimension. We discuss the special case when the gTV regularization results in multiple solutions and devise an algorithm to find an extreme point of the solution set which is guaranteed to be sparse.

Cited in

(15)

• Functional penalised basis pursuit on spheres
• Sparsest piecewise-linear regression of one-dimensional data
• Functional estimation of anisotropic covariance and autocovariance operators on the sphere
• TV-based spline reconstruction with Fourier measurements: uniqueness and convergence of grid-based methods
• A unifying representer theorem for inverse problems and machine learning
• Convex optimization in sums of Banach spaces
• Multikernel regression with sparsity constraint
• An Epigraphical Approach to the Representer Theorem
• TV-based reconstruction of periodic functions
• A representer theorem for deep neural networks
• On representer theorems and convex regularization
• Explicit representations for Banach subspaces of Lizorkin distributions
• Controlled learning of pointwise nonlinearities in neural-network-like architectures
• Convergence analysis of the discretization of continuous-domain inverse problems
• Adaptive vector-valued splines for the resolution of inverse problems

This page was built for publication: Continuous-Domain Solutions of Linear Inverse Problems With Tikhonov Versus Generalized TV Regularization

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4622369)