Splines are universal solutions of linear inverse problems with generalized TV regularization
From MaRDI portal
(Redirected from Publication:4592947)
Abstract: Splines come in a variety of flavors that can be characterized in terms of some differential operator L. The simplest piecewise-constant model corresponds to the derivative operator. Likewise, one can extend the traditional notion of total variation by considering more general operators than the derivative. This leads us to the definition of the generalized Beppo-Levi space M, which is further identified as the direct sum of two Banach spaces. We then prove that the minimization of the generalized total variation (gTV) over M, subject to some arbitrary (convex) consistency constraints on the linear measurements of the signal, admits nonuniform L-spline solutions with fewer knots than the number of measurements. This shows that non-uniform splines are universal solutions of continuous-domain linear inverse problems with LASSO, L1, or TV-like regularization constraints. Remarkably, the spline-type is fully determined by the choice of L and does not depend on the actual nature of the measurements.
Recommendations
- Splines in higher order TV regularization
- Exact solutions of infinite dimensional total-variation regularized problems
- Structural Properties of Solutions to Total Variation Regularization Problems
- Exact recovery of non-uniform splines from the projection onto spaces of algebraic polynomials
- TV-based spline reconstruction with Fourier measurements: uniqueness and convergence of grid-based methods
Cites work
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- A mathematical introduction to compressive sensing
- A practical guide to splines
- An algorithm for total variation minimization and applications
- An EM algorithm for wavelet-based image restoration
- An introduction to sparse stochastic processes
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
- Approximation properties of Sobolev splines and the construction of compactly supported equivalents
- Breaking the coherence barrier: a new theory for compressed sensing
- Canonical decomposition of steerable functions
- Cardinal exponential splines: part I - theory and filtering algorithms
- Compressed sensing
- Compressed Sensing and Redundant Dictionaries
- Exact support recovery for sparse spikes deconvolution
- Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems
- Fractional Splines and Wavelets
- From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
- Generalized sampling and infinite-dimensional compressed sensing
- Harmonic analysis of the space BV.
- scientific article; zbMATH DE number 5359727 (Why is no real title available?)
- scientific article; zbMATH DE number 5190601 (Why is no real title available?)
- scientific article; zbMATH DE number 4046318 (Why is no real title available?)
- scientific article; zbMATH DE number 47968 (Why is no real title available?)
- scientific article; zbMATH DE number 3533448 (Why is no real title available?)
- scientific article; zbMATH DE number 1022519 (Why is no real title available?)
- scientific article; zbMATH DE number 1022658 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3187905 (Why is no real title available?)
- scientific article; zbMATH DE number 3101307 (Why is no real title available?)
- Inverse problems in spaces of measures
- L-splines
- Les espaces du type de Beppo Levi
- Locally adaptive regression splines
- Nonlinear total variation based noise removal algorithms
- Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
- Polyharmonic cardinal splines
- Representer Theorems for Sparsity-Promoting <inline-formula> <tex-math notation="LaTeX">$\ell _{1}$ </tex-math> </inline-formula> Regularization
- Riesz potentials, higher Riesz transforms and Beppo Levi spaces
- Sampling -- 50 years after Shannon
- Sampling signals with finite rate of innovation
- Sampling theory. Beyond bandlimited systems
- Scattered Data Approximation
- Self-Similarity: Part I—Splines and Operators
- Shape-preserving, multiscale fitting of univariate data by cubic \(L_1\) smoothing splines
- Sparse and redundant representations. From theory to applications in signal and image processing.
- Sparsity and incoherence in compressive sampling
- Spline solutions to L\(^1\) extremal problems in one and several variables
- Splines in higher order TV regularization
- Stable signal recovery from incomplete and inaccurate measurements
- Super-resolution from noisy data
- Super-resolution of point sources via convex programming
- Support recovery for sparse super-resolution of positive measures
- Taut-string algorithm and regularization programs with \(G\)-norm data fit
- The restricted isometry property and its implications for compressed sensing
- The Split Bregman Method for L1-Regularized Problems
Cited in
(43)- Mini-workshop: Deep learning and inverse problems. Abstracts from the mini-workshop held March 4--10, 2018
- Energy on spheres and discreteness of minimizing measures
- Functional penalised basis pursuit on spheres
- Learning quantities of interest from dynamical systems for observation-consistent inversion
- Sparsest piecewise-linear regression of one-dimensional data
- TV-based spline reconstruction with Fourier measurements: uniqueness and convergence of grid-based methods
- Understanding neural networks with reproducing kernel Banach spaces
- Deep learning architectures for nonlinear operator functions and nonlinear inverse problems
- Atomic norm minimization for decomposition into complex exponentials and optimal transport in Fourier domain
- A unifying representer theorem for inverse problems and machine learning
- On the linear convergence rates of exchange and continuous methods for total variation minimization
- Sparsity of solutions for variational inverse problems with finite-dimensional data
- Non-uniform spline recovery from small degree polynomial approximation
- Exact recovery of non-uniform splines from the projection onto spaces of algebraic polynomials
- Convex optimization in sums of Banach spaces
- A new approach for the inversion of the attenuated Radon transform
- Sampling the Fourier transform along radial lines
- Banach space representer theorems for neural networks and ridge splines
- Multikernel regression with sparsity constraint
- On the extremal points of the ball of the Benamou-Brenier energy
- An Epigraphical Approach to the Representer Theorem
- A superposition principle for the inhomogeneous continuity equation with Hellinger–Kantorovich-regular coefficients
- On the uniqueness of solutions for the basis pursuit in the continuum
- What Kinds of Functions Do Deep Neural Networks Learn? Insights from Variational Spline Theory
- TV-based reconstruction of periodic functions
- A representer theorem for deep neural networks
- On representer theorems and convex regularization
- Explicit representations for Banach subspaces of Lizorkin distributions
- A generalized conditional gradient method for dynamic inverse problems with optimal transport regularization
- Dynamical programming for off-the-grid dynamic inverse problems
- From kernel methods to neural networks: a unifying variational formulation
- Compositional function spaces for deep learning
- Moments, time-inversion and source identification for the heat equation
- Representation and regression problems in neural networks: relaxation, generalization, and numerics
- Grid is good. Adaptive refinement algorithms for off-the-grid total variation minimization
- Controlled learning of pointwise nonlinearities in neural-network-like architectures
- Convergence analysis of the discretization of continuous-domain inverse problems
- A machine-learning enabled framework for quantifying uncertainties in parameters of computational models
- Extremal points and sparse optimization for generalized Kantorovich-Rubinstein norms
- Function-space optimality of neural architectures with multivariate nonlinearities
- A sparse optimization approach to infinite infimal convolution regularization
- A Lipschitz spaces view of infinitely wide shallow neural networks
- Splines in higher order TV regularization
This page was built for publication: Splines are universal solutions of linear inverse problems with generalized TV regularization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4592947)
