Sparse regression using mixed norms
The article deals mixed norms that are suitable to solve regression problems in order to exploit both structure and sparsity. Regression problems are reformulated as optimization problems. Multi-layered expansion on unions of dictionaries of signals are considered. These expansions are performed using an exact reconstruction constraint, through a modified FOCUSS algorithm. The paper is organized in six sections. Section 1 is devoted to the introduction, the presentation of the problem and the definition of mixed norms. Section 2 deals with properties of mixed norms. In Section 3 the author explains the problem of signal estimation subject to equality constraints. The algorithm is presented, convergence results are studied and extension to multi-layered expansion is developed. The infinite-dimensional case is considered in Section 4, that is related to the signal estimation in the presence of noise. Section 5 gives illustrations of the algorithms previously introduced and the influence of mixed norms. Finally conclusions and outlooks are mentioned in Section 6. The article is difficult to read for people who are not experienced on this topic. In general, the author explains in detail the problems and the proofs of the theorems (some of them are given in the Appendix). Besides that, the author makes an effort to write in a self-contained way. Particularly, the solution of the problem in Section 4 is very well explained. Each algorithm presented in this paper is supported by theorems and convergence results. The examples to illustrate the developed ideas are related to the field of audio signal processing. These techniques could be adapted to image processing problems in a straightforward manner. In the conclusions it is shown an interesting table with comparisons of advantages and drawbacks of the algorithms. Finally, some extensions for the method are suggested as a future work.
- scientific article; zbMATH DE number 7750673
- Sparse Convex Regression
- A note on sparse least-squares regression
- Approximate sparse linear regression
- Sparse linear regression from perturbed data
- Some priors for sparse regression modelling
- Scaled sparse linear regression
- Marginalized Lasso in sparse regression
- Regularity properties for sparse regression
- Sparse regression for extreme values
- A Schur test for weighted mixed-norm spaces
- An affine scaling methodology for best basis selection
- An iterative algorithm for nonlinear inverse problems with joint sparsity constraints in vector-valued regimes and an application to color image inpainting
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
- Atomic Decomposition by Basis Pursuit
- scientific article; zbMATH DE number 5119348 (Why is no real title available?)
- scientific article; zbMATH DE number 3748742 (Why is no real title available?)
- scientific article; zbMATH DE number 1380579 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Hybrid representations for audiophonic signal encoding
- Image decomposition via the combination of sparse representations and a variational approach
- Iterative thresholding algorithms
- Model Selection and Estimation in Regression with Grouped Variables
- Modulation spaces: looking back and ahead
- Multi-frame representations in linear inverse problems with mixed multi-constraints
- Nonlinear approximation with local Fourier bases
- On Restrictions and Extensions of the Besov and Triebel-Lizorkin Spaces with Respect to Lipschitz Domains
- On the existence and nonexistence of Lagrange multipliers in Banach spaces
- On the importance of combining wavelet-based nonlinear approximation with coding strategies
- Proximité et dualité dans un espace hilbertien
- Random Models for Sparse Signals Expansion on Unions of Bases With Application to Audio Signals
- Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints
- Regularization and Variable Selection Via the Elastic Net
- Signal Recovery by Proximal Forward-Backward Splitting
- Sparse solutions to linear inverse problems with multiple measurement vectors
- Sparsity and persistence: mixed norms provide simple signal models with dependent coefficients
- The composite absolute penalties family for grouped and hierarchical variable selection
- The spaces L^ p, with mixed norm
- Sparsity and persistence: mixed norms provide simple signal models with dependent coefficients
- Exact recovery of sparse multiple measurement vectors by \(l_{2,p}\)-minimization
- Fast projections onto mixed-norm balls with applications
- Alternating direction multiplier method for matrix \(l_{2,1}\)-norm optimization in multitask feature learning problems
- Recovery under side constraints
- Linear convergence of prox-SVRG method for separable non-smooth convex optimization problems under bounded metric subregularity
- A proximal alternating direction method for \(\ell_{2,1}\)-norm least squares problem in multi-task feature learning
- A note on sparse least-squares regression
- Locally sparse reconstruction using the \(\ell^{1,\infty}\)-norm
- Regularity properties for sparse regression
- Collaborative total variation: a general framework for vectorial TV models
- Comprehensive comparative analysis and identification of RNA-binding protein domains: multi-class classification and feature selection
- Scaled sparse linear regression
- THE LINEAR TIME FREQUENCY ANALYSIS TOOLBOX
- Linear Regression With a Sparse Parameter Vector
- scientific article; zbMATH DE number 6866335 (Why is no real title available?)
- Blind source separation with outliers in transformed domains
- Discerning the linear convergence of ADMM for structured convex optimization through the lens of variational analysis
- Sparse and nonnegative sparse D-MORPH regression
- Compressed sensing-based reconstruction for computed tomography with translational trajectory
- Provably robust blind source separation of linear-quadratic near-separable mixtures
- Purely time-dependent optimal control of quasilinear parabolic PDEs with sparsity enforcing penalization
- Knot placement for B-spline curve approximation via \(L_{\infty, 1}\)-norm and differential evolution algorithm
- Sparse regularized fuzzy regression
- Sparse and switching infinite horizon optimal controls with mixed-norm penalizations
- Scalable algorithms for the sparse ridge regression
- On a class of linear regression methods
- A highly efficient algorithm for solving exclusive lasso problems
- Adaptive sieving: a dimension reduction technique for sparse optimization problems
- A Bayesian approach to multi-task learning with network Lasso
- Multiple regression for matrix and vector predictors: models, theory, algorithms, and beyond
This page was built for publication: Sparse regression using mixed norms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q734328)
