Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization

From MaRDI portal
Publication:5460772

DOI10.1073/pnas.0437847100zbMath1064.94011OpenAlexW2154332973WikidataQ24681748 ScholiaQ24681748MaRDI QIDQ5460772

David L. Donoho, Michael Elad

Publication date: 19 July 2005

Published in: Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1073/pnas.0437847100



Related Items

Geršgorin variations. IV: A left eigenvector approach., Best subset selection via a modern optimization lens, Signal recovery under cumulative coherence, Secure estimation based Kalman filter for cyber-physical systems against sensor attacks, Directional Haar wavelet frames on triangles, Robust sparse component analysis based on a generalized Hough transform, New constructions of \(K\)-g-frames, Sparse solutions of linear complementarity problems, Solution of linear ill-posed problems by model selection and aggregation, On shrinking and boundedly complete Schauder frames of Banach spaces, Deterministic convolutional compressed sensing matrices, Revisiting compressed sensing: exploiting the efficiency of simplex and sparsification methods, 1-bit compressive sensing: reformulation and RRSP-based sign recovery theory, Equiangular tight frames that contain regular simplices, A variational approach of the rank function, Backtracking-based simultaneous orthogonal matching pursuit for sparse unmixing of hyperspectral data, Highly sparse representations from dictionaries are unique and independent of the sparseness measure, Approximation accuracy, gradient methods, and error bound for structured convex optimization, Multiple suboptimal solutions for prediction rules in gene expression data, Minimal and maximal unconditional bases with respect to framings, Theory of compressive sensing via \(\ell_1\)-minimization: a non-RIP analysis and extensions, Impacts of high dimensionality in finite samples, Feature selection when there are many influential features, Frames for operators in Banach spaces, Restricted normal cones and sparsity optimization with affine constraints, Online fault diagnosis for nonlinear power systems, Approximating sampled sinusoids and multiband signals using multiband modulated DPSS dictionaries, Recovery of sparsest signals via \(\ell^q \)-minimization, Optimization over finite frame varieties and structured dictionary design, Sampling in the analysis transform domain, \(l_p\)-optimal rankings and max-optimal rankings are different, Two are better than one: fundamental parameters of frame coherence, Verifiable conditions of \(\ell_{1}\)-recovery for sparse signals with sign restrictions, From compression to compressed sensing, A note on preserving the spark of a matrix, Direct data domain STAP using sparse representation of clutter spectrum, A Bayesian approach for inferring neuronal connectivity from calcium fluorescent imaging data, Optimization methods for regularization-based ill-posed problems: a survey and a multi-objective framework, Recovery of signals under the condition on RIC and ROC via prior support information, Median filter based compressed sensing model with application to MR image reconstruction, Analysis sparse representation for nonnegative signals based on determinant measure by DC programming, Simultaneous nonparametric regression in RADWT dictionaries, On the conditioning of random subdictionaries, Robustness of orthogonal matching pursuit under restricted isometry property, Analysis of orthogonal multi-matching pursuit under restricted isometry property, A sharp nonasymptotic bound and phase diagram of \(L_{1/2}\) regularization, Signal recovery under mutual incoherence property and oracle inequalities, A new perspective on least squares under convex constraint, Sparse dual frames and dual Gabor functions of minimal time and frequency supports, The road to deterministic matrices with the restricted isometry property, High-dimensional Bayesian inference in nonparametric additive models, Equivalence and strong equivalence between the sparsest and least \(\ell _1\)-norm nonnegative solutions of linear systems and their applications, Discrete uncertainty principles and sparse signal processing, Rejoinder: One-step sparse estimates in nonconcave penalized likelihood models, ``Preconditioning for feature selection and regression in high-dimensional problems, Blind identification of fully observed linear time-varying systems via sparse recovery, Computing sparse representation in a highly coherent dictionary based on difference of \(L_1\) and \(L_2\), Fast L1-L2 minimization via a proximal operator, Disjoint sparsity for signal separation and applications to hybrid inverse problems in medical imaging, Coefficient quantization for frames in Banach spaces, Spark-level sparsity and the \(\ell_1\) tail minimization, A modified greedy analysis pursuit algorithm for the cosparse analysis model, Sparse decomposition by iterating Lipschitzian-type mappings, Image reconstruction using analysis model prior, Sparse recovery under weak moment assumptions, The null space property for sparse recovery from multiple measurement vectors, Identification of switched linear systems via sparse optimization, Restricted \(p\)-isometry property and its application for nonconvex compressive sensing, Underdetermined blind separation of non-disjoint signals in time-frequency domain based on matrix diagonalization, Two-dimensional random projection, Approximation related to quotient functionals, Sparse approximate solution of partial differential equations, High-dimensional Ising model selection using \(\ell _{1}\)-regularized logistic regression, CMB data analysis and sparsity, Stochastic expansions using continuous dictionaries: Lévy adaptive regression kernels, A convex optimization approach to filtering in jump linear systems with state dependent transitions, Sparse recovery by non-convex optimization - instance optimality, On performance of greedy algorithms, Real versus complex null space properties for sparse vector recovery, A unified approach to model selection and sparse recovery using regularized least squares, When do stepwise algorithms meet subset selection criteria?, Estimating the dimension of a model, Lasso-type recovery of sparse representations for high-dimensional data, Iterative thresholding for sparse approximations, Analysis of basis pursuit via capacity sets, On some deterministic dictionaries supporting sparsity, Sub-Nyquist sampling and reconstruction model of LFM signals based on blind compressed sensing in FRFT domain, Chirp sensing codes: Deterministic compressed sensing measurements for fast recovery, Factor-Adjusted Regularized Model Selection, A null space analysis of the \(\ell_1\)-synthesis method in dictionary-based compressed sensing, A survey of uncertainty principles and some signal processing applications, Sparsest solutions of underdetermined linear systems via \( \ell _q\)-minimization for \(0<q\leqslant 1\), K-hyperline clustering learning for sparse component analysis, Sparse solutions to underdetermined Kronecker product systems, Preserving injectivity under subgaussian mappings and its application to compressed sensing, Theoretical guarantees for graph sparse coding, Analysis of a nonsmooth optimization approach to robust estimation, Empirical average-case relation between undersampling and sparsity in X-ray CT, The weighted majority algorithm, On error correction with errors in both the channel and syndrome, A smoothing iterative method for quantile regression with nonconvex \(\ell_p\) penalty, A dynamical analysis on non-local autoregressive model and its application on image reconstruction, Efficient projection algorithms onto the weighted \(\ell_1\) ball, Exploiting prior knowledge in compressed sensing to design robust systems for endoscopy image recovery, Stable high-order cubature formulas for experimental data, Entropic Regularization of the ℓ 0 Function, A LONE code for the sparse control of quantum systems, Frame operators of \(K\)-frames, A novel coherence reduction method in compressed sensing for DOA estimation, The asymptotic distribution and Berry-Esseen bound of a new test for independence in high dimension with an application to stochastic optimization, Iteratively reweighted least squares and slime mold dynamics: connection and convergence, Single frame image super-resolution: should we process locally or globally?, Sparse signal recovery via generalized Gaussian function, Bias versus non-convexity in compressed sensing, Bayesian factor-adjusted sparse regression, Analysis vs synthesis with structure -- an investigation of union of subspace models on graphs, Sparse pseudo spectral projection methods with directional adaptation for uncertainty quantification, Compressed sensing for finite-valued signals, Toric symplectic geometry and full spark frames, Low-rank and joint-sparse signal recovery using sparse Bayesian learning in a WBAN, Weaving phase retrieval and weaving norm retrieval, Phase retrieval of real-valued signals in a shift-invariant space, Complex best \(r\)-term approximations almost always exist in finite dimensions, Stretchy binary classification, Globally sparse and locally dense signal recovery for compressed sensing, A uniform framework for the combination of penalties in generalized structured models, Full spark frames, A smoothing method for sparse optimization over convex sets, A filtered bucket-clustering method for projection onto the simplex and the \(\ell_1\) ball, Spatially distributed sampling and reconstruction, A near-optimal sampling strategy for sparse recovery of polynomial chaos expansions, Fast overcomplete dictionary construction with probabilistic guarantees, Atomic norm minimization for decomposition into complex exponentials and optimal transport in Fourier domain, Compressive Sensing, Cayley sum graphs and their applications to codebooks, Processing of sparse signals and mutual coherence of ``measurable vectors, Greedy-like algorithms for the cosparse analysis model, On Linguistic Variables and Sparse Representations, On the sparsity of Lasso minimizers in sparse data recovery, A characterization of Schauder frames which are near-Schauder bases, A new class of near-optimal partial Fourier codebooks from an almost difference set, Kriging-enhanced ensemble variational data assimilation for scalar-source identification in turbulent environments, Optimized projections for compressed sensing via rank-constrained nearest correlation matrix, Analysis of the ratio of \(\ell_1\) and \(\ell_2\) norms in compressed sensing, Beyond sparsity: recovering structured representations by \({\ell}^1\) minimization and greedy algorithms, A preconditioning approach for improved estimation of sparse polynomial chaos expansions, Beyond coherence: Recovering structured time-frequency representations, Minimization of transformed \(L_1\) penalty: theory, difference of convex function algorithm, and robust application in compressed sensing, Gaussian averages of interpolated bodies and applications to approximate reconstruction, Graph-induced restricted Boltzmann machines for document modeling, A bilinear algorithm for sparse representations, Analysis of inpainting via clustered sparsity and microlocal analysis, A new iterative firm-thresholding algorithm for inverse problems with sparsity constraints, Geometric separation by single-pass alternating thresholding, Stable restoration and separation of approximately sparse signals, Fast thresholding algorithms with feedbacks for sparse signal recovery, A performance guarantee for orthogonal matching pursuit using mutual coherence, A super-resolution direction of arrival estimation algorithm for coprime array via sparse Bayesian learning inference, Sparse approximate reconstruction decomposed by two optimization problems, Measurement matrix optimization via mutual coherence minimization for compressively sensed signals reconstruction, Computing the spark: mixed-integer programming for the (vector) matroid girth problem, Necessary and sufficient conditions of solution uniqueness in 1-norm minimization, Ways to sparse representation: An overview, A numerical exploration of compressed sampling recovery, Dictionary learning based on nonnegative matrix factorization using parallel coordinate descent, A sharp RIP condition for orthogonal matching pursuit, Treelets -- an adaptive multi-scale basis for sparse unordered data, On the uniqueness of overcomplete dictionaries, and a practical way to retrieve them, Resolution Analysis of Imaging with $\ell_1$ Optimization, An efficient algorithm for learning dictionary under coherence constraint, An efficient algorithm for overcomplete sparsifying transform learning with signal denoising, Estimation in High Dimensions: A Geometric Perspective, On the Minimization Over Sparse Symmetric Sets: Projections, Optimality Conditions, and Algorithms, Necessary and sufficient conditions for linear convergence of ℓ1-regularization, An effective algorithm for the spark of sparse binary measurement matrices, On the differences between \(L_2\) boosting and the Lasso, Rates of contraction of posterior distributions based on \(p\)-exponential priors, Structured overcomplete sparsifying transform learning with convergence guarantees and applications, Adaptive blind separation of underdetermined mixtures based on sparse component analysis, A modulus-based iterative method for sparse signal recovery, Safe feature elimination for non-negativity constrained convex optimization, A new generalized projection and its application to acceleration of audio declipping, Nonuniqueness of solutions of a class of \(\ell_0\)-minimization problems, Weighted Zak transforms and the dual tiling condition, Divide and conquer: an incremental sparsity promoting compressive sampling approach for polynomial chaos expansions, HIERARCHICAL SPARSE METHOD WITH APPLICATIONS IN VISION AND SPEECH RECOGNITION, Structured iterative hard thresholding with on- and off-grid applications, Truncated sparse approximation property and truncated \(q\)-norm minimization, Combining data envelopment analysis and stochastic frontiers via a LASSO prior, Principles and Typical Computational Limitations of Sparse Speaker Separation Based on Deterministic Speech Features, Novel harmonic regularization approach for variable selection in Cox's proportional hazards model, Orthogonal matched wavelets with vanishing moments: a sparsity design approach, A Joint Sparse Recovery Framework for Accurate Reconstruction of Inclusions in Elastic Media, Asymptotic Equivalence of Regularization Methods in Thresholded Parameter Space, Alternating direction method of multipliers for solving dictionary learning models, Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA), Theory and applications of compressed sensing, Sparse spatio-temporal autoregressions by profiling and bagging, Sparse recovery of sound fields using measurements from moving microphones, Convex graph invariant relaxations for graph edit distance, An efficient semismooth Newton method for adaptive sparse signal recovery problems, Compressed data separation via unconstrained l1-split analysis, A survey on compressive sensing: classical results and recent advancements, A two-stage approach for structural damage detection using a damage localization indicator vector and cluster particle swarm optimization, On sparse approximations of solutions to linear systems with orthogonal matrices, Sparse reconstruction via the mixture optimization model with iterative support estimate, Weighted sparsity regularization for source identification for elliptic PDEs, Research trends in combinatorial optimization, Matrix methods for perfect signal recovery underlying range space of operators, Time-frequency analysis on flat tori and Gabor frames in finite dimensions, Tutorial on Amortized Optimization, Linear inverse problems with Hessian-Schatten total variation, Sampling rates for \(\ell^1\)-synthesis, Fusion frame homotopy and tightening fusion frames by gradient descent, Stable Recovery of Sparsely Corrupted Signals Through Justice Pursuit De-Noising, Sparks of symmetric matrices and their graphs, Unnamed Item, Influences of preconditioning on the mutual coherence and the restricted isometry property of Gaussian/Bernoulli measurement matrices, Convex Optimization and Parsimony of $L_p$-balls Representation, Generalized representer theorems in Banach spaces, A Multi-resolution Theory for Approximating Infinite-p-Zero-n: Transitional Inference, Individualized Predictions, and a World Without Bias-Variance Tradeoff, Model selection with distributed SCAD penalty, Fast sparse reconstruction: Greedy inverse scale space flows, A General Framework of Rotational Sparse Approximation in Uncertainty Quantification, The Kadison–Singer Problem in mathematics and engineering, Book Review: A mathematical introduction to compressive sensing, WEIGHTED AND CONTROLLED FRAMES: MUTUAL RELATIONSHIP AND FIRST NUMERICAL PROPERTIES, Model Selection With Lasso-Zero: Adding Straw to the Haystack to Better Find Needles, Unnamed Item, Discriminative Sparse Representations, Minimization of $L_1$ Over $L_2$ for Sparse Signal Recovery with Convergence Guarantee, The Noise Collector for sparse recovery in high dimensions, Analysis of simultaneous inpainting and geometric separation based on sparse decomposition, Parseval transforms for finite frames, Sparsest representations and approximations of an underdetermined linear system, Analysis of Sparse Representation and Blind Source Separation, Nonlinear Extraction of Independent Components of Natural Images Using Radial Gaussianization, A dual split Bregman method for fast $\ell ^1$ minimization, Computing Sparse Representations of Multidimensional Signals Using Kronecker Bases, $(L_r,L_r,1)$-Decompositions, Sparse Component Analysis, and the Blind Separation of Sums of Exponentials, Multicompartment magnetic resonance fingerprinting, Optimal Injectivity Conditions for Bilinear Inverse Problems with Applications to Identifiability of Deconvolution Problems, Connectivity and Irreducibility of Algebraic Varieties of Finite Unit Norm Tight Frames, TWO NEW LOWER BOUNDS FOR THE SPARK OF A MATRIX, Difference-of-Convex Learning: Directional Stationarity, Optimality, and Sparsity, Splines Are Universal Solutions of Linear Inverse Problems with Generalized TV Regularization, Optimal arrangements of classical and quantum states with limited purity, Computational Aspects of Constrained L 1-L 2 Minimization for Compressive Sensing, Cornerstones of Sampling of Operator Theory, A null-space-based weightedl1minimization approach to compressed sensing, Proximal Mapping for Symmetric Penalty and Sparsity, Finding Planted Subgraphs with Few Eigenvalues using the Schur--Horn Relaxation, Convergence rates and source conditions for Tikhonov regularization with sparsity constraints, Improved Sparse Coding Under the Influence of Perceptual Attention, Kernelized Elastic Net Regularization: Generalization Bounds, and Sparse Recovery, Generalized Mercer Kernels and Reproducing Kernel Banach Spaces, Stability analysis of a class of sparse optimization problems, Extracting Structured Dynamical Systems Using Sparse Optimization With Very Few Samples, Non-Negative Sparse Regression and Column Subset Selection with L1 Error, An Introduction to Compressed Sensing, On Reconstructing Functions from Binary Measurements, Sparse Recovery and Dictionary Learning to Identify the Nonlinear Dynamical Systems: One Step Toward Finding Bifurcation Points in Real Systems, Typicall1-recovery limit of sparse vectors represented by concatenations of random orthogonal matrices, Statistical mechanics of complex neural systems and high dimensional data, Sparsity-promoting and edge-preserving maximum a posteriori estimators in non-parametric Bayesian inverse problems, Inverse scale space decomposition, An unsupervised stereo matching cost based on sparse representation, Microlocal Analysis of the Geometric Separation Problem, Unnamed Item, CHAOTIC ANALOG-TO-INFORMATION CONVERSION: PRINCIPLE AND RECONSTRUCTABILITY WITH PARAMETER IDENTIFIABILITY, An adaptive inverse scale space method for compressed sensing, Search for Sparse Active Inputs: A Review, Compressed modes for variational problems in mathematics and physics, Wavelet Scattering Regression of Quantum Chemical Energies, A Discretized Newton Flow for Time-Varying Linear Inverse Problems, Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model, Unnamed Item, Unnamed Item, Tight and full spark Chebyshev frames with real entries and worst-case coherence analysis, What is a Frame? Theory and Applications of Frames, Unnamed Item, A Multiple Measurement Vector Approach to Synthetic Aperture Radar Imaging, Packings in Real Projective Spaces, Smooth Component Analysis as Ensemble Method for Prediction Improvement, Maximization of Component Disjointness: A Criterion for Blind Source Separation, Spherical Designs and Nonconvex Minimization for Recovery of Sparse Signals on the Sphere, On Collaborative Compressive Sensing Systems: The Framework, Design, and Algorithm, A New Optimization Approach to Sparse Reconstruction of Log-Conductivity in Acousto-Electric Tomography, A Scale-Invariant Approach for Sparse Signal Recovery, New Upper Bounds for Equiangular Lines by Pillar Decomposition, Sparse reconstructions from few noisy data: analysis of hierarchical Bayesian models with generalized gamma hyperpriors, Full spark frames and totally positive matrices, Weak Stability of 1-Minimization Methods in Sparse Data Reconstruction, Selection and Fusion of Categorical Predictors with L0-Type Penalties, Imaging with highly incomplete and corrupted data, Greedy approximate projection for magnetic resonance fingerprinting with partial volumes, Frames for compressed sensing using coherence, Tensor Least Angle Regression for Sparse Representations of Multidimensional Signals, An improved bound of cumulative coherence for signal recovery, Sparse System Identification in Pairs of Pulse and Takenaka--Malmquist Bases, Unnamed Item, Weak-Type Estimates for the Metaplectic Representation Restricted to the Shearing and Dilation Subgroup of $$SL(2,\mathbb {R})$$, Unnamed Item, Remarks on the spark of a matrix and the null space property, Estimation of Sparse Nonnegative Sources from Noisy Overcomplete Mixtures Using MAP, Detection of spatially sparse damage using impulse response sensitivity and LASSO regularization, Dictionary-Based Classification Models. Applications for Multichannel Neural Activity Analysis, A Greedy Approach to $\ell_{0,\infty}$-Based Convolutional Sparse Coding, A Hybrid Finite-Dimensional RHC for Stabilization of Time-Varying Parabolic Equations, Detecting and Repairing Arbitrage in Traded Option Prices, Sparse Solutions by a Quadratically Constrained ℓq (0 <q< 1) Minimization Model, Uniqueness Conditions for A Class of ℓ0-Minimization Problems, Minimization of $\ell_{1-2}$ for Compressed Sensing, Sure Independence Screening for Ultrahigh Dimensional Feature Space, Stability Selection, A New Computational Method for the Sparsest Solutions to Systems of Linear Equations, Unnamed Item, An Algorithm Solving Compressive Sensing Problem Based on Maximal Monotone Operators, Controlled g-fusion frame in Hilbert space, Multi-Layer Sparse Coding: The Holistic Way, Identifiability of Complete Dictionary Learning



Cites Work