Communications-inspired projection design with application to compressive sensing

DOI10.1137/120878380MaRDI QIDQ4902158zbMATH OpenOpenAlexFDO

Authors William R. Carson, Minhua Chen, M. R. D. Rodrigues, Robert Calderbank, Lawrence Carin

Publication date 25 January 2013

Published in SIAM Journal on Imaging Sciences (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1206.1973

zbMATH Keywords

mutual informationcompressed sensingMIMO communicationlow resolution imagingmode alignmentprecoder design

Mathematics Subject Classification ID

Communication theory (94A05) Information theory (general) (94A15) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Computing methodologies for image processing (68U10)

Abstract: We consider the recovery of an underlying signal x in C^m based on projection measurements of the form y=Mx+w, where y in C^l and w is measurement noise; we are interested in the case l < m. It is assumed that the signal model p(x) is known, and w CN(w;0,S_w), for known S_W. The objective is to design a projection matrix M in C^(l x m) to maximize key information-theoretic quantities with operational significance, including the mutual information between the signal and the projections I(x;y) or the Renyi entropy of the projections h_a(y) (Shannon entropy is a special case). By capitalizing on explicit characterizations of the gradients of the information measures with respect to the projections matrix, where we also partially extend the well-known results of Palomar and Verdu from the mutual information to the Renyi entropy domain, we unveil the key operations carried out by the optimal projections designs: mode exposure and mode alignment. Experiments are considered for the case of compressive sensing (CS) applied to imagery. In this context, we provide a demonstration of the performance improvement possible through the application of the novel projection designs in relation to conventional ones, as well as justification for a fast online projections design method with which state-of-the-art adaptive CS signal recovery is achieved.

Recommendations

• Signal Reconstruction From Noisy Random Projections
• Compressed sensing
• Optimized measurement matrix for compressive sensing
• An orthogonal method for measurement matrix optimization
• In situ compressive sensing

Cited in

(6)

• On the average uncertainty for systems with nonlinear coupling
• The quest for optimal sampling: computationally efficient, structure-exploiting measurements for compressed sensing
• Compressive classification: where wireless communications meets machine learning
• On the Absence of Uniform Recovery in Many Real-World Applications of Compressed Sensing and the Restricted Isometry Property and Nullspace Property in Levels
• Bayesian uncertainty quantification for low-rank matrix completion
• Breaking the coherence barrier: a new theory for compressed sensing

This page was built for publication: Communications-inspired projection design with application to compressive sensing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4902158)