Communications-inspired projection design with application to compressive sensing

DOI10.1137/120878380zbMATH Open1260.94010arXiv1206.1973OpenAlexW3100302110MaRDI QIDQ4902158FDOQ4902158

Authors: William R. Carson, Minhua Chen, M. R. D. Rodrigues, Robert Calderbank, Lawrence Carin 

Publication date: 25 January 2013

Published in: SIAM Journal on Imaging Sciences (Search for Journal in Brave)

Abstract: We consider the recovery of an underlying signal x in C^m based on projection measurements of the form y=Mx+w, where y in C^l and w is measurement noise; we are interested in the case l < m. It is assumed that the signal model p(x) is known, and w CN(w;0,S_w), for known S_W. The objective is to design a projection matrix M in C^(l x m) to maximize key information-theoretic quantities with operational significance, including the mutual information between the signal and the projections I(x;y) or the Renyi entropy of the projections h_a(y) (Shannon entropy is a special case). By capitalizing on explicit characterizations of the gradients of the information measures with respect to the projections matrix, where we also partially extend the well-known results of Palomar and Verdu from the mutual information to the Renyi entropy domain, we unveil the key operations carried out by the optimal projections designs: mode exposure and mode alignment. Experiments are considered for the case of compressive sensing (CS) applied to imagery. In this context, we provide a demonstration of the performance improvement possible through the application of the novel projection designs in relation to conventional ones, as well as justification for a fast online projections design method with which state-of-the-art adaptive CS signal recovery is achieved.

Full work available at URL: https://arxiv.org/abs/1206.1973

Recommendations

• Signal Reconstruction From Noisy Random Projections
• Compressed sensing
• Optimized measurement matrix for compressive sensing
• An orthogonal method for measurement matrix optimization
• In situ compressive sensing

zbMATH Keywords

mutual informationcompressed sensingMIMO communicationlow resolution imagingmode alignmentprecoder design

Mathematics Subject Classification ID

Communication theory (94A05) Information theory (general) (94A15) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Computing methodologies for image processing (68U10)

Cited In (6)

• The quest for optimal sampling: computationally efficient, structure-exploiting measurements for compressed sensing
• On the average uncertainty for systems with nonlinear coupling
• Compressive classification: where wireless communications meets machine learning
• On the Absence of Uniform Recovery in Many Real-World Applications of Compressed Sensing and the Restricted Isometry Property and Nullspace Property in Levels
• Bayesian uncertainty quantification for low-rank matrix completion
• Breaking the coherence barrier: a new theory for compressed sensing

This page was built for publication: Communications-inspired projection design with application to compressive sensing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4902158)