Statistical mechanics analysis of thresholding 1-bit compressed sensing

DOI10.1088/1742-5468/2016/08/083405MaRDI QIDQ3302796zbMATH OpenOpenAlexFDO

Authors Yoshiyuki Kabashima, Yingying Xu

Publication date 11 August 2020

Published in Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1605.01867

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Signal theory (characterization, reconstruction, filtering, etc.) (94A12)

Abstract: The one-bit compressed sensing framework aims to reconstruct a sparse signal by only using the sign information of its linear measurements. To compensate for the loss of scale information, past studies in the area have proposed recovering the signal by imposing an additional constraint on the L2-norm of the signal. Recently, an alternative strategy that captures scale information by introducing a threshold parameter to the quantization process was advanced. In this paper, we analyze the typical behavior of the thresholding 1-bit compressed sensing utilizing the replica method of statistical mechanics, so as to gain an insight for properly setting the threshold value. Our result shows that, fixing the threshold at a constant value yields better performance than varying it randomly when the constant is optimally tuned, statistically. Unfortunately, the optimal threshold value depends on the statistical properties of the target signal, which may not be known in advance. In order to handle this inconvenience, we develop a heuristic that adaptively tunes the threshold parameter based on the frequency of positive (or negative) values in the binary outputs. Numerical experiments show that the heuristic exhibits satisfactory performance while incurring low computational cost.

Recommendations

• Statistical mechanics approach to 1-bit compressed sensing
• Analysis of hard-thresholding for distributed compressed sensing with one-bit measurements
• One-bit compressed sensing with non-Gaussian measurements
• Noisy 1-bit compressive sensing: models and algorithms
• Stability of 1-bit compressed sensing in sparse data reconstruction
• Threshold Effects in Parameter Estimation From Compressed Data
• The Noise-Sensitivity Phase Transition in Compressed Sensing
• Compressive Sensing Using Iterative Hard Thresholding With Low Precision Data Representation: Theory and Applications

Cites work

• Bayesian signal reconstruction for 1-bit compressed sensing
• Beyond Nyquist: Efficient Sampling of Sparse Bandlimited Signals
• Compressed sensing
• Introduction to the replica theory of disordered statistical systems
• Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
• Sparse and redundant representations. From theory to applications in signal and image processing.
• Sparse image and signal processing. Wavelets, curvelets, morphological diversity
• Statistical mechanics approach to 1-bit compressed sensing

Cited in

(4)

• Statistical mechanics approach to 1-bit compressed sensing
• Bayesian signal reconstruction for 1-bit compressed sensing
• Approximate message passing for nonconvex sparse regularization with stability and asymptotic analysis
• Analysis of hard-thresholding for distributed compressed sensing with one-bit measurements

Describes a project that uses

Uses Software

• CVX

This page was built for publication: Statistical mechanics analysis of thresholding 1-bit compressed sensing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3302796)