Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models
From MaRDI portal
Abstract: Spatial multiplexing cameras (SMCs) acquire a (typically static) scene through a series of coded projections using a spatial light modulator (e.g., a digital micro-mirror device) and a few optical sensors. This approach finds use in imaging applications where full-frame sensors are either too expensive (e.g., for short-wave infrared wavelengths) or unavailable. Existing SMC systems reconstruct static scenes using techniques from compressive sensing (CS). For videos, however, existing acquisition and recovery methods deliver poor quality. In this paper, we propose the CS multi-scale video (CS-MUVI) sensing and recovery framework for high-quality video acquisition and recovery using SMCs. Our framework features novel sensing matrices that enable the efficient computation of a low-resolution video preview, while enabling high-resolution video recovery using convex optimization. To further improve the quality of the reconstructed videos, we extract optical-flow estimates from the low-resolution previews and impose them as constraints in the recovery procedure. We demonstrate the efficacy of our CS-MUVI framework for a host of synthetic and real measured SMC video data, and we show that high-quality videos can be recovered at roughly compression.
Recommendations
- Video compressive sensing for spatial multiplexing cameras using motion-flow models
- Video Compressive Sensing Using Gaussian Mixture Models
- Temporal compressive sensing for video
- Structured Sparse Representation With Union of Data-Driven Linear and Multilinear Subspaces Model for Compressive Video Sampling
- Block-based compressed sensing of images and video
- Video distributed compressive sensing research based on correlation model
- Compressed motion sensing
- High-Accuracy Total Variation With Application to Compressed Video Sensing
- Surveillance video processing using compressive sensing
Cites work
- An algorithm for total variation minimization and applications
- An Iterative Regularization Method for Total Variation-Based Image Restoration
- Block-based compressed sensing of images and video
- Compressed sensing
- Compressive acquisition of linear dynamical systems
- Coupled Dictionary Training for Image Super-Resolution
- Determining optical flow
- scientific article; zbMATH DE number 3750829 (Why is no real title available?)
- Modified-CS: Modifying Compressive Sensing for Problems With Partially Known Support
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
- The restricted isometry property and its implications for compressed sensing
- The STOne Transform: Multi-Resolution Image Enhancement and Compressive Video
- Video Compressive Sensing Using Gaussian Mixture Models
Cited in
(10)- On plenoptic multiplexing and reconstruction
- Compressive acquisition of linear dynamical systems
- Block-based compressed sensing of images and video
- Video compressive sensing for spatial multiplexing cameras using motion-flow models
- Temporal compressive sensing for video
- High-Accuracy Total Variation With Application to Compressed Video Sensing
- Structured Sparse Representation With Union of Data-Driven Linear and Multilinear Subspaces Model for Compressive Video Sampling
- Space-time regularization for video decompression
- Compressive time-of-flight 3D imaging using block-structured sensing matrices
- Compression at the source for digital camcorders
This page was built for publication: Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5230426)
