Shrinkage Algorithms for MMSE Covariance Estimation
From MaRDI portal
Abstract: We address covariance estimation in the sense of minimum mean-squared error (MMSE) for Gaussian samples. Specifically, we consider shrinkage methods which are suitable for high dimensional problems with a small number of samples (large p small n). First, we improve on the Ledoit-Wolf (LW) method by conditioning on a sufficient statistic. By the Rao-Blackwell theorem, this yields a new estimator called RBLW, whose mean-squared error dominates that of LW for Gaussian variables. Second, to further reduce the estimation error, we propose an iterative approach which approximates the clairvoyant shrinkage estimator. Convergence of this iterative method is established and a closed form expression for the limit is determined, which is referred to as the oracle approximating shrinkage (OAS) estimator. Both RBLW and OAS estimators have simple expressions and are easily implemented. Although the two methods are developed from different persepctives, their structure is identical up to specified constants. The RBLW estimator provably dominates the LW method. Numerical simulations demonstrate that the OAS approach can perform even better than RBLW, especially when n is much less than p. We also demonstrate the performance of these techniques in the context of adaptive beamforming.
Recommendations
- Shrinkage of Covariance Matrices for Linear Signal Estimation Using Cross-Validation
- Shrinkage estimation for mean and covariance matrices
- Shrinkage Estimators for Covariance Matrices
- Asymptotically Optimal Linear Shrinkage of Sample LMMSE and MVDR Filters
- Quadratic shrinkage for large covariance matrices
- Sparse estimation: an MMSE approach
- A shrinkage approach to joint estimation of multiple covariance matrices
- Techniques for MIMO Channel Covariance Matrix Quantization
- Multi-Target Shrinkage Estimation for Covariance Matrices
Cited in
(41)- Numerical implementation of the QuEST function
- Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions
- An efficient ensemble Kalman filter implementation via shrinkage covariance matrix estimation: exploiting prior knowledge
- 3D human pose tracking priors using geodesic mixture models
- A Stein's approach to covariance matrix estimation using regularization of Cholesky factor and log-Cholesky metric
- Optimal shrinkage of eigenvalues in the spiked covariance model
- Adaptive evolutionary clustering
- Matrix means and a novel high-dimensional shrinkage phenomenon
- Spatio-temporal convolution kernels
- Linear shrinkage estimation of large covariance matrices using factor models
- An iterative stochastic ensemble method for parameter estimation of subsurface flow models
- Estimating high dimensional covariance matrices: a new look at the Gaussian conjugate framework
- Techniques for MIMO Channel Covariance Matrix Quantization
- High-dimensional linear discriminant analysis classifier for spiked covariance model
- A new procedure for resampled portfolio with shrinkaged covariance matrix
- A new data adaptive elastic net predictive model using hybridized smoothed covariance estimators with information complexity
- Choosing the optimal hybrid covariance estimators in adaptive elastic net regression models using information complexity
- Graphical lassos for meta‐elliptical distributions
- Hybrid projection methods for large-scale inverse problems with mixed Gaussian priors
- Cardinality-constrained distributionally robust portfolio optimization
- Affine invariant integrated rank-weighted statistical depth: properties and finite sample analysis
- Target selection in shrinkage estimation of covariance matrix: a structural similarity approach
- An adaptive covariance parameterization technique for the ensemble Gaussian mixture filter
- Shrinkage estimation of higher-order Bochner integrals
- Sample and realized minimum variance portfolios: estimation, statistical inference, and tests
- On robust estimators of a sphericity measure in high dimension
- Comment: Ridge Regression and Regularization of Large Matrices
- Dynamic estimation of sample covariance matrices via hierarchical clustering
- Introduction to correlation networks: interdisciplinary approaches beyond thresholding
- Preserving nonlinear constraints in variational flow filtering data assimilation
- Synthetic data generation method providing enhanced covariance matrix estimation
- Adaptive unsupervised anomaly detection in variable environment by online expectation maximization
- Improved variance estimation from trimmed samples
- A new family of distribution-free geometric shrinkage variances estimators with applications
- Covariance constraints for stochastic inverse problems of computer models
- Ledoit-Wolf linear shrinkage with unknown mean
- Enhancing mean-variance portfolio optimization through GANs-based anomaly detection
- Distributionally robust sparse portfolio optimization model under satisfaction criterion
- Ensemble variational Fokker-Planck methods for data assimilation
- Enhancing variable selection in elastic-net regression for high-dimensional data sets: The use of modified Bayesian type criteria and hybridized smoothed covariance estimators
- Improved shrinkage estimator of large-dimensional covariance matrix under the complex Gaussian distribution
This page was built for publication: Shrinkage Algorithms for MMSE Covariance Estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4570555)
