Large covariance estimation by thresholding principal orthogonal complements. With discussion and authors' reply
From MaRDI portal
(Redirected from Publication:5743151)
Abstract: This paper deals with the estimation of a high-dimensional covariance with a conditional sparsity structure and fast-diverging eigenvalues. By assuming sparse error covariance matrix in an approximate factor model, we allow for the presence of some cross-sectional correlation even after taking out common but unobservable factors. We introduce the Principal Orthogonal complEment Thresholding (POET) method to explore such an approximate factor structure with sparsity. The POET estimator includes the sample covariance matrix, the factor-based covariance matrix (Fan, Fan, and Lv, 2008), the thresholding estimator (Bickel and Levina, 2008) and the adaptive thresholding estimator (Cai and Liu, 2011) as specific examples. We provide mathematical insights when the factor analysis is approximately the same as the principal component analysis for high-dimensional data. The rates of convergence of the sparse residual covariance matrix and the conditional sparse covariance matrix are studied under various norms. It is shown that the impact of estimating the unknown factors vanishes as the dimensionality increases. The uniform rates of convergence for the unobserved factors and their factor loadings are derived. The asymptotic results are also verified by extensive simulation studies. Finally, a real data application on portfolio allocation is presented.
Recommendations
- Large covariance estimation through elliptical factor models
- High dimensional covariance matrix estimation using a factor model
- High-dimensional covariance matrix estimation in approximate factor models
- Nonparametric estimation of large covariance matrices with conditional sparsity
- Asymptotics of empirical eigenstructure for high dimensional spiked covariance
Cites work
- A general framework for multiple testing dependence
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis
- A Singular Value Thresholding Algorithm for Matrix Completion
- A Testing Procedure for Determining the Number of Factors in Approximate Factor Models With Large Datasets
- A two-step estimator for large approximate dynamic factor models based on Kalman filtering
- Adaptive thresholding for sparse covariance matrix estimation
- Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets
- Are more data always better for factor analysis?
- Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
- Correlated z-values and the accuracy of large-scale statistical estimates
- Correlation and Large-Scale Simultaneous Significance Testing
- Covariance regularization by thresholding
- Determining the Number of Factors in Approximate Factor Models
- Determining the Number of Factors in the General Dynamic Factor Model
- Dynamic factors in the presence of blocks
- Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure
- Estimation with quadratic loss.
- Forecasting Using Principal Components From a Large Number of Predictors
- Generalized thresholding of large covariance matrices
- GMM estimation of linear panel data models with time-varying individual effects
- High dimensional covariance matrix estimation using a factor model
- High-dimensional analysis of semidefinite relaxations for sparse principal components
- High-dimensional covariance matrix estimation in approximate factor models
- High-dimensional graphs and variable selection with the Lasso
- High-dimensional sparse factor modeling: applications in gene expression genomics
- High-dimensional volatility matrix estimation via wavelets and thresholding
- scientific article; zbMATH DE number 1911755 (Why is no real title available?)
- scientific article; zbMATH DE number 3396952 (Why is no real title available?)
- Improved penalization for determining the number of factors in approximate factor models
- Inferential Theory for Factor Models of Large Dimensions
- Measure Theory and Probability Theory
- Minimax bounds for sparse PCA with noisy high-dimensional data
- Noisy matrix decomposition via convex relaxation: optimal rates in high dimensions
- Nonparametric modeling of longitudinal covariance structure in functional mapping of quantitative trait loci
- On consistency and sparsity for principal components analysis in high dimensions
- On the distribution of the largest eigenvalue in principal components analysis
- Optimal rates of convergence for sparse covariance matrix estimation
- Optimal solutions for sparse principal component analysis
- PCA consistency in high dimension, low sample size context
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Regularization of Wavelet Approximations
- Robust principal component analysis?
- Sparse principal component analysis and iterative thresholding
- Sparse principal component analysis via regularized low rank matrix approximation
- Sparsistency and rates of convergence in large covariance matrix estimation
- The econometrics of mean‐variance efficiency tests: a survey
- The generalized dynamic factor model consistency and rates
- The Rotation of Eigenvectors by a Perturbation. III
- Vast portfolio selection with gross-exposure constraints
Cited in
(only showing first 100 items - show all)- Autoregressive models for matrix-valued time series
- Sparse Bayesian time-varying covariance estimation in many dimensions
- Factor-Adjusted Regularized Model Selection
- Projected estimation for large-dimensional matrix factor models
- Low-rank diffusion matrix estimation for high-dimensional time-changed Lévy processes
- Adaptive test for mean vectors of high-dimensional time series data with factor structure
- Estimating large correlation matrices for international migration
- High dimensional efficiency with applications to change point tests
- On the systematic and idiosyncratic volatility with large panel high-frequency data
- Transformed contribution ratio test for the number of factors in static approximate factor models
- Recent developments in high dimensional covariance estimation and its related issues, a review
- A generalized likelihood ratio test for normal mean when \(p\) is greater than \(n\)
- Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions
- Estimating large covariance matrix with network topology for high-dimensional biomedical data
- Simultaneous multiple change-point and factor analysis for high-dimensional time series
- A nonparametric eigenvalue-regularized integrated covariance matrix estimator for asset return data
- Generalized dynamic factor models and volatilities: estimation and forecasting
- Using principal component analysis to estimate a high dimensional factor model with high-frequency data
- A constrained \(\ell1\) minimization approach for estimating multiple sparse Gaussian or nonparanormal graphical models
- Pivotal variable detection of the covariance matrix and its application to high-dimensional factor models
- Adaptive thresholding for large volatility matrix estimation based on high-frequency financial data
- Heterogeneity adjustment with applications to graphical model inference
- Optimal shrinkage estimator for high-dimensional mean vector
- Large-dimensional factor modeling based on high-frequency observations
- Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data
- Factor models for matrix-valued high-dimensional time series
- Factor GARCH-Itô models for high-frequency data with application to large volatility matrix prediction
- Structured volatility matrix estimation for non-synchronized high-frequency financial data
- Large volatility matrix estimation with factor-based diffusion model for high-frequency financial data
- Testing against constant factor loading matrix with large panel high-frequency data
- Quasi maximum likelihood analysis of high dimensional constrained factor models
- Estimation of large dimensional factor models with an unknown number of breaks
- Factor-adjusted multiple testing of correlations
- Error covariance matrix estimation using ridge estimator
- Test for high dimensional covariance matrices
- A rank test for the number of factors with high-frequency data
- Semiparametric model for covariance regression analysis
- Asymptotics of empirical eigenstructure for high dimensional spiked covariance
- On factor models with random missing: EM estimation, inference, and cross validation
- Nonparametric estimation of large covariance matrices with conditional sparsity
- Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix
- Robust high-dimensional factor models with applications to statistical machine learning
- Bridging convex and nonconvex optimization in robust PCA: noise, outliers and missing data
- Estimating change-point latent factor models for high-dimensional time series
- Mahalanobis metric based clustering for fixed effects model
- Recent advances in shrinkage-based high-dimensional inference
- A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix
- Positive-definite modification of a covariance matrix by minimizing the matrix \(\ell_{\infty}\) norm with applications to portfolio optimization
- Feature extraction for functional time series: theory and application to NIR spectroscopy data
- Consistently recovering the signal from noisy functional data
- Design-free estimation of integrated covariance matrices for high-frequency data
- Unified discrete-time factor stochastic volatility and continuous-time Itô models for combining inference based on low-frequency and high-frequency
- Preprocessing noisy functional data: a multivariate perspective
- Adaptive estimation in multivariate response regression with hidden variables
- Rank determination in tensor factor model
- Inference in latent factor regression with clusterable features
- Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications
- CDPA: common and distinctive pattern analysis between high-dimensional datasets
- Doubly debiased Lasso: high-dimensional inference under hidden confounding
- Bayesian factor-adjusted sparse regression
- A factor-GARCH model for high dimensional volatilities
- Efficient estimation of heterogeneous coefficients in panel data models with common shocks
- Ridge-type linear shrinkage estimation of the mean matrix of a high-dimensional normal distribution
- Sequential testing for structural stability in approximate factor models
- Estimation of a multiplicative correlation structure in the large dimensional case
- Estimating latent asset-pricing factors
- Consistent estimation of high-dimensional factor models when the factor number is over-estimated
- Limiting laws for divergent spiked eigenvalues and largest nonspiked eigenvalue of sample covariance matrices
- Statistical analysis of sparse approximate factor models
- Forecasting large covariance matrix with high-frequency data using factor approach for the correlation matrix
- Adaptive estimation in structured factor models with applications to overlapping clustering
- Bootstrapping factor models with cross sectional dependence
- Estimation and inference of change points in high-dimensional factor models
- Recursive estimation in large panel data models: theory and practice
- Detecting groups in large vector autoregressions
- A semiparametric latent factor model for large scale temporal data with heteroscedasticity
- A recursive approach for determining matrix inverses as applied to causal time series processes
- NOVELIST estimator of large correlation and covariance matrices and their inverses
- A large covariance matrix estimator under intermediate spikiness regimes
- Compressed covariance estimation with automated dimension learning
- Principal envelope model
- Generalized dynamic factor models and volatilities: consistency, rates, and prediction intervals
- Tangency portfolio weights for singular covariance matrix in small and large dimensions: estimation and test theory
- Rank regularized estimation of approximate factor models
- High-dimensional multivariate realized volatility estimation
- A new semiparametric estimation approach for large dynamic covariance matrices with multiple conditioning variables
- The two-to-infinity norm and singular subspace geometry with applications to high-dimensional statistics
- Inferences in panel data with interactive effects using large covariance matrices
- Regularized estimation in sparse high-dimensional multivariate regression, with application to a DNA methylation study
- Large covariance estimation through elliptical factor models
- On the penalized maximum likelihood estimation of high-dimensional approximate factor model
- Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Design-free estimation of variance matrices
- Estimation of high-dimensional integrated covariance matrix based on noisy high-frequency data with multiple observations
- Large-dimensional dynamic factor models: estimation of impulse-response functions with I(1) cointegrated factors
- Augmented factor models with applications to validating market risk factors and forecasting bond risk premia
- Estimation and inference in semiparametric quantile factor models
- High dimensional minimum variance portfolio estimation under statistical factor models
- Multi-population mortality modeling: when the data is too much and not enough
This page was built for publication: Large covariance estimation by thresholding principal orthogonal complements. With discussion and authors' reply
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5743151)
