Estimation of an oblique structure via penalized likelihood factor analysis
From MaRDI portal
Abstract: We consider the problem of sparse estimation via a lasso-type penalized likelihood procedure in a factor analysis model. Typically, the model estimation is done under the assumption that the common factors are orthogonal (uncorrelated). However, the lasso-type penalization method based on the orthogonal model can often estimate a completely different model from that with the true factor structure when the common factors are correlated. In order to overcome this problem, we propose to incorporate a factor correlation into the model, and estimate the factor correlation along with parameters included in the orthogonal model by maximum penalized likelihood procedure. An entire solution path is computed by the EM algorithm with coordinate descent, which permits the application to a wide variety of convex and nonconvex penalties. The proposed method can provide sufficiently sparse solutions, and be applied to the data where the number of variables is larger than the number of observations. Monte Carlo simulations are conducted to investigate the effectiveness of our modeling strategies. The results show that the lasso-type penalization based on the orthogonal model cannot often approximate the true factor structure, whereas our approach performs well in various situations. The usefulness of the proposed procedure is also illustrated through the analysis of real data.
Recommendations
- Sparse estimation via nonconcave penalized likelihood in factor analysis model
- A penalized maximum likelihood approach to sparse factor analysis
- Sparse factor regression via penalized maximum likelihood estimation
- Single- and multiple-group penalized factor analysis: a trust-region algorithm approach with integrated automatic multiple tuning parameter selection
- Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case
Cites work
- A penalized maximum likelihood approach to sparse factor analysis
- A RAPIDLY CONVERGENT METHOD FOR MAXIMUM‐LIKELIHOOD FACTOR ANALYSIS
- Bayesian estimation in unrestricted factor analysis: A treatment for Heywood cases
- Bayesian information criteria and smoothing parameter selection in radial basis function networks
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
- EM algorithms for ML factor analysis
- Factor analysis and AIC
- Factor analysis with EM algorithm never gives improper solutions when sample covariance and initial parameter matrices are proper
- Foundations of factor analysis
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3258737 (Why is no real title available?)
- scientific article; zbMATH DE number 3396952 (Why is no real title available?)
- Least angle regression. (With discussion)
- Nearly unbiased variable selection under minimax concave penalty
- On Measuring and Correcting the Effects of Data Mining and Model Selection
- On the ``degrees of freedom of the lasso
- On various causes of improper solutions in maximum likelihood factor analysis
- Pathwise coordinate optimization
- Screening active factors in supersaturated designs
- Some contributions to maximum likelihood factor analysis
- SparseNet: coordinate descent with nonconvex penalties
- The Adaptive Lasso and Its Oracle Properties
- The varimax criterion for analytic rotation in factor analysis
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(17)- Sparsest factor analysis for clustering variables: a matrix decomposition approach
- Sparse exploratory factor analysis
- A penalized likelihood method for structural equation modeling
- Second-order disjoint factor analysis
- In the pursuit of sparseness: a new rank-preserving penalty for a finite mixture of factor analyzers
- Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case
- Sparse estimation via nonconcave penalized likelihood in factor analysis model
- A penalized maximum likelihood approach to sparse factor analysis
- A penalized likelihood method for multi‐group structural equation modelling
- scientific article; zbMATH DE number 7387188 (Why is no real title available?)
- Simultaneous variable and factor selection via sparse group lasso in factor analysis
- Rotation to sparse loadings using L^p losses and related inference problems
- Sparse and simple structure estimation via prenet penalization
- Mediation analysis with latent factors using simultaneous group-wise and parameter-wise penalization
- Sparse factor regression via penalized maximum likelihood estimation
- Single- and multiple-group penalized factor analysis: a trust-region algorithm approach with integrated automatic multiple tuning parameter selection
- fanc
This page was built for publication: Estimation of an oblique structure via penalized likelihood factor analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1623658)
