Variable selection using MM algorithms
From MaRDI portal
Publication:2583414
Abstract: Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function is often challenging because it may be nondifferentiable and/or nonconcave. This article proposes a new class of algorithms for finding a maximizer of the penalized likelihood for a broad class of penalty functions. These algorithms operate by perturbing the penalty function slightly to render it differentiable, then optimizing this differentiable function using a minorize-maximize (MM) algorithm. MM algorithms are useful extensions of the well-known class of EM algorithms, a fact that allows us to analyze the local and global convergence of the proposed algorithm using some of the techniques employed for EM algorithms. In particular, we prove that when our MM algorithms converge, they must converge to a desirable point; we also discuss conditions under which this convergence may be guaranteed. We exploit the Newton-Raphson-like aspect of these algorithms to propose a sandwich estimator for the standard errors of the estimators. Our method performs well in numerical tests.
Recommendations
- Variable selection in multivariate multiple regression
- MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection
- The variable selection methods and algorithms in the multiple linear model
- The Mnet method for variable selection
- MM Algorithms for Variance Components Models
- Predictive Variable Selection for the Multivariate Linear Model
- Variable selection for multivariate generalized linear models
- MM ALGORITHMS FOR VARIANCE COMPONENT ESTIMATION AND SELECTION IN LOGISTIC LINEAR MIXED MODEL
Cites work
- A Note on the Efficiency of Sandwich Covariance Matrix Estimation
- A Statistical View of Some Chemometrics Regression Tools
- scientific article; zbMATH DE number 46301 (Why is no real title available?)
- scientific article; zbMATH DE number 3513549 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 739537 (Why is no real title available?)
- scientific article; zbMATH DE number 1059776 (Why is no real title available?)
- scientific article; zbMATH DE number 1086057 (Why is no real title available?)
- scientific article; zbMATH DE number 1906319 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- New Estimation and Model Selection Procedures for Semiparametric Modeling in Longitudinal Data Analysis
- Nonconcave penalized likelihood with a diverging number of parameters.
- On the convergence properties of the EM algorithm
- On the rate of convergence of the ECM algorithm
- Partial likelihood
- Regularization of Wavelet Approximations
- Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
- Variable selection for Cox's proportional hazards model and frailty model
- Variable selection for multivariate failure time data
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- SCAD-penalized regression in high-dimensional partially linear models
- Tournament screening cum EBIC for feature selection with high-dimensional feature spaces
- A unified approach to model selection and sparse recovery using regularized least squares
- Nearly unbiased variable selection under minimax concave penalty
- On the estimation of variance parameters in non-standard generalised linear mixed models: application to penalised smoothing
- A Penalized Likelihood Method for Classification With Matrix-Valued Predictors
- Robust truss topology optimization via semidefinite programming with complementarity constraints: a difference-of-convex programming approach
- Data mining for longitudinal data under multicollinearity and time dependence using penalized generalized estimating equations
- Screening active factors in supersaturated designs
- Penalized principal logistic regression for sparse sufficient dimension reduction
- Variable selection and parameter estimation with the Atan regularization method
- Lasso, fractional norm and structured sparse estimation using a Hadamard product parametrization
- The use of random-effect models for high-dimensional variable selection problems
- Maximum likelihood estimation of triangular and polygonal distributions
- Estimation and variable selection for proportional response data with partially linear single-index models
- Structured variable selection via prior-induced hierarchical penalty functions
- A globally convergent algorithm for Lasso-penalized mixture of linear regression models
- Sparse pathway-based prediction models for high-throughput molecular data
- A random-effect model approach for group variable selection
- Support vector machines for unbalanced multicategory classification
- Relaxed sparse eigenvalue conditions for sparse estimation via non-convex regularized regression
- Folded concave penalized sparse linear regression: sparsity, statistical performance, and algorithmic theory for local solutions
- Robust variable selection in high-dimensional varying coefficient models based on weighted composite quantile regression
- Genetic algorithm versus classical methods in sparse index tracking
- Modified SCAD penalty for constrained variable selection problems
- Review: Reversed low-rank ANOVA model for transforming high dimensional genetic data into low dimension
- Variable selection for spatial semivarying coefficient models
- On optimizing the sum of the Rayleigh quotient and the generalized Rayleigh quotient on the unit sphere
- Sparse permutation invariant covariance estimation
- Thresholding-based iterative selection procedures for model selection and shrinkage
- Majorization-minimization algorithms for nonsmoothly penalized objective functions
- Variable selection for varying coefficient models via kernel based regularized rank regression
- Advanced algorithms for penalized quantile and composite quantile regression
- Adaptive LASSO for selecting Fourier coefficients in a functional smooth time-varying cointegrating regression: an application to the Feldstein-Horioka puzzle
- Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix
- The horseshoe-like regularization for feature subset selection
- Model identification and selection for single-index varying-coefficient models
- Sparse classification: a scalable discrete optimization perspective
- Analysis of generalized Bregman surrogate algorithms for nonsmooth nonconvex statistical learning
- High-performance statistical computing in the computing environments of the 2020s
- A split-and-conquer variable selection approach for high-dimensional general semiparametric models with massive data
- High-dimensional variable screening through kernel-based conditional mean dependence
- Penalized generalized estimating equations approach to longitudinal data with multinomial responses
- Removing the singularity of a penalty via thresholding function matching
- Identifying local differences with fused-MCP: an apartment rental market case study on geographical segmentation detection
- Penalized empirical likelihood for partially linear errors-in-variables models
- Variable selection and estimation for longitudinal survey data
- A fast algorithm for detecting gene-gene interactions in genome-wide association studies
- Network exploration via the adaptive LASSO and SCAD penalties
- Bridge regression: adaptivity and group selection
- Majorized proximal alternating imputation for regularized rank constrained matrix completion
- Asymptotic theory of the adaptive sparse group Lasso
- Penalized full likelihood approach to variable selection for Cox's regression model under nested case-control sampling
- A modified generalized Lasso algorithm to detect local spatial clusters for count data
- Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case
- Smoothed rank correlation of the linear transformation regression model
- Penalized estimation equation for an extended single-index model
- Finite mixture of varying coefficient model: estimation and component selection
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models
- Calibrating nonconvex penalized regression in ultra-high dimension
- Robust estimation for partially linear models with large-dimensional covariates
- On optimality of Bayesian testimation in the normal means problem
- Variable selection in semiparametric regression modeling
- Strong oracle optimality of folded concave penalized estimation
- Endogeneity in high dimensions
- Weighted composite quantile regression estimation and variable selection for varying coefficient models with heteroscedasticity
- Walsh-average based variable selection for varying coefficient models
- A focused information criterion for graphical models in fMRI connectivity with high-dimensional data
- A new sparse variable selection via random-effect model
- Simultaneous variable selection and de-coarsening in multi-path change-point models
- Robust structure identification and variable selection in partial linear varying coefficient models
- Variable selection in linear mixed models using an extended class of penalties
- Global solutions to folded concave penalized nonconvex learning
- Shrinkage and pretest estimators for longitudinal data analysis under partially linear models
- Sparsistent and constansistent estimation of the varying-coefficient model with a diverging number of predictors
- Penalized generalized estimating equations for high-dimensional longitudinal data analysis
- Variable selection for survival data with a class of adaptive elastic net techniques
- Asymptotic properties of lasso in high-dimensional partially linear models
- Penalized MM regression estimation with L_ penalty: a robust version of bridge regression
- Fixed and Random Effects Selection in Mixed Effects Models
- An ordinary differential equation-based solution path algorithm
- Pairwise Variable Selection for High-Dimensional Model-Based Clustering
- Variable selection for panel count data via non-concave penalized estimating function
- New estimation and feature selection methods in mixture-of-experts models
- Robust penalized logistic regression with truncated loss functions
- Selection and combination of biomarkers using ROC method for disease classification and prediction
- Latent variable selection in structural equation models
- Statistical Software VASMM for Variable Selection in Multivariate Methods
- Adaptive bridge estimation for high-dimensional regression models
- Simultaneous variable selection and class fusion for high-dimensional linear discriminant analysis
- Coordinate majorization descent algorithm for nonconvex penalized regression
- Fused-MCP With Application to Signal Processing
- MM Algorithms for Variance Components Models
- Variable selection for zero‐inflated and overdispersed data with application to health care demand in Germany
- Rank-based variable selection
- Penalized profiled semiparametric estimating functions
- Variable selection in linear measurement error models via penalized score functions
- Variable selection of the quantile varying coefficient regression models
- Variable selection in robust semiparametric modeling for longitudinal data
This page was built for publication: Variable selection using MM algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2583414)
