Supervised dimension reduction for ordinal predictors

DOI10.1016/J.CSDA.2018.03.018MaRDI QIDQ1662936zbMATH OpenOpenAlexWikidataFDO

Authors Liliana Forzani, Rodrigo García Arancibia, Pamela Llop, Diego Tomassi

Publication date 20 August 2018

Published in Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1511.05491

zbMATH Keywords

variable selectionsupervised classificationexpectation-maximization (EM)latent variables reduction subspaceSES index construction

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08)

Abstract: In applications involving ordinal predictors, common approaches to reduce dimensionality are either extensions of unsupervised techniques such as principal component analysis, or variable selection procedures that rely on modeling the regression function. In this paper, a supervised dimension reduction method tailored to ordered categorical predictors is introduced. It uses a model-based dimension reduction approach, inspired by extending sufficient dimension reductions to the context of latent Gaussian variables. The reduction is chosen without modeling the response as a function of the predictors and does not impose any distributional assumption on the response or on the response given the predictors. A likelihood-based estimator of the reduction is derived and an iterative expectation-maximization type algorithm is proposed to alleviate the computational load and thus make the method more practical. A regularized estimator, which simultaneously achieves variable selection and dimension reduction, is also presented. Performance of the proposed method is evaluated through simulations and a real data example for socioeconomic index construction, comparing favorably to widespread use techniques.

Recommendations

• scientific article; zbMATH DE number 7376763
• Dimension reduction in binary response regression: a joint modeling approach
• Dimension reduction for object ranking
• Sufficient dimension reduction in regressions with categorical predictors
• Dimension reduction for the conditional mean in regressions with categorical predictors

Cites work

• scientific article; zbMATH DE number 3942782 (Why is no real title available?)
• scientific article; zbMATH DE number 1220060 (Why is no real title available?)
• scientific article; zbMATH DE number 1131222 (Why is no real title available?)
• scientific article; zbMATH DE number 2109186 (Why is no real title available?)
• An Adaptive Estimation of Dimension Reduction Space
• Bayesian analysis for social sciences
• Brownian distance covariance
• Comment
• Contour regression: a general approach to dimension reduction
• Coordinate-independent sparse sufficient dimension reduction and variable selection
• Dimension Reduction in Binary Response Regression
• Dimension reduction for conditional mean in regression
• EM algorithms for multivariate Gaussian mixture models with truncated and censored data
• Estimating the structural dimension of regressions via parametric inverse regression
• Factor analysis parameter estimation from incomplete data
• Fisher lecture: Dimension reduction in regression
• Fourier Methods for Estimating the Central Subspace and the Central Mean Subspace in Regression
• Graphics for Regressions With a Binary Response
• Likelihood-based sufficient dimension reduction
• Linear Statistical Inference and its Applications
• Measuring and testing dependence by correlation of distances
• Modeling ordered choices. A primer
• On Directional Regression for Dimension Reduction
• On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's Lemma
• Principal fitted components for dimension reduction in regression
• Sliced Inverse Regression for Dimension Reduction
• Sparse modeling of categorial explanatory variables
• Successive direction extraction for estimating the central subspace in a multiple-index regres\-sion
• Sufficient Dimension Reduction via Inverse Regression
• Sufficient dimension reduction and prediction in regression
• Sufficient dimension reduction in regressions with categorical predictors
• Theory & Methods: Special Invited Paper: Dimension Reduction and Visualization in Discriminant Analysis (with discussion)

Cited in

(7)

• The Lasso on latent indices for regression modeling with ordinal categorical predictors
• Dimension reduction in binary response regression: a joint modeling approach
• Dimension reduction for object ranking
• Semisupervised Ordinal Regression Based on Empirical Risk Minimization
• On forward sufficient dimension reduction for categorical and ordinal responses
• scientific article; zbMATH DE number 7376763 (Why is no real title available?)
• Supervised dimension reduction of intrinsically low-dimensional data

This page was built for publication: Supervised dimension reduction for ordinal predictors

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1662936)