A constructive approach to the estimation of dimension reduction directions

DOI10.1214/009053607000000352zbMATH Open1360.62196arXivmath/0701761OpenAlexW1997384244MaRDI QIDQ129272FDOQ129272

Yingcun Xia, Yingcun Xia

Publication date: 1 December 2007

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: In this paper, we propose two new methods to estimate the dimension-reduction directions of the central subspace (CS) by constructing a regression model such that the directions are all captured in the regression mean. Compared with the inverse regression estimation methods (e.g. Li, 1991, 1992; Cook and Weisberg, 1991), the new methods require no strong assumptions on the design of covariates or the functional relation between regressors and the response variable, and have better performance than the inverse regression estimation methods for finite samples. Compared with the direct regression estimation methods (e.g. H"ardle and Stoker, 1989; Hristache, Juditski, Polzehl and Spokoiny, 2001; Xia, Tong, Li and Zhu, 2002), which can only estimate the directions of CS in the regression mean, the new methods can detect the directions of CS exhaustively. Consistency of the estimators and the convergence of corresponding algorithms are proved.

Full work available at URL: https://arxiv.org/abs/math/0701761

Recommendations

• Sliced Regression for Dimension Reduction
• Direction estimation in single-index regressions
• A semiparametric approach to dimension reduction
• On dimension reduction in regressions with multivariate responses
• On Directional Regression for Dimension Reduction

zbMATH Keywords

conditional density functionconvergence of algorithmdouble-kernel smoothingefficient dimension reductionroot-\(n\) consistency

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Nonparametric statistical resampling methods (62G09) Characterization and structure theory for multivariate probability distributions; copulas (62H05)

Cites Work

• A constructive approach to the estimation of dimension reduction directions
• Optimal smoothing in single-index models
• Title not available (Why is that?)
• Sliced Inverse Regression for Dimension Reduction
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear time series. Nonparametric and parametric methods
• Investigating Smooth Multiple Regression by the Method of Average Derivatives
• Direct Semiparametric Estimation of Single-Index Models with Discrete Covariates
• An Adaptive Estimation of Dimension Reduction Space
• Title not available (Why is that?)
• Contour regression: a general approach to dimension reduction
• Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems
• Title not available (Why is that?)
• Title not available (Why is that?)
• A general class of exponential inequalities for martingales and ratios
• Direct estimation of the index coefficient in a single-index model
• Structure adaptive approach for dimension reduction.
• Dimension reduction for conditional mean in regression
• On semiparametric \(M\)-estimation in single-index regression
• Exploring Regression Structure Using Nonparametric Functional Estimation
• Principal Hessian Directions for regression with measurement error
• ASYMPTOTIC DISTRIBUTIONS FOR TWO ESTIMATORS OF THE SINGLE-INDEX MODEL
• Weak and strong uniform consistency of kernel regression estimates
• On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's Lemma
• Title not available (Why is that?)
• Dimension Reduction for the Conditionalkth Moment in Regression
• Title not available (Why is that?)
• Direction estimation in single-index regressions
• Title not available (Why is that?)
• Totally positive matrices

Cited In (only showing first 100 items - show all)

• Dimension reduction regressions with measurement errors subject to additive distortion
• Tail inverse regression: dimension reduction for prediction of extremes
• Sliced average variance estimation for tensor data
• Estimation and variable selection for single-index models with non ignorable missing data
• A Novel Estimation Method in Generalized Single Index Models
• A post-screening diagnostic study for ultrahigh dimensional data
• Penalized Weighted Variance Estimate for Dimension Reduction
• Conditional Density Estimation with Dimensionality Reduction via Squared-Loss Conditional Entropy Minimization
• Gradient-based kernel variable selection for support vector hazards machine
• On forward sufficient dimension reduction for categorical and ordinal responses
• Testing the Linear Mean and Constant Variance Conditions in Sufficient Dimension Reduction
• Dimension reduction with expectation of conditional difference measure
• Distributed Sufficient Dimension Reduction for Heterogeneous Massive Data
• A new reproducing kernel‐based nonlinear dimension reduction method for survival data
• Specification testing of partially linear single-index models: a groupwise dimension reduction-based adaptive-to-model approach
• Online sparse sliced inverse regression for high-dimensional streaming data
• Advance of the sufficient dimension reduction
• An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space
• Sparse dimension reduction for survival data
• Single index Fréchet regression
• Specification Testing of Regression Models with Mixed Discrete and Continuous Predictors
• A Projective Approach to Conditional Independence Test for Dependent Processes
• Robust Inference for Nonstationary Time Series with Possibly Multiple Changing Periodic Structures
• Sufficient dimension reduction with simultaneous estimation of effective dimensions for time-to-event data
• Aggregate Inverse Mean Estimation for Sufficient Dimension Reduction
• On the single-index model estimate of the conditional density function: consistency and implementation
• Sufficient Dimension Reduction via Direct Estimation of the Gradients of Logarithmic Conditional Densities
• Gradient-based approach to sufficient dimension reduction with functional or longitudinal covariates
• New forest-based approaches for sufficient dimension reduction
• A slicing-free perspective to sufficient dimension reduction: selective review and recent developments
• A METHOD OF LOCAL INFLUENCE ANALYSIS IN SUFFICIENT DIMENSION REDUCTION
• Sufficient dimension reduction on marginal regression for gaps of recurrent events
• High-dimensional variable screening under multicollinearity
• Ultrahigh-dimensional sufficient dimension reduction for censored data with measurement error in covariates
• A note on the semiparametric approach to dimension reduction
• Model checking for regressions: an approach bridging between local smoothing and global smoothing methods
• Semiparametric jump-preserving estimation for single-index models
• Robust dimension reduction using sliced inverse median regression
• A brief review of linear sufficient dimension reduction through optimization
• Title not available (Why is that?)
• Semiparametric marginal and association regression methods for clustered binary data
• Dimension reduction using the generalized gradient direction
• Efficient estimation in heteroscedastic single-index models
• Contour projected dimension reduction
• Estimating central subspaces via inverse third moments
• Functional sufficient dimension reduction through average Fréchet derivatives
• Ensemble sufficient dimension folding methods for analyzing matrix-valued data
• A unified approach to sufficient dimension reduction
• Sparse sufficient dimension reduction with heteroscedasticity
• Estimation for single-index models via martingale difference divergence
• Robust estimation for partial linear single-index models
• Dimension reduction based on conditional multiple index density function
• Local Walsh-average-based estimation and variable selection for single-index models
• Quantile-slicing estimation for dimension reduction in regression
• Estimation in linear regression models with measurement errors subject to single-indexed distortion
• Local Linear Regression on Manifolds and Its Geometric Interpretation
• Robust MAVE through nonconvex penalized regression
• Successive direction extraction for estimating the central subspace in a multiple-index regres\-sion
• A Semiparametric Approach to Model Effect Modification
• A note on structural adaptive dimension reduction
• Functional single index models for longitudinal data
• Dimension reduction and estimation in the secondary analysis of case-control studies
• Heteroscedasticity checks for single index models
• Distributed estimation in heterogeneous reduced rank regression: with application to order determination in sufficient dimension reduction
• A structured covariance ensemble for sufficient dimension reduction
• On post dimension reduction statistical inference
• Enhancing sparsity of Hermite polynomial expansions by iterative rotations
• Rank reducible varying coefficient model
• Projection expectile regression for sufficient dimension reduction
• Quantile based dimension reduction in censored regression
• Sufficient dimension reduction based on an ensemble of minimum average variance estimators
• Minimum average variance estimation with group Lasso for the multivariate response central mean subspace
• An adaptive composite quantile approach to dimension reduction
• On Directional Regression for Dimension Reduction
• Sufficient dimension reduction in regressions through cumulative Hessian directions
• A robust adaptive-to-model enhancement test for parametric single-index models
• Sufficient Dimension Reduction via Squared-Loss Mutual Information Estimation
• Efficient estimation in sufficient dimension reduction
• On IPW-based estimation of conditional average treatment effects
• Quasi-likelihood estimation of the single index conditional variance model
• MAVE
• A constructive approach to the estimation of dimension reduction directions
• Robust Inference of Conditional Average Treatment Effects Using Dimension Reduction
• Estimating the conditional single-index error distribution with a partial linear mean regression
• Central subspaces review: methods and applications
• An ensemble of inverse moment estimators for sufficient dimension reduction
• Model-based reinforcement learning with dimension reduction
• Sliced-Inverse-Regression--Aided Rotated Compressive Sensing Method for Uncertainty Quantification
• Dimension reduction based on weighted variance estimate
• Direct Estimation of the Derivative of Quadratic Mutual Information with Application in Supervised Dimension Reduction
• A Semiparametric Approach to Dimension Reduction
• Fusing sufficient dimension reduction with neural networks
• Surrogate space based dimension reduction for nonignorable nonresponse
• On efficient dimension reduction with respect to a statistical functional of interest
• Covariate Information Matrix for Sufficient Dimension Reduction
• A Simple Two-Sample Test in High Dimensions Based on L²-Norm
• A Review on Sliced Inverse Regression, Sufficient Dimension Reduction, and Applications
• Improvement of some multidimensional estimates by reduction of dimensionality
• Direction estimation in single-index models via distance covariance
• Metric Learning via Cross-Validation

This page was built for publication: A constructive approach to the estimation of dimension reduction directions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q129272)