A Statistical Learning Approach to Modal Regression

zbMath1497.68418arXiv1702.05960MaRDI QIDQ4969033

Jun Fan, Yun-Long Feng, Johan A. K. Suykens

Publication date: 5 October 2020

Full work available at URL: https://arxiv.org/abs/1702.05960

zbMATH Keywords

kernel density estimationstatistical learning theoryempirical risk minimizationgeneralization boundsnonparametric modal regression

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) General nonlinear regression (62J02) Learning and adaptive systems in artificial intelligence (68T05)

Related Items

Learning theory of minimum error entropy under weak moment conditions ⋮ On empirical estimation of mode based on weakly dependent samples ⋮ Error analysis on regularized regression based on the maximum correntropy criterion ⋮ Modal additive models with data-driven structure identification ⋮ Half-quadratic alternating direction method of multipliers for robust orthogonal tensor approximation ⋮ Robust estimation for nonrandomly distributed data ⋮ Distributed penalized modal regression for massive data ⋮ Statistical Inference with Local Optima ⋮ Robust partially linear trend filtering for regression estimation and structure discovery ⋮ Kernel-based maximum correntropy criterion with gradient descent method ⋮ Bootstrap Inference for Quantile-based Modal Regression ⋮ Semiparametric partially linear varying coefficient modal regression ⋮ Online minimum error entropy algorithm with unbounded sampling ⋮ Some asymptotic properties of kernel regression estimators of the mode for stationary and ergodic continuous time processes ⋮ Robust kernel-based distribution regression ⋮ Regularized modal regression with data-dependent hypothesis spaces ⋮ Learning with correntropy-induced losses for regression with mixture of symmetric stable noise ⋮ Modal linear regression models with additive distortion measurement errors ⋮ Learning under \((1 + \epsilon)\)-moment conditions ⋮ Quantile regression approach to conditional mode estimation ⋮ New Insights Into Learning With Correntropy-Based Regression ⋮ A Framework of Learning Through Empirical Gain Maximization ⋮ Optimal learning with Gaussians and correntropy loss ⋮ Comparison theorems on large-margin learning ⋮ Nonparametric statistical learning based on modal regression

Cites Work

• Unnamed Item
• Unnamed Item
• Nonparametric modal regression in the presence of measurement error
• Semiparametric mixtures of nonparametric regressions
• Nonparametric modal regression
• Consistency analysis of an empirical minimum error entropy algorithm
• Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
• Regression towards the mode
• Mode regression
• Learning under \((1 + \epsilon)\)-moment conditions
• Multi-kernel regularized classifiers
• Optimum kernel estimators
• Maximum likelihood estimation of isotonic modal regression
• Functional time series prediction via conditional mode estimation
• Quadratic mode regression
• A note on prediction via estimation of the conditional mode function
• Rates of consistency for nonparametric estimation of the mode in absence of smoothness assumptions
• Statistical behavior and consistency of classification methods based on convex risk minimization.
• Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
• Robust variable selection for nonlinear models with diverging number of parameters
• Estimation of the mode
• Local Rademacher complexities
• A New Regression Model: Modal Linear Regression
• Non linear parametric mode regression
• Local modal regression
• Non-parametric estimation of the conditional mode
• Learning Theory
• Support Vector Machines
• On Semiparametric Mode Regression Estimation
• The estimation of the gradient of a density function, with applications in pattern recognition
• An Iterative Procedure for Estimating the Mode
• Nonparametric forecasting: a comparison of three kernel-based methods
• Semiparametric econometric estimators for a truncated regression model: a review with an extension
• A Note on Ergodic Processes Prediction via Estimation of the Conditional Mode Function
• A nonparametric conditional mode estimate
• Robust Inference for Generalized Linear Models
• Correntropy: Properties and Applications in Non-Gaussian Signal Processing
• Generalized Correntropy for Robust<?Pub _newline ?>Adaptive Filtering
• Neural Network Learning
• Information Theoretic Learning
• Robust Variable Selection With Exponential Squared Loss
• Robust Principal Component Analysis Based on Maximum Correntropy Criterion
• The mode functional is not elicitable
• On Estimation of a Probability Density Function and Mode
• Convexity, Classification, and Risk Bounds
• Modelling Beyond Regression Functions: An Application of Multimodal Regression to Speed–Flow Data
• Optimal learning with Gaussians and correntropy loss