Density-sensitive semisupervised inference

DOI10.1214/13-AOS1092zbMATH Open1267.62057arXiv1204.1685MaRDI QIDQ355103FDOQ355103

Aarti Singh, Martin Azizyan, Larry Wasserman

Publication date: 24 July 2013

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: Semisupervised methods are techniques for using labeled data $(X_1,Y_1),ldots,(X_n,Y_n)$ together with unlabeled data $X_{n+1},ldots,X_N$ to make predictions. These methods invoke some assumptions that link the marginal distribution $P_X$ of X to the regression function f(x). For example, it is common to assume that f is very smooth over high density regions of $P_X$. Many of the methods are ad-hoc and have been shown to work in specific examples but are lacking a theoretical foundation. We provide a minimax framework for analyzing semisupervised methods. In particular, we study methods based on metrics that are sensitive to the distribution $P_X$. Our model includes a parameter $alpha$ that controls the strength of the semisupervised assumption. We then use the data to adapt to $alpha$.

Full work available at URL: https://arxiv.org/abs/1204.1685

Recommendations

• Semi-supervised learning based on high density region estimation
• On semi-supervised learning
• Semi-supervised learning with density-ratio estimation
• A unified view of density-based methods for semi-supervised clustering and classification
• Generalization error bounds in semi-supervised classification under the cluster assumption

zbMATH Keywords

efficiencykernel densitynonparametric inferencesemisupervised

Mathematics Subject Classification ID

Density estimation (62G07) Nonparametric regression and quantile regression (62G08) Nonparametric tolerance and confidence regions (62G15)

Cites Work

• The use of unlabeled data in predictive modeling
• A distribution-free theory of nonparametric regression
• Signal Reconstruction From Noisy Random Projections
• Semi-supervised learning on Riemannian manifolds
• Title not available (Why is that?)
• Title not available (Why is that?)
• Density-sensitive semisupervised inference
• The relative value of labeled and unlabeled samples in pattern recognition with an unknown mixing parameter
• On the Tchebychef Inequality of Bernstein
• Spectral Connectivity Analysis
• On Propagated Scoring for Semisupervised Additive Models

Cited In (7)

• On semi-supervised learning
• On regression and classification with possibly missing response variables in the data
• Balancing Geometry and Density: Path Distances on High-Dimensional Data
• Conditional probability estimation based classification with class label missing at random
• Density-sensitive semisupervised inference
• Semi-supervised learning based on high density region estimation
• Metric-based methods for adaptive model selection and regularization

Uses Software

• spa

This page was built for publication: Density-sensitive semisupervised inference

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q355103)