Kernel Mean Embedding of Distributions: A Review and Beyond
From MaRDI portal
Publication:4593744
Abstract: A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing kernel Hilbert space (RKHS) in which the whole arsenal of kernel methods can be extended to probability measures. It can be viewed as a generalization of the original "feature map" common to support vector machines (SVMs) and other kernel methods. While initially closely associated with the latter, it has meanwhile found application in fields ranging from kernel machines and probabilistic modeling to statistical inference, causal discovery, and deep learning. The goal of this survey is to give a comprehensive review of existing work and recent advances in this research area, and to discuss the most challenging issues and open problems that could lead to new research directions. The survey begins with a brief introduction to the RKHS and positive definite kernels which forms the backbone of this survey, followed by a thorough discussion of the Hilbert space embedding of marginal distributions, theoretical guarantees, and a review of its applications. The embedding of distributions enables us to apply RKHS methods to probability measures which prompts a wide range of applications such as kernel two-sample testing, independent testing, and learning on distributional data. Next, we discuss the Hilbert space embedding for conditional distributions, give theoretical insights, and review some applications. The conditional mean embedding enables us to perform sum, product, and Bayes' rules---which are ubiquitous in graphical model, probabilistic inference, and reinforcement learning---in a non-parametric way. We then discuss relationships between this framework and other related areas. Lastly, we give some suggestions on future research directions.
Recommendations
- Kernel distribution embeddings: universal kernels, characteristic kernels and kernel metrics on distributions
- Minimax estimation of kernel mean embeddings
- Admissible kernels for RKHS embedding of probability distributions
- scientific article; zbMATH DE number 4178397
- scientific article; zbMATH DE number 7626782
- scientific article; zbMATH DE number 751035
- Kernel estimators of density in spaces of an arbitrary nature.
- scientific article; zbMATH DE number 1530929
- On kernel estimation of a multivariate distribution function
Cited in
(71)- scientific article; zbMATH DE number 7415100 (Why is no real title available?)
- High-order sequential simulation via statistical learning in reproducing kernel Hilbert space
- State-based confidence bounds for data-driven stochastic reachability using Hilbert space embeddings
- Nonlinear directed acyclic graph estimation based on the kernel partial correlation coefficient
- Eigendecompositions of transfer operators in reproducing kernel Hilbert spaces
- Hilbert space embeddings and metrics on probability measures
- A rigorous theory of conditional mean embeddings
- Strictly proper kernel scores and characteristic kernels on compact spaces
- Estimation of Copulas via Maximum Mean Discrepancy
- scientific article; zbMATH DE number 7758314 (Why is no real title available?)
- A preconditioning technique for Krylov subspace methods in RKHSs
- Reproducing kernel Hilbert space embedding for adaptive estimation of nonlinearities in piezoelectric systems
- Bayesian optimization with approximate set kernels
- Model-based kernel sum rule: kernel Bayesian inference with probabilistic models
- scientific article; zbMATH DE number 7626782 (Why is no real title available?)
- Distribution regression model with a Reproducing Kernel Hilbert Space approach
- Characteristic and universal tensor product kernels
- A Hilbert Space Embedding for Distributions
- Toward a Kernel-Based Uncertainty Decomposition Framework for Data and Models
- Local permutation tests for conditional independence
- Optimization hierarchy for fair statistical decision problems
- scientific article; zbMATH DE number 7306872 (Why is no real title available?)
- Krylov subspace methods for estimating operator-vector multiplications in Hilbert spaces
- Evaluating Forecasts for High-Impact Events Using Transformed Kernel Scores
- Kernel method for persistence diagrams via kernel embedding and weight factor
- A Generalized Kernel Method for Global Sensitivity Analysis
- Reproducing kernel Hilbert spaces in the mean field limit
- Kernel distribution embeddings: universal kernels, characteristic kernels and kernel metrics on distributions
- Sparse machine learning in Banach spaces
- Topology, convergence, and reconstruction of predictive states
- Near-optimal coresets of kernel density estimates
- Finite sample properties of parametric MMD estimation: robustness to misspecification and dependence
- Gaussian processes with multidimensional distribution inputs via optimal transport and Hilbertian embedding
- Estimation with infinite-dimensional exponential family and Fisher divergence
- Kernel methods for detecting coherent structures in dynamical data
- scientific article; zbMATH DE number 7415079 (Why is no real title available?)
- Model-free inference of diffusion networks using RKHS embeddings
- scientific article; zbMATH DE number 7370518 (Why is no real title available?)
- Linear response based parameter estimation in the presence of model error
- Admissible kernels for RKHS embedding of probability distributions
- Supervised learning of sheared distributions using linearized optimal transport
- scientific article; zbMATH DE number 7370553 (Why is no real title available?)
- Dimensionality reduction of complex metastable systems via kernel embeddings of transition manifolds
- Convergence analysis of deterministic kernel-based quadrature rules in misspecified settings
- Training image free high-order stochastic simulation based on aggregated kernel statistics
- Nonasymptotic one- and two-sample tests in high dimension with unknown covariance structure
- scientific article; zbMATH DE number 7306866 (Why is no real title available?)
- Learning rates for the kernel regularized regression with a differentiable strongly convex loss
- Comparing a large number of multivariate distributions
- Hawkes Processes Modeling, Inference, and Control: An Overview
- Optimal Monte Carlo integration on closed manifolds
- Singular Value Decomposition of Operators on Reproducing Kernel Hilbert Spaces
- Energy-based sequential sampling for low-rank PSD-matrix approximation
- A Gaussian process approach to model checks
- A kernel framework for learning differential equations and their solution operators
- Kernel embedding of measures and low-rank approximation of integral operators
- On nonparametric conditional independence tests for continuous variables
- Unbalanced optimal transport and maximum mean discrepancies: interconnections and rapid evaluation
- Sharp Analysis of Sketch-and-Project Methods via a Connection to Randomized Singular Value Decomposition
- Hypothesis Testing for Matched Pairs with Missing Data by Maximum Mean Discrepancy: An Application to Continuous Glucose Monitoring
- Scalable kernel two-sample tests via empirical likelihood and jackknife
- Error analysis of kernel/GP methods for nonlinear and parametric PDEs
- Spectral regularized Kernel two-sample tests
- Nonconvex SVM for cancer diagnosis based on morphologic features of tumor microenvironment
- Reversible Gromov-Monge sampler for simulation-based inference
- Reinforcement learning in non-Markovian environments
- Closed-form expressions for maximum mean discrepancy with applications to Wasserstein auto-encoders
- Approximating symmetrized estimators of scatter via balanced incomplete \(U\)-statistics
- Kernel-based Sensitivity Analysis for (Excursion) Sets
- Kernel mean embedding vs kernel density estimation: a quantum perspective
- Coefficient-based regularized distribution regression
This page was built for publication: Kernel Mean Embedding of Distributions: A Review and Beyond
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4593744)
