Recent advances in algebraic geometry and Bayesian statistics
From MaRDI portal
Abstract: This article is a review of theoretical advances in the research field of algebraic geometry and Bayesian statistics in the last two decades. Many statistical models and learning machines which contain hierarchical structures or latent variables are called nonidentifiable, because the map from a parameter to a statistical model is not one-to-one. In nonidentifiable models, both the likelihood function and the posterior distribution have singularities in general, hence it was difficult to analyze their statistical properties. However, from the end of the 20th century, new theory and methodology based on algebraic geometry have been established which enables us to investigate such models and machines in the real world. In this article, the following results in recent advances are reported. First, we explain the framework of Bayesian statistics and introduce a new perspective from the birational geometry. Second, two mathematical solutions are derived based on algebraic geometry. An appropriate parameter space can be found by a resolution map, which makes the posterior distribution be normal crossing and the log likelihood ratio function be well-defined. Third, three applications to statistics are introduced. The posterior distribution is represented by the renormalized form, the asymptotic free energy is derived, and the universal formula among the generalization loss, the cross validation, and the information criterion is established. Two mathematical solutions and three applications to statistics based on algebraic geometry reported in this article are now being used in many practical fields in data science and artificial intelligence.
Cites work
- A new look at the statistical model identification
- A widely applicable Bayesian information criterion
- Algebraic analysis for nonidentifiable learning machines
- Algebraic Geometry and Statistical Learning Theory
- An asymptotic behaviour of the marginal likelihood for general Markov models
- Asymptotic accuracy of Bayes estimation for latent variables with redundancy
- Asymptotic analysis of Bayesian generalization error with Newton diagram
- Asymptotic behavior of exchange ratio in exchange Monte Carlo method
- Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory
- B-functions and holonomic systems. Rationality of roots of B-functions
- Bayesian Measures of Model Complexity and Fit
- Bayesian Model Assessment and Comparison Using Cross-Validation Predictive Densities
- Case-deletion importance sampling estimators: central limit theorems and related results
- Comparing two Bayes methods based on the free energy functions in Bernoulli mixtures
- Estimating the dimension of a model
- Higher order equivalence of Bayes cross validation and WAIC
- scientific article; zbMATH DE number 3721864 (Why is no real title available?)
- scientific article; zbMATH DE number 1453027 (Why is no real title available?)
- scientific article; zbMATH DE number 6791314 (Why is no real title available?)
- Information criteria and cross validation for Bayesian inference in regular and singular cases
- Learning coefficient of generalization error in Bayesian estimation and Vandermonde matrix-type singularity
- Learning Coefficients of Layered Models When the True Distribution Mismatches the Singularities
- Mathematical theory of Bayesian statistics
- On the Variability of Case-Deletion Importance Sampling Weights in the Bayesian Linear Model
- Philosophy and the practice of Bayesian statistics
- Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
- Resolution of Singularities and Division of Distributions
- Resolution of singularities of an algebraic variety over a field of characteristic zero. I
- Science and Statistics
- Singularities in mixture models and upper bounds of stochastic complexity.
- Singularities of Pairs
- Stochastic complexities of Gaussian mixtures in variational Bayesian approximation
- Stochastic complexities of reduced rank regression in Bayesian estimation
- Stochastic complexity and generalization error of a restricted Boltzmann machine in Bayesian estimation
- The exact asymptotic form of Bayesian generalization error in latent Dirichlet allocation
- Understanding predictive information criteria for Bayesian models
- Variational Bayesian Learning Theory
Cited in
(2)
This page was built for publication: Recent advances in algebraic geometry and Bayesian statistics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6138795)
