Bayesian methods for neural networks and related models

DOI10.1214/088342304000000099zbMath1057.62078MaRDI QIDQ1766320

Michael D. Titterington

Publication date: 7 March 2005

Published in: Statistical Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/088342304000000099

zbMATH Keywords

Markov chain Monte Carlo; machine learning; Laplace approximation; feedforward neural network; variational approximation; graphical model; Bayesian model choice

Mathematics Subject Classification ID

62F15: Bayesian inference

62M45: Neural nets and related approaches to inference from stochastic processes

Related Items

Modeling Motor Learning Using Heteroscedastic Functional Principal Components Analysis, Multiscale Bayesian state-space model for Granger causality analysis of brain signal, Bayesian regularized artificial neural networks for the estimation of the probability of default, Approximate blocked Gibbs sampling for Bayesian neural networks, Gradient and uncertainty enhanced sequential sampling for global fit, Variational approximations in Bayesian model selection for finite mixture distributions, Computational advances for and from Bayesian analysis, Functional regression via variational Bayes, A variational inference for the Lévy adaptive regression with multiple kernels, Challenges in Markov chain Monte Carlo for Bayesian neural networks, Quantile regression neural networks: a Bayesian approach, Gradient conjugate priors and multi-layer neural networks, A variational Bayesian approach for inverse problems with skew-\(t\) error distributions, SEMIPARAMETRIC REGRESSION AND GRAPHICAL MODELS, Approximate Bayesian Inference for Latent Gaussian models by using Integrated Nested Laplace Approximations, Gaussian Scale Mixture Models for Robust Linear Multivariate Regression with Missing Data, Streamlined mean field variational Bayes for longitudinal and multilevel data analysis, Statistical challenges of high-dimensional data

Uses Software

• ElemStatLearn
• VIBES

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
• Statistical decision theory and Bayesian analysis. 2nd ed
• Developments of the generative topographic mapping
• On a certain Banach space in connection with minimax series
• Factorial hidden Markov models
• A noninformative prior for neural networks
• Model selection for neural network classification
• Neural networks: A review from a statistical perspective. With comments and a rejoinder by the authors
• Improving the mean-field approximation in belief networks using Bahadur's reparameterisation of the multivariate binary distribution
• Parameter estimation for hidden Markov chains
• Bayesian learning for neural networks
• Online Model Selection Based on the Variational Bayes
• Robust Full Bayesian Learning for Radial Basis Networks
• Bayesian inference in neural networks
• Bayesian MLP neural networks for image analysis
• A Tighter Bound for Graphical Models
• The mean field theory in EM procedures for Markov random fields
• A Bayesian Analysis of Self-Organizing Maps
• 10.1162/15324430152748236
• Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Application to Speech Recognition
• Variational Mixture of Bayesian Independent Component Analyzers
• Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis
• On the Adequacy of Variational Lower Bound Functions for Likelihood-based Inference in Markovian Models with Missing Values
• Bayesian Measures of Model Complexity and Fit
• Variational Bayesian Learning of ICA with Missing Data
• Probable networks and plausible predictions — a review of practical Bayesian methods for supervised neural networks
• Bayesian information criteria and smoothing parameter selection in radial basis function networks
• Probabilistic image processing by means of the Bethe approximation for theQ-Ising model
• The elements of statistical learning. Data mining, inference, and prediction