Variational Bayes Solution of Linear Neural Networks and Its Generalization Performance

DOI10.1162/NECO.2007.19.4.1112MaRDI QIDQ3440433zbMATH OpenOpenAlexWikidataFDO

Authors Shinichi Nakajima, Sumio Watanabe

Publication date 22 May 2007

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1162/neco.2007.19.4.1112

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Performance evaluation, queueing, and scheduling in the context of computer systems (68M20)

Recommendations

• Statistical foundation of variational Bayes neural networks
• Bayesian methods for neural networks and related models
• scientific article; zbMATH DE number 2119835
• scientific article; zbMATH DE number 7626766
• Variational Bayesian Learning Theory
• Bayesian learning for neural networks
• Variational training of neural network approximations of solution maps for physical models

Cites work

• A new look at the statistical model identification
• Algebraic analysis for nonidentifiable learning machines
• Estimating the dimension of a model
• Learning Coefficients of Layered Models When the True Distribution Mismatches the Singularities
• Likelihood ratio of unidentifiable models and multilayer neural networks
• On the Problem in Model Selection of Neural Network Regression in Overrealizable Scenario
• Online model selection based on the variational Bayes
• Stochastic complexities of reduced rank regression in Bayesian estimation
• Stochastic complexity and modeling
• Tail probabilities of the maxima of multilinear forms and their applications.
• Testing in locally conic models, and application to mixture models
• The strong limits of random matrix spectra for sample matrices of independent elements
• Weights of \(\overline{\chi}^2\) distribution for smooth or piecewise smooth cone alternatives

Cited in

(8)

• Approximate method of variational Bayesian matrix factorization/completion with sparse prior
• An alternative view of variational Bayes and asymptotic approximations of free energy
• scientific article; zbMATH DE number 5575603 (Why is no real title available?)
• Asymptotic analysis of Bayesian generalization error with Newton diagram
• Bayesian Inference Based on Stationary Fokker-Planck Sampling
• Variational inference in neural functional prior using normalizing flows: application to differential equation and operator learning problems
• On variational Bayes estimation and variational information criteria for linear regression models
• Variational approximation error in non-negative matrix factorization

This page was built for publication: Variational Bayes Solution of Linear Neural Networks and Its Generalization Performance

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3440433)