Comprehensive study of variational Bayes classification for dense deep neural networks

DOI10.1007/S11222-023-10338-9MaRDI QIDQ6067625zbMATH OpenOpenAlexFDO

Authors Shrijita Bhattacharya, Zihuan Liu, Tapabrata Maiti

Publication date 17 November 2023

Published in Statistics and Computing (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s11222-023-10338-9

zbMATH Keywords

adaptive learning ratesblack-box variational inferencecontrol variatesHellinger neighborhoodmean-field family

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Bayesian inference (62F15) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Artificial neural networks and deep learning (68T07)

Recommendations

• Statistical foundation of variational Bayes neural networks
• Concentration of tempered posteriors and of their variational approximations
• Convergence rates of variational posterior distributions
• Frequentist consistency of variational Bayes
• On variational Bayes estimation and variational information criteria for linear regression models

Cites work

• 10.1162/jmlr.2003.3.4-5.993
• \(\alpha\)-variational inference with statistical guarantees
• A correlated topic model of science
• A survey of algorithms and analysis for adaptive online learning
• Adaptive subgradient methods for online learning and stochastic optimization
• Bayesian neural networks for selection of drug sensitive genes
• Convergence rates of variational posterior distributions
• Flexible Bayesian nonlinear model configuration
• Frequentist consistency of variational Bayes
• scientific article; zbMATH DE number 51427 (Why is no real title available?)
• Multilayer feedforward networks are universal approximators
• Nonparametric regression using deep neural networks with ReLU activation function
• Probability inequalities for likelihood ratios and convergence rates of sieve MLEs
• Random-projection ensemble classification. (With discussion).
• Scikit-learn: machine learning in Python
• Simulation.
• Statistical foundation of variational Bayes neural networks
• The consistency of posterior distributions in nonparametric problems
• Weak convergence and empirical processes. With applications to statistics

Cited in

(2)

• Statistical foundation of variational Bayes neural networks
• Misclassification bounds for PAC-Bayesian sparse deep learning

This page was built for publication: Comprehensive study of variational Bayes classification for dense deep neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6067625)