Decreasing the size of the restricted Boltzmann machine

DOI10.1162/NECO_A_01176MaRDI QIDQ5154145zbMATH OpenOpenAlexWikidataFDO

Authors Yohei Saito, Takuya Kato

Publication date 1 October 2021

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1807.02999

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Abstract: We propose a method to decrease the number of hidden units of the restricted Boltzmann machine while avoiding decrease of the performance measured by the Kullback-Leibler divergence. Then, we demonstrate our algorithm by using numerical simulations.

Recommendations

• An infinite restricted Boltzmann machine
• Restricted Boltzmann machines
• Restricted Boltzmann machines: introduction and review
• Training restricted Boltzmann machines: an introduction
• Discrete restricted Boltzmann machines

Cites work

• scientific article; zbMATH DE number 2061729 (Why is no real title available?)
• A Fast Learning Algorithm for Deep Belief Nets
• An efficient learning procedure for deep Boltzmann machines
• Learning compositional representations of interacting systems with restricted Boltzmann machines: comparative study of lattice proteins
• Reducing the Dimensionality of Data with Neural Networks
• Representational Power of Restricted Boltzmann Machines and Deep Belief Networks
• Solving the quantum many-body problem with artificial neural networks
• Training Products of Experts by Minimizing Contrastive Divergence

Describes a project that uses

Uses Software

• WaveNet
• Tensor2Tensor
• MNIST
• darch

This page was built for publication: Decreasing the size of the restricted Boltzmann machine

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5154145)