Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

DOI10.1137/21M1391444OpenAlexW3118185732MaRDI QIDQ5037563

Cole Hawkins, Xing Liu, Zheng Zhang

Publication date: 1 March 2022

Published in: SIAM Journal on Mathematics of Data Science (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2010.08689

zbMATH Keywords

low-rank tensorcompact neural networkscompressed trainingtensor rank determination

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Uses Software

• PARAFAC
• GitHub
• TensorLy
• BinaryNet
• MUSCO

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Tensor Decompositions and Applications
• PARAFAC: Parallel factor analysis
• Tensor-Train Decomposition
• An introduction to variational methods for graphical models
• Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
• Mean field variational Bayes for elaborate distributions
• Robust Low-Rank Tensor Recovery: Models and Algorithms
• Tensor completion and low-n-rank tensor recovery via convex optimization
• The horseshoe estimator for sparse signals
• Tensor Regression with Applications in Neuroimaging Data Analysis

This page was built for publication: Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination