Language models based on deep learning: a review

DOI10.13328/J.CNKI.JOS.006169MaRDI QIDQ4996240zbMATH OpenFDO

Authors Naiyu Wang, Yuxin Ye, Lu Liu, Lizhou Feng, Tie Bao, Tao Peng

Publication date 1 July 2021

Full work available at URL https://doi.org/10.13328/J.CNKI.JOS.006169

zbMATH Keywords

deep learninglanguage modelnatural language processingneural language modelpre-training

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Natural language processing (68T50)

Recommendations

• Deep learning in NLP: methods and applications
• A survey on deep learning for natural language processing
• A survey of word embeddings based on deep learning
• 10.1162/153244303322533223
• A Primer on Neural Network Models for Natural Language Processing

Cited in

(6)

• Transformer-based deep neural language modeling for construct-specific automatic item generation
• A Primer on Neural Network Models for Natural Language Processing
• Deep learning in NLP: methods and applications
• Modern Language Models and Computation
• A cross-lingual sentence pair interaction feature capture model based on pseudo-corpus and multilingual embedding
• Energy-Based Models with Applications to Speech and Language Processing

This page was built for publication: Language models based on deep learning: a review

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4996240)