Constructing n-gram rules for natural language models through exploring the limitation of the Zipf-Mandelbrot law

DOI10.1007/S00607-010-0116-XzbMATH Open1227.68113OpenAlexW2075726856MaRDI QIDQ644850FDOQ644850

Authors: Harry M. Chang 

Publication date: 7 November 2011

Published in: Computing (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00607-010-0116-x

Recommendations

• ZIPF'S LAWS IN TEXT MODELING
• Zipf's law in natural languages, programming languages, and command languages: the Simon-Yule approach
• Analysis of Zipf's law: An index approach
• A statistical test for correspondence of texts to the Zipf-Mandelbrot law
• INTERPRETATION OF THE GENERALIZED ZIPF-MANDELBROT LAW PARAMETERS

zbMATH Keywords

natural language processingquantitative linguistics\(n\)-gram statistical language modelsZipf-Mandelbrot law

Mathematics Subject Classification ID

Natural language processing (68T50)

Cites Work

• ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
• Beyond the Zipf-Mandelbrot law in quantitative linguistics
• The stretched exponential distribution of internet media access patterns
• Title not available (Why is that?)
• A “Law≓ of occurrences for words of low frequency
• POPULATION DIFFERENCES BETWEEN SPECIES GROWING ACCORDING TO SIMPLE BIRTH AND DEATH PROCESSES

Cited In (3)

• ZIPF'S LAWS IN TEXT MODELING
• USING GRAPHEME n-GRAMS IN SPELLING CORRECTION AND AUGMENTATIVE TYPING SYSTEMS
• Use of power law models in detecting region of interest

This page was built for publication: Constructing \(n\)-gram rules for natural language models through exploring the limitation of the Zipf-Mandelbrot law

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q644850)