Some upper bounds for the rate of convergence of penalized likelihood context tree estimators

DOI10.1214/09-BJPS033zbMATH Open1192.62193arXivmath/0701810MaRDI QIDQ985992FDOQ985992

Authors: Florencia Leonardi 

Publication date: 9 August 2010

Published in: Brazilian Journal of Probability and Statistics (Search for Journal in Brave)

Abstract: We find upper bounds for the probability of underestimation and overestimation errors in penalized likelihood context tree estimation. The bounds are explicit and applies to processes of not necessarily finite memory. We allow for general penalizing terms and we give conditions over the maximal depth of the estimated trees in order to get strongly consistent estimates. This generalizes previous results obtained in the case of estimation of the order of a Markov chain.

Full work available at URL: https://arxiv.org/abs/math/0701810

Recommendations

• Context tree selection: a unifying view
• Exponential inequalities for empirical unbounded context trees
• Context tree estimation for not necessarily finite memory processes, via BIC and MDL
• Exponential inequalities for VLMC empirical trees
• Consistency of the Unlimited BIC Context Tree Estimator

zbMATH Keywords

rate of convergenceBayesian information criterionpenalized maximum likelihood estimationcontext tree

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Inference from stochastic processes (62M99) Non-Markovian processes: estimation (62M09)

Cites Work

• Context tree estimation for not necessarily finite memory processes, via BIC and MDL
• Processes with long memory: Regenerative construction and perfect simulation
• Exponential inequalities for empirical unbounded context trees
• A universal data compression system
• The optimal error exponent for Markov order estimation
• Markov approximation and consistent estimation of unbounded probabilistic suffix trees
• The context-tree weighting method: basic properties
• Exponential inequalities for VLMC empirical trees
• Variable length Markov chains
• Estimation of General Stationary Processes by Variable Length Markov Chains
• The context-tree weighting method: extensions
• Consistency of the Unlimited BIC Context Tree Estimator
• Exponential bounds for the probability of wrong determination of the order of a Markov chain by using the EDC criterion

Cited In (6)

• Exponential inequalities for VLMC empirical trees
• Context tree selection: a unifying view
• Exponential inequalities for empirical unbounded context trees
• Context tree estimation for not necessarily finite memory processes, via BIC and MDL
• Divergence rates of Markov order estimators and their application to statistical estimation of stationary ergodic processes
• Consistency of the Unlimited BIC Context Tree Estimator

This page was built for publication: Some upper bounds for the rate of convergence of penalized likelihood context tree estimators

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q985992)