Correct ordering in the Zipf-Poisson ensemble

Abstract: We consider a Zipf--Poisson ensemble in which

X_{i} s i m p o i (N i^{- a l p h a})

for

a l p h a > 1

and

N > 0

and integers

i g e 1

. As

N o i n f t y

the first

n^{'} (N)

random variables have their proper order

X_{1} > X_{2} > ... > X_{n^{'}}

relative to each other, with probability tending to 1 for

n^{'}

up to

(A N / l o g (N))^{1 / (a l p h a + 2)}

for an explicit constant

A (a l p h a) g e 3 / 4

. The rate

N^{1 / (a l p h a + 2)}

cannot be achieved. The ordering of the first

n^{'} (N)

entities does not preclude

X_{m} > X_{n^{'}}

for some interloping

m > n^{'}

. The first

random variables are correctly ordered exclusive of any interlopers, with probability tending to 1 if

for

B < A

. For a Zipf--Poisson model of the British National Corpus, which has a total word count of

100,000,000

, our result estimates that the 72 words with the highest counts are properly ordered.

Recommendations

Cites Work

Cited In (3)

This page was built for publication: Correct ordering in the Zipf-Poisson ensemble