Technical Program

Paper Detail

Paper Title Asymptotics of Entropy of the Dirichlet-Multinomial Distribution
Paper IdentifierWE1.R7.1
Authors Krzysztof Turowski, Purdue University, United States; Philippe Jacquet, Nokia, France; Wojciech Szpankowski, Purdue University, United States
Session Lossless Compression I
Location Bièvre, Level 5
Session Time Wednesday, 10 July, 09:50 - 11:10
Presentation Time Wednesday, 10 July, 09:50 - 10:10
Manuscript  Click here to download the manuscript
Abstract Dirichlet distribution and multinomial distribution play important role in information theory and statistics. They find applications in estimation, average minimax redundancy in source coding, Polya urn model, and graph compression. Dirichlet-multinomial distribution is a multinomial distribution in which parameters are distributed according to the Dirichlet distribution. In this paper, we present some characteristics of the Dirichlet-multinomial distribution, including a precise asymptotic for the entropy. It should be point out that such a characterization turns out to be technically quite challenging requiring analytic tools including analytic continuation of hypergeometric series.