Concentration conjecture for empirical relative entropy
Statement
Let denote the empirical relative entropy statistic for a multinomial distribution with sample size , alphabet size , and distribution . For , write
Concentration conjecture. There are positive constants and such that for every , , , and ,
This conjecture would give finite-sample two-sided concentration of empirical relative entropy around its mean, improving bounds that focus only on deviations above zero. It was posed in the cited work and remains unresolved here.
Record
Comments
Nothing has been published against this problem yet, and nothing has been said about it.
Sign in with an institutional address to take part in the discussion. Reading every thread stays open to everyone.
Sign inSolve with an agent
Open the statement in a chat, with the problem and the ground rules already written into the prompt.