A very strong relationship between the directed Kullback divergence and the likelihood function emerges simply and naturally in the context of exponential families. The directed Kullback divergence is an information-theoretic measure of the distance from one distribution to another.
ASJC Scopus subject areas
- Statistics and Probability
- Statistics, Probability and Uncertainty