Exponential Family cover

Exponential Family

2026-07-20 18:18:00# Statistics

Model P{Pη:ηΞ}\mathcal{P}\{P_\eta: \eta\in\Xi\} is an s-parameter exponential family iff its defined by a family of densities of the form:

pη(x)=eηT(x)A(η)h(x)p_\eta(x)=e^{\eta'T(x)-A(\eta)}h(x)

all wrt. a common domination measure μ\mu, a measure such that PημP_\eta\ll\mu for all ηΞ\eta\in\Xi.

  • T:χRsT: \chi\rightarrow\mathbb{R}^s : sufficient statistic
  • h:χ[0,)h: \chi\rightarrow [0, \infty) : carrier density
  • η:ΞRs\eta: \Xi\rightarrow\mathbb{R}^s : natural parameter
  • T:ΞRT: \Xi\rightarrow\mathbb{R} : log-partition function