Exponential Family cover

Exponential Family

2026-07-20 18:18:00# Statistics

Model P{Pη:η∈Ξ}\mathcal{P}\{P_\eta: \eta\in\Xi\} is an s-parameter exponential family iff its defined by a family of densities of the form:

pη(x)=eη′T(x)−A(η)h(x)p_\eta(x)=e^{\eta'T(x)-A(\eta)}h(x)

all wrt. a common domination measure μ\mu, a measure such that Pη≪μP_\eta\ll\mu for all η∈Ξ\eta\in\Xi.

  • T:χ→RsT: \chi\rightarrow\mathbb{R}^s : sufficient statistic
  • h:χ→[0,∞)h: \chi\rightarrow [0, \infty) : carrier density
  • η:Ξ→Rs\eta: \Xi\rightarrow\mathbb{R}^s : natural parameter
  • T:Ξ→RT: \Xi\rightarrow\mathbb{R} : log-partition function