一、联合高斯分布中的推断

把数据拆成两半(x1,x2)~N(μ,Σ)且

Machine Learning --- Gaussian Inference

则边缘分布、条件分布还是高斯分布:

Machine Learning --- Gaussian Inference

[应用]:数据填补:

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

 

二、线性高斯系统

Machine Learning --- Gaussian InferenceMachine Learning --- Gaussian Inference

令z=(x,y),则:

Machine Learning --- Gaussian Inference

[应用1]:从未知x的有噪声测量y中估计x的值

Machine Learning --- Gaussian Inference

假设测量的精度固定为:Machine Learning --- Gaussian Inference,似然为:Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

用后验方差表示则:

Machine Learning --- Gaussian Inference

[应用2]:数据融合(每个测量精度都不一样,如用不同的仪器采集)

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

 

三、多元高斯参数的贝叶斯估计

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

(1) μ的后验估计(高斯似然+共轭高斯先验)

数据似然:

Machine Learning --- Gaussian Inference

共轭先验:

Machine Learning --- Gaussian Inference

后验:

Machine Learning --- Gaussian Inference

标量后验:

Machine Learning --- Gaussian Inference

(2) Σd的后验估计(IW似然+共轭IW先验/IG似然+共轭IG先验)

Machine Learning --- Gaussian Inference

当D=1时退化为反Gamma分布(卡方分布):

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

似然函数:

Machine Learning --- Gaussian Inference

共轭先验:

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

后验:

Machine Learning --- Gaussian Inference

Machine Learning --- Gaussian Inference

标量IG似然:

Machine Learning --- Gaussian Inference

标量共轭IG先验:

Machine Learning --- Gaussian Inference

标量后验(IG左,卡方X右):

Machine Learning --- Gaussian Inference   Machine Learning --- Gaussian Inference

参数λ控制MAP向先验收缩的程度,通过交叉验证或OLS选择。

(3) μ和Σ的后验分布(NIW似然+NIW先验)

NIW似然:

Machine Learning --- Gaussian Inference

NIW先验:

Machine Learning --- Gaussian Inference

NIW后验:

Machine Learning --- Gaussian Inference

其中:

Machine Learning --- Gaussian Inference

相关文章: