Face Alignment at 3000 FPS via Regressing Local Binary Features
CVPR2014
https://github.com/yulequan/face-alignment-in-3000fps
https://github.com/luoyetx/face-alignment-at-3000fps
https://github.com/freesouls/face-alignment-at-3000fps

本文针对人脸对齐问题,提出基于 LBP 特征 的二级回归方法,先局部后整体的思路。

基于 shape regression 的人脸对齐 predicts facial shape S in a cascaded manner,每次的迭代量如下式所示:
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features
Φ 是特征提取器, W 表示回归函数

人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

3 Regressing Local Binary Features
这里我们对每个特征点训练一个回归器来提取一个 LBP 特征,
3.1. Learning local binary features Φ
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features
这里使用 regression random forest 学习 each local mapping function

人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

3.2. Learning global linear regression W
学习整体的回归函数 W
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

3.3. Locality principle
这里应用了 two important regularization methods in feature learning,as guided by a locality principle:
1) we learn a forest for each landmark independently;
2) we only consider the pixel features in the local region of a landmark
下面是解释为什么做出上面的选择

Why the local region?
Intuitively, the optimal radius r should dependon the distributionof ∆s. If ∆s of all trainingsamples are scattered widely, we should use a large r; otherwise we use a small one
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

As expected, the radius gradually shrinks from early stage to later stage, because the variation of regressed face shapes decreases during the cascade
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

Why a single landmark regression?
先局部后整体具有一些优势,文中指出了三点:
1) 局部 feature pool 噪声要少点
2)独立的局部更有利于 global learning
3) the local learning is adaptive in different stages,Local learning is actually more appropriate in the late stage

4 Experiments
人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

人脸对齐--Face Alignment at 3000 FPS via Regressing Local Binary Features

11

相关文章: