Deep Learning Face Attributes in the Wild
文章要解决的问题
Predicting face attributes from web images
方法的主要想法
It cascades two CNNs (LNet and ANet) forface localization and attribute prediction respectively.
贡献(吹牛逼)
(1) It shows how LNet and ANet can be improved by different pre-trainingstrategies.
(2) It reveals that although filters of LNet are fine-tuned by attributelabels, their response maps over the entire image have strong indication offace’s location.
(3)It also demonstrates that the high-level hidden neurons of ANetautomatically discover semantic concepts after pretraining, and such concepts aresignificantly enriched after fine-tuning.
pre-train andfine-tuned
LNet and ANet are first pretrained differently and then jointly trainedwith attribute labels.
LNet is pre-trained by classifying massive general object categories.Thus, its pre-trained features have good generalization capability on handlingvarious background clutters. LNet is then fine-tuned by predicting attributes.
ANet is pre-trained by classifying massive face identities, to obtaindiscriminative face representation. Then it is fine-tuned by the attributeprediction task.
Pre-train的原因和人脸定位的理论:
A filter (or a group of filters) functions as a detector of an attribute. Whena subset of neurons are activated, they indicate the existence of face images,which have a particular attribute configuration. The neurons at differentlayers can form many activation patterns, implying that the whole set of face imagescan be divided into many subsets based on attribute configurations, and eachactivation pattern corresponds to one subset (e.g. ‘pointy nose’, ‘rosy cheek’, and‘smiling’). Therefore, it is not surprising that filters learned by attribute predictionlead to effective representations for face localization. By simply averagingand thresholding response maps, good face localization is achieved.
With this strategy, each face attribute is well explained by a sparselinear combination of these sematic concepts. By analyzing the coefficients ofsuch combinations, attributes show clear grouping patterns, which could be wellinterpreted semantically.
Structure Of Framework
再加上最后的SVM分类器,一共四个过程
1 LNeto定位头部和肩部
2 LNets定位脸(更准确的定位)
3 ANet表达和预测人脸特性
这个只有一个FC,所以只有一个Attribute(这妈蛋的就是接着好玩,坑爹)。训练网络时有用,预测时没用。
4 SVM人脸特征分类
这个分类出来的是Attributes的线性组合(因为有多组FC)
Framework内部说明(此处运用了参数局部共享和全局共享的混合策略)
本人不懂局部共享,以下是文献,请参考之
参数局部分享文章:
开始慢慢一点点往后面看详细介绍
3.1.Coarse-to-fine Face Localization