Gwangbin Bae, Martin de La Gorce, Tadas Baltrusaitis, Charlie Hewitt, Dong Chen, Julien Valentin, Roberto Cipolla, Jingjing Shen
State-of-the-art face recognition models show impressive accuracy, achieving over 99.8% on Labeled Faces in the Wild (LFW) dataset. Such models are trained on large-scale datasets that contain millions of real human face images collected from the internet. Web-crawled face images are severely biased (in terms of race, lighting, make-up, etc) and often contain label noise. More importantly, the face images are collected without explicit consent, raising ethical concerns. To avoid such problems, we introduce a large-scale synthetic dataset for face recognition, obtained by rendering digital faces using a computer graphics pipeline. We first demonstrate that aggressive data augmentation can significantly reduce the synthetic-to-real domain gap. Having full control over the rendering pipeline, we also study how each attribute (e.g., variation in facial pose, accessories and textures) affects the accuracy. Compared to SynFace, a recent method trained on GAN-generated synthetic faces, we reduce the error rate on LFW by 52.5% (accuracy from 91.93% to 96.17%). By fine-tuning the network on a smaller number of real face images that could reasonably be obtained with consent, we achieve accuracy that is comparable to the methods trained on millions of real face images.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Facial Recognition and Modelling | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| Facial Recognition and Modelling | LFW | Accuracy | 0.9617 | DigiFace-1M |
| Facial Recognition and Modelling | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| Facial Recognition and Modelling | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| Facial Recognition and Modelling | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |
| Face Reconstruction | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| Face Reconstruction | LFW | Accuracy | 0.9617 | DigiFace-1M |
| Face Reconstruction | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| Face Reconstruction | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| Face Reconstruction | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |
| Face Recognition | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| Face Recognition | LFW | Accuracy | 0.9617 | DigiFace-1M |
| Face Recognition | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| Face Recognition | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| Face Recognition | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |
| 3D | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| 3D | LFW | Accuracy | 0.9617 | DigiFace-1M |
| 3D | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| 3D | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| 3D | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |
| 3D Face Modelling | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| 3D Face Modelling | LFW | Accuracy | 0.9617 | DigiFace-1M |
| 3D Face Modelling | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| 3D Face Modelling | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| 3D Face Modelling | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |
| 3D Face Reconstruction | CPLFW | Accuracy | 0.8223 | DigiFace-1M |
| 3D Face Reconstruction | LFW | Accuracy | 0.9617 | DigiFace-1M |
| 3D Face Reconstruction | CALFW | Accuracy | 0.8255 | DigiFace-1M |
| 3D Face Reconstruction | AgeDB-30 | Accuracy | 0.811 | DigiFace-1M |
| 3D Face Reconstruction | CFP-FP | Accuracy | 0.8981 | DigiFace-1M |