Jianzhu Guo, Xiangyu Zhu, Jinchuan Xiao, Zhen Lei, Genxun Wan, Stan Z. Li
Face anti-spoofing is crucial for the security of face recognition systems. Learning based methods especially deep learning based methods need large-scale training samples to reduce overfitting. However, acquiring spoof data is very expensive since the live faces should be re-printed and re-captured in many views. In this paper, we present a method to synthesize virtual spoof data in 3D space to alleviate this problem. Specifically, we consider a printed photo as a flat surface and mesh it into a 3D object, which is then randomly bent and rotated in 3D space. Afterward, the transformed 3D photo is rendered through perspective projection as a virtual sample. The synthetic virtual samples can significantly boost the anti-spoofing performance when combined with a proposed data balancing strategy. Our promising results open up new possibilities for advancing face anti-spoofing using cheap and large-scale synthetic data.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Depth Estimation | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| Depth Estimation | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| Depth Estimation | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| Depth Estimation | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| Facial Recognition and Modelling | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| Facial Recognition and Modelling | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| Facial Recognition and Modelling | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| Facial Recognition and Modelling | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| Visual Odometry | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| Visual Odometry | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| Visual Odometry | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| Visual Odometry | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| Face Reconstruction | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| Face Reconstruction | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| Face Reconstruction | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| Face Reconstruction | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| 3D | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| 3D | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| 3D | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| 3D | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| 3D Face Modelling | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| 3D Face Modelling | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| 3D Face Modelling | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| 3D Face Modelling | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| 3D Face Reconstruction | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| 3D Face Reconstruction | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| 3D Face Reconstruction | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| 3D Face Reconstruction | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |
| Depth And Camera Motion | CASIA-MFSD | EER | 2.22 | 3D Synthesis (balancing sampling) |
| Depth And Camera Motion | CASIA-MFSD | HTER | 1.67 | 3D Synthesis (balancing sampling) |
| Depth And Camera Motion | Replay-Attack | EER | 0.25 | 3D Synthesis (balancing sampling) |
| Depth And Camera Motion | Replay-Attack | HTER | 0.63 | 3D Synthesis (balancing sampling) |