Ivan Perov, Daiheng Gao, Nikolay Chervoniy, Kunlin Liu, Sugasa Marangonda, Chris Umé, Mr. Dpfks, Carl Shift Facenheim, Luis RP, Jian Jiang, Sheng Zhang, Pingyu Wu, Bo Zhou, Weiming Zhang
Deepfake defense not only requires the research of detection but also requires the efforts of generation methods. However, current deepfake methods suffer the effects of obscure workflow and poor performance. To solve this problem, we present DeepFaceLab, the current dominant deepfake framework for face-swapping. It provides the necessary tools as well as an easy-to-use way to conduct high-quality face-swapping. It also offers a flexible and loose coupling structure for people who need to strengthen their pipeline with other features without writing complicated boilerplate code. We detail the principles that drive the implementation of DeepFaceLab and introduce its pipeline, through which every aspect of the pipeline can be modified painlessly by users to achieve their customization purpose. It is noteworthy that DeepFaceLab could achieve cinema-quality results with high fidelity. We demonstrate the advantage of our system by comparing our approach with other face-swapping methods.For more information, please visit:https://github.com/iperov/DeepFaceLab/.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Facial Recognition and Modelling | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| Facial Recognition and Modelling | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| Facial Recognition and Modelling | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| Facial Recognition and Modelling | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| Facial Recognition and Modelling | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| Facial Recognition and Modelling | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| Facial Recognition and Modelling | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| Facial Recognition and Modelling | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| Facial Recognition and Modelling | FaceForensics++ | pose | 4.75 | DeepFakes |
| Facial Recognition and Modelling | FaceForensics++ | verification | 0.69 | DeepFakes |
| Facial Recognition and Modelling | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| Facial Recognition and Modelling | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| Facial Recognition and Modelling | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| Facial Recognition and Modelling | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| Facial Recognition and Modelling | FaceForensics++ | verification | 0.66 | Nirkin et al. |
| Face Reconstruction | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| Face Reconstruction | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| Face Reconstruction | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| Face Reconstruction | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| Face Reconstruction | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| Face Reconstruction | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| Face Reconstruction | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| Face Reconstruction | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| Face Reconstruction | FaceForensics++ | pose | 4.75 | DeepFakes |
| Face Reconstruction | FaceForensics++ | verification | 0.69 | DeepFakes |
| Face Reconstruction | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| Face Reconstruction | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| Face Reconstruction | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| Face Reconstruction | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| Face Reconstruction | FaceForensics++ | verification | 0.66 | Nirkin et al. |
| 3D | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| 3D | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| 3D | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| 3D | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| 3D | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| 3D | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| 3D | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| 3D | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| 3D | FaceForensics++ | pose | 4.75 | DeepFakes |
| 3D | FaceForensics++ | verification | 0.69 | DeepFakes |
| 3D | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| 3D | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| 3D | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| 3D | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| 3D | FaceForensics++ | verification | 0.66 | Nirkin et al. |
| 3D Face Modelling | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| 3D Face Modelling | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| 3D Face Modelling | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| 3D Face Modelling | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| 3D Face Modelling | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| 3D Face Modelling | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| 3D Face Modelling | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| 3D Face Modelling | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| 3D Face Modelling | FaceForensics++ | pose | 4.75 | DeepFakes |
| 3D Face Modelling | FaceForensics++ | verification | 0.69 | DeepFakes |
| 3D Face Modelling | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| 3D Face Modelling | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| 3D Face Modelling | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| 3D Face Modelling | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| 3D Face Modelling | FaceForensics++ | verification | 0.66 | Nirkin et al. |
| 3D Face Reconstruction | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| 3D Face Reconstruction | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| 3D Face Reconstruction | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| 3D Face Reconstruction | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| 3D Face Reconstruction | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| 3D Face Reconstruction | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| 3D Face Reconstruction | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| 3D Face Reconstruction | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| 3D Face Reconstruction | FaceForensics++ | pose | 4.75 | DeepFakes |
| 3D Face Reconstruction | FaceForensics++ | verification | 0.69 | DeepFakes |
| 3D Face Reconstruction | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| 3D Face Reconstruction | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| 3D Face Reconstruction | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| 3D Face Reconstruction | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| 3D Face Reconstruction | FaceForensics++ | verification | 0.66 | Nirkin et al. |
| 10-shot image generation | FaceForensics++ | SSIM | 0.73 | DeepFaceLab |
| 10-shot image generation | FaceForensics++ | landmarks | 0.73 | DeepFaceLab |
| 10-shot image generation | FaceForensics++ | perceptual loss | 0.39 | DeepFaceLab |
| 10-shot image generation | FaceForensics++ | pose | 1.12 | DeepFaceLab |
| 10-shot image generation | FaceForensics++ | verification | 0.61 | DeepFaceLab |
| 10-shot image generation | FaceForensics++ | SSIM | 0.71 | DeepFakes |
| 10-shot image generation | FaceForensics++ | landmarks | 1.15 | DeepFakes |
| 10-shot image generation | FaceForensics++ | perceptual loss | 0.41 | DeepFakes |
| 10-shot image generation | FaceForensics++ | pose | 4.75 | DeepFakes |
| 10-shot image generation | FaceForensics++ | verification | 0.69 | DeepFakes |
| 10-shot image generation | FaceForensics++ | SSIM | 0.65 | Nirkin et al. |
| 10-shot image generation | FaceForensics++ | landmarks | 0.35 | Nirkin et al. |
| 10-shot image generation | FaceForensics++ | perceptual loss | 0.5 | Nirkin et al. |
| 10-shot image generation | FaceForensics++ | pose | 6.01 | Nirkin et al. |
| 10-shot image generation | FaceForensics++ | verification | 0.66 | Nirkin et al. |