Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/FaceFormer

FaceFormer

Reported on 28 benchmarks across 7 tasks · 1 paper · 28 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision8 results

3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Human Pose EstimationonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Human Pose EstimationonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
Pose EstimationonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
Pose EstimationonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329

Knowledge Base8 results

2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
2D Human Pose EstimationonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
2D Human Pose EstimationonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Absolute Human Pose EstimationonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Absolute Human Pose EstimationonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329

Methodology4 results

3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3DonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3DonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329

Playing Games4 results

3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Face AnimationonVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
3D Face AnimationonBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329

Audio4 results

1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
FDD· 2021-12-10
4.6408
best: 4.96 (FaceXHuBERT)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
Lip Vertex Error· 2021-12-10
5.3077
best: 4.2485 (SelfTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
1 Image, 2*2 StitchionVOCASET
Lip Vertex Error· 2021-12-10
5.3742
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329
1 Image, 2*2 StitchionBEAT2
MSE· 2021-12-10
7.787
best: 6.289 (MambaTalk)
SOTA
FaceFormer: Speech-Driven 3D Facial Animation with Transformers arXiv:2112.05329