TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/SelfTalk

SelfTalk

Reported on 14 benchmarks across 7 tasks · 1 paper · 7 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision4 results

  • 3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799

Knowledge Base4 results

  • 2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799

Methodology2 results

  • 3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799

Playing Games2 results

  • 3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799

Audio2 results

  • 1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-06-19
    4.2485
    SOTA
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799
  • 1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-06-19
    3.5761
    best: 4.96 (FaceXHuBERT)
    SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesarXiv:2306.10799