TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/CodeTalker

CodeTalker

Reported on 21 benchmarks across 7 tasks · 1 paper · 7 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision6 results

  • 3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Human Pose EstimationonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • Pose EstimationonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379

Knowledge Base6 results

  • 2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 2D Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 2D Human Pose EstimationonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Absolute Human Pose EstimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Absolute Human Pose EstimationonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379

Methodology3 results

  • 3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3DonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3DonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379

Playing Games3 results

  • 3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Face AnimationonBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 3D Face AnimationonBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379

Audio3 results

  • 1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    Lip Vertex Error· 2023-01-06
    4.7914
    best: 4.2485 (SelfTalk)
    SOTA
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 1 Image, 2*2 StitchionBiwi 3D Audiovisual Corpus of Affective Communication - B3D(AC)^2
    FDD· 2023-01-06
    4.117
    best: 4.96 (FaceXHuBERT)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379
  • 1 Image, 2*2 StitchionBEAT2
    MSE· 2023-01-06
    8.026
    best: 6.289 (MambaTalk)
    CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorarXiv:2301.02379