TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/FrankMocap

FrankMocap

Reported on 72 benchmarks across 8 tasks · 2 papers · 56 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision41 results

  • ReconstructiononExpressive hands and faces dataset (EHF)
    PA V2V (mm), whole body· 2021-08-13
    57.5
    SOTA
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    TR V2V (mm), left hand· 2021-08-13
    32.1
    SOTA
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • HandonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3D Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • ReconstructiononExpressive hands and faces dataset (EHF)
    MPJPE, left hand· 2021-08-13
    13.2
    best: 13.5 (ExPose)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    MPJPE-14· 2021-08-13
    62.3
    best: 87.6 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    PA V2V (mm), body only· 2021-08-13
    52.7
    best: 75.4 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    PA V2V (mm), left hand· 2021-08-13
    12.8
    best: 13.1 (ExPose)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    TR V2V (mm), body only· 2021-08-13
    80.1
    best: 116.1 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    TR V2V (mm), whole body· 2021-08-13
    76.9
    best: 93 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    mean P2S· 2021-08-13
    31.6
    best: 36.8 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • ReconstructiononExpressive hands and faces dataset (EHF)
    median P2S· 2021-08-13
    19.2
    best: 23 (SMPLify-X)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • 3D Human Pose Estimationon3DPW
    MPJPE· 2021-08-13
    94.3
    best: 130 (HMR)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • 3D Human Pose Estimationon3DPW
    PA-MPJPE· 2021-08-13
    60
    best: 157 (Simple-baseline)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • Pose Estimationon3DPW
    MPJPE· 2021-08-13
    94.3
    best: 130 (HMR)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • Pose Estimationon3DPW
    PA-MPJPE· 2021-08-13
    60
    best: 157 (Simple-baseline)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428

Methodology11 results

  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3DonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 3Don3DPW
    MPJPE· 2021-08-13
    94.3
    best: 130 (HMR)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • 3Don3DPW
    PA-MPJPE· 2021-08-13
    60
    best: 157 (Simple-baseline)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428

Audio11 results

  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 StitchionHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • 1 Image, 2*2 Stitchion3DPW
    MPJPE· 2021-08-13
    94.3
    best: 130 (HMR)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428
  • 1 Image, 2*2 Stitchion3DPW
    PA-MPJPE· 2021-08-13
    60
    best: 157 (Simple-baseline)
    FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and IntegrationarXiv:2108.06428

Graphs9 results

  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) All· 2020-08-19
    13.1
    best: 46.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Occ· 2020-08-19
    8.4
    best: 33.1 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (Ego4D) Visible· 2020-08-19
    16.3
    best: 59.3 (MaskHand)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (New Days) All· 2020-08-19
    16.1
    best: 59.6 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Occ· 2020-08-19
    9.2
    best: 33.2 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (NewDays) Visible· 2020-08-19
    20.1
    best: 62.9 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) All· 2020-08-19
    16.8
    best: 61.1 (ExtPose*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Occ· 2020-08-19
    11
    best: 42.6 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324
  • Hand Pose EstimationonHInt: Hand Interactions in the wild
    PCK@0.05 (VISOR) Visible· 2020-08-19
    20.4
    best: 66.5 (HaMeR*)
    SOTA
    FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and IntegrationarXiv:2008.08324