TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/AnyPose: Anytime 3D Human Pose Forecasting via Neural Ordi...

AnyPose: Anytime 3D Human Pose Forecasting via Neural Ordinary Differential Equations

Zixing Wang, Ahmed H. Qureshi

2023-09-09Human Pose Forecasting
PaperPDF

Abstract

Anytime 3D human pose forecasting is crucial to synchronous real-world human-machine interaction, where the term ``anytime" corresponds to predicting human pose at any real-valued time step. However, to the best of our knowledge, all the existing methods in human pose forecasting perform predictions at preset, discrete time intervals. Therefore, we introduce AnyPose, a lightweight continuous-time neural architecture that models human behavior dynamics with neural ordinary differential equations. We validate our framework on the Human3.6M, AMASS, and 3DPW dataset and conduct a series of comprehensive analyses towards comparison with existing methods and the intersection of human pose and neural ordinary differential equations. Our results demonstrate that AnyPose exhibits high-performance accuracy in predicting future poses and takes significantly lower computational time than traditional methods in solving anytime prediction tasks.

Results

TaskDatasetMetricValueModel
Pose EstimationAMASSAverage MPJPE (mm) 1000 msec91.7AnyPose1
Pose EstimationHuman3.6MAverage MPJPE (mm) @ 1000 ms128.2AnyPose1
Pose EstimationHuman3.6MAverage MPJPE (mm) @ 400ms80.6AnyPose1
Pose Estimation3DPWAverage MPJPE (mm) 1000 msec84.4AnyPose1
3DAMASSAverage MPJPE (mm) 1000 msec91.7AnyPose1
3DHuman3.6MAverage MPJPE (mm) @ 1000 ms128.2AnyPose1
3DHuman3.6MAverage MPJPE (mm) @ 400ms80.6AnyPose1
3D3DPWAverage MPJPE (mm) 1000 msec84.4AnyPose1
1 Image, 2*2 StitchiAMASSAverage MPJPE (mm) 1000 msec91.7AnyPose1
1 Image, 2*2 StitchiHuman3.6MAverage MPJPE (mm) @ 1000 ms128.2AnyPose1
1 Image, 2*2 StitchiHuman3.6MAverage MPJPE (mm) @ 400ms80.6AnyPose1
1 Image, 2*2 Stitchi3DPWAverage MPJPE (mm) 1000 msec84.4AnyPose1

Related Papers

MotionMap: Representing Multimodality in Human Pose Forecasting2024-12-25EgoCast: Forecasting Egocentric Human Pose in the Wild2024-12-03Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning2024-04-08Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Dataset2024-03-21Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecasting2024-02-21Expressive Forecasting of 3D Whole-body Human Motions2023-12-19GCNext: Towards the Unity of Graph Convolutions for Human Motion Prediction2023-12-19Personalized Pose Forecasting2023-12-06