TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/MotionPCM: Real-Time Motion Synthesis with Phased Consiste...

MotionPCM: Real-Time Motion Synthesis with Phased Consistency Model

Lei Jiang, Ye Wei, Hao Ni

2025-01-31Motion Synthesis
PaperPDF

Abstract

Diffusion models have become a popular choice for human motion synthesis due to their powerful generative capabilities. However, their high computational complexity and large sampling steps pose challenges for real-time applications. Fortunately, the Consistency Model (CM) provides a solution to greatly reduce the number of sampling steps from hundreds to a few, typically fewer than four, significantly accelerating the synthesis of diffusion models. However, its application to text-conditioned human motion synthesis in latent space remains challenging. In this paper, we introduce \textbf{MotionPCM}, a phased consistency model-based approach designed to improve the quality and efficiency of real-time motion synthesis in latent space.

Results

TaskDatasetMetricValueModel
Pose TrackingHumanML3DDiversity9.575MotionPCM
Pose TrackingHumanML3DFID0.03MotionPCM
Pose TrackingHumanML3DMultimodality1.714MotionPCM
Pose TrackingHumanML3DR Precision Top30.842MotionPCM
Pose TrackingKIT Motion-LanguageDiversity10.827MotionPCM
Pose TrackingKIT Motion-LanguageFID0.294MotionPCM
Pose TrackingKIT Motion-LanguageMultimodality1.254MotionPCM
Pose TrackingKIT Motion-LanguageR Precision Top30.787MotionPCM
Motion SynthesisHumanML3DDiversity9.575MotionPCM
Motion SynthesisHumanML3DFID0.03MotionPCM
Motion SynthesisHumanML3DMultimodality1.714MotionPCM
Motion SynthesisHumanML3DR Precision Top30.842MotionPCM
Motion SynthesisKIT Motion-LanguageDiversity10.827MotionPCM
Motion SynthesisKIT Motion-LanguageFID0.294MotionPCM
Motion SynthesisKIT Motion-LanguageMultimodality1.254MotionPCM
Motion SynthesisKIT Motion-LanguageR Precision Top30.787MotionPCM
10-shot image generationHumanML3DDiversity9.575MotionPCM
10-shot image generationHumanML3DFID0.03MotionPCM
10-shot image generationHumanML3DMultimodality1.714MotionPCM
10-shot image generationHumanML3DR Precision Top30.842MotionPCM
10-shot image generationKIT Motion-LanguageDiversity10.827MotionPCM
10-shot image generationKIT Motion-LanguageFID0.294MotionPCM
10-shot image generationKIT Motion-LanguageMultimodality1.254MotionPCM
10-shot image generationKIT Motion-LanguageR Precision Top30.787MotionPCM
3D Human Pose TrackingHumanML3DDiversity9.575MotionPCM
3D Human Pose TrackingHumanML3DFID0.03MotionPCM
3D Human Pose TrackingHumanML3DMultimodality1.714MotionPCM
3D Human Pose TrackingHumanML3DR Precision Top30.842MotionPCM
3D Human Pose TrackingKIT Motion-LanguageDiversity10.827MotionPCM
3D Human Pose TrackingKIT Motion-LanguageFID0.294MotionPCM
3D Human Pose TrackingKIT Motion-LanguageMultimodality1.254MotionPCM
3D Human Pose TrackingKIT Motion-LanguageR Precision Top30.787MotionPCM

Related Papers

DeepGesture: A conversational gesture synthesis system based on emotions and semantics2025-07-03VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisions2025-06-29DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modeling2025-06-23PlanMoGPT: Flow-Enhanced Progressive Planning for Text to Motion Synthesis2025-06-22Motion-R1: Chain-of-Thought Reasoning and Reinforcement Learning for Human Motion Generation2025-06-12DanceChat: Large Language Model-Guided Music-to-Dance Generation2025-06-12MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generation2025-06-03MotionPro: A Precise Motion Controller for Image-to-Video Generation2025-05-26