TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Motion Inbetweening via Deep $Δ$-Interpolator

Motion Inbetweening via Deep $Δ$-Interpolator

Boris N. Oreshkin, Antonios Valkanas, Félix G. Harvey, Louis-Simon Ménard, Florent Bocquelet, Mark J. Coates

2022-01-18Motion Synthesis
PaperPDFCode(official)

Abstract

We show that the task of synthesizing human motion conditioned on a set of key frames can be solved more accurately and effectively if a deep learning based interpolator operates in the delta mode using the spherical linear interpolator as a baseline. We empirically demonstrate the strength of our approach on publicly available datasets achieving state-of-the-art performance. We further generalize these results by showing that the $\Delta$-regime is viable with respect to the reference of the last known frame (also known as the zero-velocity model). This supports the more general conclusion that operating in the reference frame local to input frames is more accurate and robust than in the global (world) reference frame advocated in previous work. Our code is publicly available at https://github.com/boreshkinai/delta-interpolator.

Results

TaskDatasetMetricValueModel
Pose TrackingLaFAN1L2P@150.47$\Delta$-interpolator
Pose TrackingLaFAN1L2P@301$\Delta$-interpolator
Pose TrackingLaFAN1L2P@50.13$\Delta$-interpolator
Pose TrackingLaFAN1L2Q@150.32$\Delta$-interpolator
Pose TrackingLaFAN1L2Q@300.57$\Delta$-interpolator
Pose TrackingLaFAN1L2Q@50.11$\Delta$-interpolator
Pose TrackingLaFAN1NPSS@150.0217$\Delta$-interpolator
Pose TrackingLaFAN1NPSS@300.1217$\Delta$-interpolator
Pose TrackingLaFAN1NPSS@50.0014$\Delta$-interpolator
Motion SynthesisLaFAN1L2P@150.47$\Delta$-interpolator
Motion SynthesisLaFAN1L2P@301$\Delta$-interpolator
Motion SynthesisLaFAN1L2P@50.13$\Delta$-interpolator
Motion SynthesisLaFAN1L2Q@150.32$\Delta$-interpolator
Motion SynthesisLaFAN1L2Q@300.57$\Delta$-interpolator
Motion SynthesisLaFAN1L2Q@50.11$\Delta$-interpolator
Motion SynthesisLaFAN1NPSS@150.0217$\Delta$-interpolator
Motion SynthesisLaFAN1NPSS@300.1217$\Delta$-interpolator
Motion SynthesisLaFAN1NPSS@50.0014$\Delta$-interpolator
10-shot image generationLaFAN1L2P@150.47$\Delta$-interpolator
10-shot image generationLaFAN1L2P@301$\Delta$-interpolator
10-shot image generationLaFAN1L2P@50.13$\Delta$-interpolator
10-shot image generationLaFAN1L2Q@150.32$\Delta$-interpolator
10-shot image generationLaFAN1L2Q@300.57$\Delta$-interpolator
10-shot image generationLaFAN1L2Q@50.11$\Delta$-interpolator
10-shot image generationLaFAN1NPSS@150.0217$\Delta$-interpolator
10-shot image generationLaFAN1NPSS@300.1217$\Delta$-interpolator
10-shot image generationLaFAN1NPSS@50.0014$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2P@150.47$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2P@301$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2P@50.13$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2Q@150.32$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2Q@300.57$\Delta$-interpolator
3D Human Pose TrackingLaFAN1L2Q@50.11$\Delta$-interpolator
3D Human Pose TrackingLaFAN1NPSS@150.0217$\Delta$-interpolator
3D Human Pose TrackingLaFAN1NPSS@300.1217$\Delta$-interpolator
3D Human Pose TrackingLaFAN1NPSS@50.0014$\Delta$-interpolator

Related Papers

DeepGesture: A conversational gesture synthesis system based on emotions and semantics2025-07-03VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisions2025-06-29DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modeling2025-06-23PlanMoGPT: Flow-Enhanced Progressive Planning for Text to Motion Synthesis2025-06-22Motion-R1: Chain-of-Thought Reasoning and Reinforcement Learning for Human Motion Generation2025-06-12DanceChat: Large Language Model-Guided Music-to-Dance Generation2025-06-12MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generation2025-06-03MotionPro: A Precise Motion Controller for Image-to-Video Generation2025-05-26