Video Generation on BAIR Robot Pushing

Metric: Train (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Train▼	Extra Data	Paper	Date↕	Code
1	RaMViD	20	No	Diffusion Models for Video Prediction and Infill...	2022-06-15	Code
2	MAGVIT	15	No	MAGVIT: Masked Generative Video Transformer	2022-12-10	Code
3	NUWA	15	Yes	NÜWA: Visual Synthesis Pre-training for Neural v...	2021-11-24	Code
4	FitVid	15	No	FitVid: Overfitting in Pixel-Level Video Predict...	2021-06-24	Code
5	Video Transformer	15	No	Scaling Autoregressive Video Models	2019-06-06	Code
6	CCVS	15	No	CCVS: Context-aware Controllable Video Synthesis	2021-07-16	Code
7	VideoGPT	15	No	VideoGPT: Video Generation using VQ-VAE and Tran...	2021-04-20	Code
8	TrIVD-GAN-FP	15	No	Transformation-based Adversarial Video Predictio...	2020-03-09	-
9	DVD-GAN-FP	15	No	Adversarial Video Generation on Complex Datasets	2019-07-15	Code
10	LVT	15	No	Latent Video Transformer	2020-06-18	Code
11	Baseline (from LVT)	15	No	Latent Video Transformer	2020-06-18	Code
12	SAVP (from FVD)	14	No	Stochastic Adversarial Video Prediction	2018-04-04	Code
13	WAM	14	No	Exploring Spatial-Temporal Multi-Frequency Analy...	2020-02-23	Code
14	SV2P (from FVD)	14	No	Stochastic Variational Video Prediction	2017-10-30	Code
15	CDNA (from FVD)	14	No	Unsupervised Learning for Physical Interaction t...	2016-05-23	Code
16	SVG-FP (from FVD)	14	No	Stochastic Video Generation with a Learned Prior	2018-02-21	Code
17	SAVP-VAE (from WAM)	14	No	Stochastic Adversarial Video Prediction	2018-04-04	Code
18	SAVP (from SRVP)	12	No	Stochastic Adversarial Video Prediction	2018-04-04	Code
19	SRVP	12	No	Stochastic Latent Residual Video Prediction	2020-02-21	Code
20	SVG (from SRVP)	12	No	Stochastic Video Generation with a Learned Prior	2018-02-21	Code
21	MoCoGAN	12	No	MoCoGAN: Decomposing Motion and Content for Vide...	2017-07-17	Code
22	SV2P (from SRVP)	12	No	Stochastic Variational Video Prediction	2017-10-30	Code
23	VideoFlow	10	No	VideoFlow: A Conditional Flow-Based Model for St...	2019-03-04	Code
24	Hier-VRNN	10	No	Improved Conditional VRNNs for Video Prediction	2019-04-27	Code
25	SAVP (from vRNN)	10	No	Stochastic Adversarial Video Prediction	2018-04-04	Code
26	VRNN 1L	10	No	Improved Conditional VRNNs for Video Prediction	2019-04-27	Code
27	SLAMP	10	No	SLAMP: Stochastic Latent Appearance and Motion P...	2021-08-05	Code
28	SVG-LP (from vRNN)	10	No	Stochastic Video Generation with a Learned Prior	2018-02-21	Code
29	MCVD : c2t5p14	5	No	MCVD: Masked Conditional Video Diffusion for Pre...	2022-05-19	Code
30	MCVD : c1t5p15	5	No	MCVD: Masked Conditional Video Diffusion for Pre...	2022-05-19	Code
31	MCVD : c2t5p28	5	No	MCVD: Masked Conditional Video Diffusion for Pre...	2022-05-19	Code

#1RaMViDSOTA
20
Train· 2022-06-15
Diffusion Models for Video Prediction and Infilling Code
#2MAGVIT
15
Train· 2022-12-10
MAGVIT: Masked Generative Video Transformer Code
#3NUWA
15
Train· Extra Data· 2021-11-24
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion Code
#4FitVid
15
Train· 2021-06-24
FitVid: Overfitting in Pixel-Level Video Prediction Code
#5Video TransformerSOTA
15
Train· 2019-06-06
Scaling Autoregressive Video Models Code
#6CCVS
15
Train· 2021-07-16
CCVS: Context-aware Controllable Video Synthesis Code
#7VideoGPT
15
Train· 2021-04-20
VideoGPT: Video Generation using VQ-VAE and Transformers Code
#8TrIVD-GAN-FP
15
Train· 2020-03-09
Transformation-based Adversarial Video Prediction on Large-Scale Data
#9DVD-GAN-FP
15
Train· 2019-07-15
Adversarial Video Generation on Complex Datasets Code
#10LVT
15
Train· 2020-06-18
Latent Video Transformer Code
#11Baseline (from LVT)
15
Train· 2020-06-18
Latent Video Transformer Code
#12SAVP (from FVD)
14
Train· 2018-04-04
Stochastic Adversarial Video Prediction Code
#13WAM
14
Train· 2020-02-23
Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Prediction Code
#14SV2P (from FVD)
14
Train· 2017-10-30
Stochastic Variational Video Prediction Code
#15CDNA (from FVD)SOTA
14
Train· 2016-05-23
Unsupervised Learning for Physical Interaction through Video Prediction Code
#16SVG-FP (from FVD)
14
Train· 2018-02-21
Stochastic Video Generation with a Learned Prior Code
#17SAVP-VAE (from WAM)
14
Train· 2018-04-04
Stochastic Adversarial Video Prediction Code
#18SAVP (from SRVP)
12
Train· 2018-04-04
Stochastic Adversarial Video Prediction Code
#19SRVP
12
Train· 2020-02-21
Stochastic Latent Residual Video Prediction Code
#20SVG (from SRVP)
12
Train· 2018-02-21
Stochastic Video Generation with a Learned Prior Code
#21MoCoGAN
12
Train· 2017-07-17
MoCoGAN: Decomposing Motion and Content for Video Generation Code
#22SV2P (from SRVP)
12
Train· 2017-10-30
Stochastic Variational Video Prediction Code
#23VideoFlow
10
Train· 2019-03-04
VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation Code
#24Hier-VRNN
10
Train· 2019-04-27
Improved Conditional VRNNs for Video Prediction Code
#25SAVP (from vRNN)
10
Train· 2018-04-04
Stochastic Adversarial Video Prediction Code
#26VRNN 1L
10
Train· 2019-04-27
Improved Conditional VRNNs for Video Prediction Code
#27SLAMP
10
Train· 2021-08-05
SLAMP: Stochastic Latent Appearance and Motion Prediction Code
#28SVG-LP (from vRNN)
10
Train· 2018-02-21
Stochastic Video Generation with a Learned Prior Code
#29MCVD : c2t5p14
5
Train· 2022-05-19
MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation Code
#30MCVD : c1t5p15
5
Train· 2022-05-19
MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation Code
#31MCVD : c2t5p28
5
Train· 2022-05-19
MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation Code