Video Prediction on Moving MNIST

Metric: SSIM (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	SSIM▼	Extra Data	Paper	Date↕	Code
1	MSPred	0.975	No	MSPred: Video Prediction at Multiple Spatio-Temp...	2022-03-17	Code
2	PredFormer	0.9742	No	Video Prediction Transformers without Recurrence...	2024-10-07	Code
3	SimVP+gSTA-Sx10	0.967	No	SimVPv2: Towards Simple yet Powerful Spatiotempo...	2022-11-22	Code
4	MogaNet (SimVP 10x)	0.9661	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
5	IAM4VPx5	0.966	No	Implicit Stacked Autoregressive Model for Video ...	2023-03-14	Code
6	VAN (SimVP 10x)	0.9646	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
7	HorNet (SimVP 10x)	0.9624	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
8	SwinLSTM	0.962	No	-	-	Code
9	ConvNeXt (SimVP 10x)	0.9617	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
10	GMG	0.9586	No	GMG: A Video Prediction Method Based on Global F...	2025-03-14	Code
11	TAU	0.957	No	Temporal Attention Unit: Towards Efficient Spati...	2022-06-24	Code
12	ViT (SimVP 10x)	0.9539	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
13	CrevNet+ST-LSTM	0.949	No	-	-	Code
14	SimVP	0.948	No	SimVP: Simpler yet Better Video Prediction	2022-06-09	Code
15	PhyDNet	0.947	No	Disentangling Physical Dynamics from Unknown Fac...	2020-03-03	Code
16	MAU	0.937	No	-	-	Code
17	CrevNet+ConvLSTM	0.928	No	-	-	Code
18	LMC	0.924	No	Video Prediction Recalling Long-term Motion Cont...	2021-04-02	Code
19	SA-ConvLSTM	0.913	No	-	-	Code
20	E3D-LSTM	0.91	No	-	-	Code
21	MIM*	0.91	No	Memory In Memory: A Predictive Neural Network fo...	2018-11-19	Code
22	Causal LSTM	0.898	No	PredRNN++: Towards A Resolution of the Deep-in-T...	2018-04-17	Code
23	PredRNN-V2	0.891	No	PredRNN: A Recurrent Neural Network for Spatiote...	2021-03-17	Code
24	MIM	0.874	No	Memory In Memory: A Predictive Neural Network fo...	2018-11-19	Code
25	PredRNN	0.867	No	-	-	Code
26	ConvLSTM	0.707	No	Convolutional LSTM Network: A Machine Learning A...	2015-06-13	Code

#1MSPredSOTA
0.975
SSIM· 2022-03-17
MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networks Code
#2PredFormer
0.9742
SSIM· 2024-10-07
Video Prediction Transformers without Recurrence or Convolution Code
#3SimVP+gSTA-Sx10
0.967
SSIM· 2022-11-22
SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learning Code
#4MogaNet (SimVP 10x)
0.9661
SSIM· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#5IAM4VPx5
0.966
SSIM· 2023-03-14
Implicit Stacked Autoregressive Model for Video Prediction Code
#6VAN (SimVP 10x)
0.9646
SSIM· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#7HorNet (SimVP 10x)
0.9624
SSIM· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#8SwinLSTM
0.962
SSIM
No paperCode
#9ConvNeXt (SimVP 10x)
0.9617
SSIM· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#10GMG
0.9586
SSIM· 2025-03-14
GMG: A Video Prediction Method Based on Global Focus and Motion Guided Code
#11TAU
0.957
SSIM· 2022-06-24
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning Code
#12ViT (SimVP 10x)
0.9539
SSIM· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#13CrevNet+ST-LSTM
0.949
SSIM
No paperCode
#14SimVP
0.948
SSIM· 2022-06-09
SimVP: Simpler yet Better Video Prediction Code
#15PhyDNetSOTA
0.947
SSIM· 2020-03-03
Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Prediction Code
#16MAU
0.937
SSIM
No paperCode
#17CrevNet+ConvLSTM
0.928
SSIM
No paperCode
#18LMC
0.924
SSIM· 2021-04-02
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning Code
#19SA-ConvLSTM
0.913
SSIM
No paperCode
#20E3D-LSTM
0.91
SSIM
No paperCode
#21MIM*SOTA
0.91
SSIM· 2018-11-19
Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics Code
#22Causal LSTMSOTA
0.898
SSIM· 2018-04-17
PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning Code
#23PredRNN-V2
0.891
SSIM· 2021-03-17
PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning Code
#24MIM
0.874
SSIM· 2018-11-19
Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics Code
#25PredRNN
0.867
SSIM
No paperCode
#26ConvLSTMSOTA
0.707
SSIM· 2015-06-13
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting Code