Video on Moving MNIST

Metric: MSE (lower is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	MSE▲	Extra Data	Paper	Date↕	Code
1	PredFormer	11.62	No	Video Prediction Transformers without Recurrence...	2024-10-07	Code
2	SimVP+gSTA-Sx10	15.05	No	SimVPv2: Towards Simple yet Powerful Spatiotempo...	2022-11-22	Code
3	IAM4VPx5	15.3	No	Implicit Stacked Autoregressive Model for Video ...	2023-03-14	Code
4	MogaNet (SimVP 10x)	15.67	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
5	VAN (SimVP 10x)	16.21	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
6	HorNet (SimVP 10x)	17.4	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
7	ConvNeXt (SimVP 10x)	17.58	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
8	SwinLSTM	17.7	No	-	-	Code
9	Uniformer (SimVP 10x)	18.01	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
10	MLP-Mixer (SimVP 10x)	18.85	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
11	GMG	19.0741	No	GMG: A Video Prediction Method Based on Global F...	2025-03-14	Code
12	Swin (SimVP 10x)	19.11	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
13	ViT (SimVP 10x)	19.74	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
14	TAU	19.8	No	Temporal Attention Unit: Towards Efficient Spati...	2022-06-24	Code
15	Poolformer (SimVP 10x)	20.96	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
16	ConvMixer (SimVP 10x)	22.3	No	MogaNet: Multi-order Gated Aggregation Network	2022-11-07	Code
17	CrevNet+ST-LSTM	22.3	No	-	-	Code
18	SimVP	23.8	No	SimVP: Simpler yet Better Video Prediction	2022-06-09	Code
19	PhyDNet	24.4	No	Disentangling Physical Dynamics from Unknown Fac...	2020-03-03	Code
20	MAU	27.6	No	-	-	Code
21	MSPred	34.44	No	MSPred: Video Prediction at Multiple Spatio-Temp...	2022-03-17	Code
22	CrevNet+ConvLSTM	38.5	No	-	-	Code
23	E3D-LSTM	41.3	No	-	-	Code
24	LMC	41.5	No	Video Prediction Recalling Long-term Motion Cont...	2021-04-02	Code
25	SA-ConvLSTM	43.9	No	-	-	Code
26	MIM*	44.2	No	Memory In Memory: A Predictive Neural Network fo...	2018-11-19	Code
27	Causal LSTM	46.5	No	PredRNN++: Towards A Resolution of the Deep-in-T...	2018-04-17	Code
28	PredRNN-V2	48.4	No	PredRNN: A Recurrent Neural Network for Spatiote...	2021-03-17	Code
29	MIM	52	No	Memory In Memory: A Predictive Neural Network fo...	2018-11-19	Code
30	PredRNN	56.8	No	-	-	Code
31	ConvLSTM	103.3	No	Convolutional LSTM Network: A Machine Learning A...	2015-06-13	Code

#1PredFormerSOTA
11.62
MSE· 2024-10-07
Video Prediction Transformers without Recurrence or Convolution Code
#2SimVP+gSTA-Sx10SOTA
15.05
MSE· 2022-11-22
SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learning Code
#3IAM4VPx5
15.3
MSE· 2023-03-14
Implicit Stacked Autoregressive Model for Video Prediction Code
#4MogaNet (SimVP 10x)SOTA
15.67
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#5VAN (SimVP 10x)SOTA
16.21
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#6HorNet (SimVP 10x)SOTA
17.4
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#7ConvNeXt (SimVP 10x)SOTA
17.58
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#8SwinLSTM
17.7
MSE
No paperCode
#9Uniformer (SimVP 10x)SOTA
18.01
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#10MLP-Mixer (SimVP 10x)SOTA
18.85
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#11GMG
19.0741
MSE· 2025-03-14
GMG: A Video Prediction Method Based on Global Focus and Motion Guided Code
#12Swin (SimVP 10x)SOTA
19.11
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#13ViT (SimVP 10x)SOTA
19.74
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#14TAUSOTA
19.8
MSE· 2022-06-24
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning Code
#15Poolformer (SimVP 10x)
20.96
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#16ConvMixer (SimVP 10x)
22.3
MSE· 2022-11-07
MogaNet: Multi-order Gated Aggregation Network Code
#17CrevNet+ST-LSTM
22.3
MSE
No paperCode
#18SimVPSOTA
23.8
MSE· 2022-06-09
SimVP: Simpler yet Better Video Prediction Code
#19PhyDNetSOTA
24.4
MSE· 2020-03-03
Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Prediction Code
#20MAU
27.6
MSE
No paperCode
#21MSPred
34.44
MSE· 2022-03-17
MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networks Code
#22CrevNet+ConvLSTM
38.5
MSE
No paperCode
#23E3D-LSTM
41.3
MSE
No paperCode
#24LMC
41.5
MSE· 2021-04-02
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning Code
#25SA-ConvLSTM
43.9
MSE
No paperCode
#26MIM*SOTA
44.2
MSE· 2018-11-19
Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics Code
#27Causal LSTMSOTA
46.5
MSE· 2018-04-17
PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning Code
#28PredRNN-V2
48.4
MSE· 2021-03-17
PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning Code
#29MIM
52
MSE· 2018-11-19
Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics Code
#30PredRNN
56.8
MSE
No paperCode
#31ConvLSTMSOTA
103.3
MSE· 2015-06-13
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting Code