TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Convolutional LSTM Network: A Machine Learning Approach fo...

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting

Xingjian Shi, Zhourong Chen, Hao Wang, Dit-yan Yeung, Wai-kin Wong, Wang-chun Woo

2015-06-13NeurIPS 2015 12Video PredictionWeather ForecastingBIG-bench Machine Learning
PaperPDFCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCodeCode

Abstract

The goal of precipitation nowcasting is to predict the future rainfall intensity in a local region over a relatively short period of time. Very few previous studies have examined this crucial and challenging weather forecasting problem from the machine learning perspective. In this paper, we formulate precipitation nowcasting as a spatiotemporal sequence forecasting problem in which both the input and the prediction target are spatiotemporal sequences. By extending the fully connected LSTM (FC-LSTM) to have convolutional structures in both the input-to-state and state-to-state transitions, we propose the convolutional LSTM (ConvLSTM) and use it to build an end-to-end trainable model for the precipitation nowcasting problem. Experiments show that our ConvLSTM network captures spatiotemporal correlations better and consistently outperforms FC-LSTM and the state-of-the-art operational ROVER algorithm for precipitation nowcasting.

Results

TaskDatasetMetricValueModel
VideoMoving MNISTMAE182.9ConvLSTM
VideoMoving MNISTMSE103.3ConvLSTM
VideoMoving MNISTSSIM0.707ConvLSTM
VideoKTHCond10ConvLSTM
VideoKTHLPIPS0.231ConvLSTM
VideoKTHPSNR23.58ConvLSTM
VideoKTHPred20ConvLSTM
VideoKTHSSIM0.712ConvLSTM
Video PredictionMoving MNISTMAE182.9ConvLSTM
Video PredictionMoving MNISTMSE103.3ConvLSTM
Video PredictionMoving MNISTSSIM0.707ConvLSTM
Video PredictionKTHCond10ConvLSTM
Video PredictionKTHLPIPS0.231ConvLSTM
Video PredictionKTHPSNR23.58ConvLSTM
Video PredictionKTHPred20ConvLSTM
Video PredictionKTHSSIM0.712ConvLSTM

Related Papers

FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale2025-07-16D3FL: Data Distribution and Detrending for Robust Federated Learning in Non-linear Time-series Data2025-07-15Epona: Autoregressive Diffusion World Model for Autonomous Driving2025-06-30Whole-Body Conditioned Egocentric Video Prediction2025-06-26Optimising 4th-Order Runge-Kutta Methods: A Dynamic Heuristic Approach for Efficiency and Low Storage2025-06-26Distributed Cross-Channel Hierarchical Aggregation for Foundation Models2025-06-26Elucidated Rolling Diffusion Models for Probabilistic Weather Forecasting2025-06-24MinD: Unified Visual Imagination and Control via Hierarchical World Models2025-06-23