Christian Requena-Mesa, Vitus Benson, Markus Reichstein, Jakob Runge, Joachim Denzler
Satellite images are snapshots of the Earth surface. We propose to forecast them. We frame Earth surface forecasting as the task of predicting satellite imagery conditioned on future weather. EarthNet2021 is a large dataset suitable for training deep neural networks on the task. It contains Sentinel 2 satellite imagery at 20m resolution, matching topography and mesoscale (1.28km) meteorological variables packaged into 32000 samples. Additionally we frame EarthNet2021 as a challenge allowing for model intercomparison. Resulting forecasts will greatly improve (>x50) over the spatial resolution found in numerical models. This allows localized impacts from extreme weather to be predicted, thus supporting downstream applications such as crop yield prediction, forest health assessments or biodiversity monitoring. Find data, code, and how to participate at www.earthnet.tech
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Video | EarthNet2021 IID Track | EarthNetScore | 0.2902 | Channel-U-Net Baseline |
| Video | EarthNet2021 IID Track | EarthNetScore | 0.2803 | Arcon Baseline |
| Video | EarthNet2021 IID Track | EarthNetScore | 0.2625 | Persistence Baseline |
| Video | EarthNet2021 Seasonal Track | EarthNetScore | 0.2676 | Persistence Baseline |
| Video | EarthNet2021 Seasonal Track | EarthNetScore | 0.1955 | Channel-U-Net Baseline |
| Video | EarthNet2021 Seasonal Track | EarthNetScore | 0.1587 | Arcon Baseline |
| Video | EarthNet2021 OOD Track | EarthNetScore | 0.2854 | Channel-U-Net Baseline |
| Video | EarthNet2021 OOD Track | EarthNetScore | 0.2655 | Arcon Baseline |
| Video | EarthNet2021 OOD Track | EarthNetScore | 0.2587 | Persistence Baseline |
| Video | EarthNet2021 Extreme Track | EarthNetScore | 0.2364 | Channel-U-Net Baseline |
| Video | EarthNet2021 Extreme Track | EarthNetScore | 0.2215 | Arcon Baseline |
| Video | EarthNet2021 Extreme Track | EarthNetScore | 0.1939 | Persistence Baseline |
| Video Prediction | EarthNet2021 IID Track | EarthNetScore | 0.2902 | Channel-U-Net Baseline |
| Video Prediction | EarthNet2021 IID Track | EarthNetScore | 0.2803 | Arcon Baseline |
| Video Prediction | EarthNet2021 IID Track | EarthNetScore | 0.2625 | Persistence Baseline |
| Video Prediction | EarthNet2021 Seasonal Track | EarthNetScore | 0.2676 | Persistence Baseline |
| Video Prediction | EarthNet2021 Seasonal Track | EarthNetScore | 0.1955 | Channel-U-Net Baseline |
| Video Prediction | EarthNet2021 Seasonal Track | EarthNetScore | 0.1587 | Arcon Baseline |
| Video Prediction | EarthNet2021 OOD Track | EarthNetScore | 0.2854 | Channel-U-Net Baseline |
| Video Prediction | EarthNet2021 OOD Track | EarthNetScore | 0.2655 | Arcon Baseline |
| Video Prediction | EarthNet2021 OOD Track | EarthNetScore | 0.2587 | Persistence Baseline |
| Video Prediction | EarthNet2021 Extreme Track | EarthNetScore | 0.2364 | Channel-U-Net Baseline |
| Video Prediction | EarthNet2021 Extreme Track | EarthNetScore | 0.2215 | Arcon Baseline |
| Video Prediction | EarthNet2021 Extreme Track | EarthNetScore | 0.1939 | Persistence Baseline |