Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, Timo Aila
We apply basic statistical reasoning to signal reconstruction by machine learning -- learning to map corrupted observations to clean signals -- with a simple and powerful conclusion: it is possible to learn to restore images by only looking at corrupted examples, at performance at and sometimes exceeding training using clean data, without explicit image priors or likelihood models of the corruption. In practice, we show that a single model learns photographic noise removal, denoising synthetic Monte Carlo images, and reconstruction of undersampled MRI scans -- all corrupted by different processes -- based on noisy data only.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Denoising | BSD300 Noise Level 30% | PSNR | 39.83 | Noise2Noise |
| Denoising | BSD300 Noise Level 50% | PSNR | 35.92 | Noise2Noise |
| Denoising | Kodak24 Noise Level 50% | PSNR | 32.27 | Noise2Noise |
| Denoising | Kodak24 Noise Level 70% | PSNR | 30.49 | Noise2Noise |
| Denoising | BSD300 Noise Level 70% | PSNR | 31.42 | Noise2Noise |
| Denoising | Kodak24 Noise Level 30% | PSNR | 34.95 | Noise2Noise |
| 3D Architecture | BSD300 Noise Level 30% | PSNR | 39.83 | Noise2Noise |
| 3D Architecture | BSD300 Noise Level 50% | PSNR | 35.92 | Noise2Noise |
| 3D Architecture | Kodak24 Noise Level 50% | PSNR | 32.27 | Noise2Noise |
| 3D Architecture | Kodak24 Noise Level 70% | PSNR | 30.49 | Noise2Noise |
| 3D Architecture | BSD300 Noise Level 70% | PSNR | 31.42 | Noise2Noise |
| 3D Architecture | Kodak24 Noise Level 30% | PSNR | 34.95 | Noise2Noise |