Hansen Feng, Lizhi Wang, Yuzhi Wang, Hua Huang
Low-light raw denoising is an important and valuable task in computational photography where learning-based methods trained with paired real data are mainstream. However, the limited data volume and complicated noise distribution have constituted a learnability bottleneck for paired real data, which limits the denoising performance of learning-based methods. To address this issue, we present a learnability enhancement strategy to reform paired real data according to noise modeling. Our strategy consists of two efficient techniques: shot noise augmentation (SNA) and dark shading correction (DSC). Through noise model decoupling, SNA improves the precision of data mapping by increasing the data volume and DSC reduces the complexity of data mapping by reducing the noise complexity. Extensive results on the public datasets and real imaging scenarios collectively demonstrate the state-of-the-art performance of our method. Our code is available at: https://github.com/megvii-research/PMN.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Denoising | SID SonyA7S2 x250 | PSNR (Raw) | 40.92 | PMN |
| Denoising | SID SonyA7S2 x250 | SSIM (Raw) | 0.947 | PMN |
| Denoising | ELD SonyA7S2 x200 | PSNR (Raw) | 44.51 | PMN |
| Denoising | ELD SonyA7S2 x200 | SSIM (Raw) | 0.973 | PMN |
| Denoising | SID x100 | PSNR (Raw) | 43.16 | PMN |
| Denoising | SID x100 | SSIM | 0.96 | PMN |
| Denoising | SID x300 | PSNR (Raw) | 37.77 | PMN |
| Denoising | SID x300 | SSIM | 0.934 | PMN |
| Denoising | SID SonyA7S2 x100 | PSNR (Raw) | 43.16 | PMN |
| Denoising | SID SonyA7S2 x100 | SSIM (Raw) | 0.96 | PMN |
| Denoising | ELD SonyA7S2 x100 | PSNR (Raw) | 46.5 | PMN |
| Denoising | ELD SonyA7S2 x100 | SSIM (Raw) | 0.985 | PMN |
| Image Denoising | SID SonyA7S2 x250 | PSNR (Raw) | 40.92 | PMN |
| Image Denoising | SID SonyA7S2 x250 | SSIM (Raw) | 0.947 | PMN |
| Image Denoising | ELD SonyA7S2 x200 | PSNR (Raw) | 44.51 | PMN |
| Image Denoising | ELD SonyA7S2 x200 | SSIM (Raw) | 0.973 | PMN |
| Image Denoising | SID x100 | PSNR (Raw) | 43.16 | PMN |
| Image Denoising | SID x100 | SSIM | 0.96 | PMN |
| Image Denoising | SID x300 | PSNR (Raw) | 37.77 | PMN |
| Image Denoising | SID x300 | SSIM | 0.934 | PMN |
| Image Denoising | SID SonyA7S2 x100 | PSNR (Raw) | 43.16 | PMN |
| Image Denoising | SID SonyA7S2 x100 | SSIM (Raw) | 0.96 | PMN |
| Image Denoising | ELD SonyA7S2 x100 | PSNR (Raw) | 46.5 | PMN |
| Image Denoising | ELD SonyA7S2 x100 | SSIM (Raw) | 0.985 | PMN |
| 3D Architecture | SID SonyA7S2 x250 | PSNR (Raw) | 40.92 | PMN |
| 3D Architecture | SID SonyA7S2 x250 | SSIM (Raw) | 0.947 | PMN |
| 3D Architecture | ELD SonyA7S2 x200 | PSNR (Raw) | 44.51 | PMN |
| 3D Architecture | ELD SonyA7S2 x200 | SSIM (Raw) | 0.973 | PMN |
| 3D Architecture | SID x100 | PSNR (Raw) | 43.16 | PMN |
| 3D Architecture | SID x100 | SSIM | 0.96 | PMN |
| 3D Architecture | SID x300 | PSNR (Raw) | 37.77 | PMN |
| 3D Architecture | SID x300 | SSIM | 0.934 | PMN |
| 3D Architecture | SID SonyA7S2 x100 | PSNR (Raw) | 43.16 | PMN |
| 3D Architecture | SID SonyA7S2 x100 | SSIM (Raw) | 0.96 | PMN |
| 3D Architecture | ELD SonyA7S2 x100 | PSNR (Raw) | 46.5 | PMN |
| 3D Architecture | ELD SonyA7S2 x100 | SSIM (Raw) | 0.985 | PMN |