Majed El Helou, Sabine Süsstrunk
Blind and universal image denoising consists of using a unique model that denoises images with any level of noise. It is especially practical as noise levels do not need to be known when the model is developed or at test time. We propose a theoretically-grounded blind and universal deep learning image denoiser for additive Gaussian noise removal. Our network is based on an optimal denoising solution, which we call fusion denoising. It is derived theoretically with a Gaussian image prior assumption. Synthetic experiments show our network's generalization strength to unseen additive noise levels. We also adapt the fusion denoising network architecture for image denoising on real images. Our approach improves real-world grayscale additive image denoising PSNR results for training noise levels and further on noise levels not seen during training. It also improves state-of-the-art color image denoising performance on every single noise level, by an average of 0.1dB, whether trained on or not.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Denoising | CBSD68 sigma5 | PSNR | 40.05 | CBUIFD75 |
| Denoising | CBSD68 sigma20 | PSNR | 32.02 | CBUIFD75 |
| Denoising | CBSD68 sigma15 | PSNR | 33.66 | CBUIFD75 |
| Denoising | CBSD68 sigma45 | PSNR | 27.28 | CBUIFD75 |
| Denoising | CBSD68 sigma60 | PSNR | 25.34 | CBUIFD75 |
| Denoising | CBSD68 sigma40 | PSNR | 28.01 | CBUIFD75 |
| Denoising | CBSD68 sigma65 | PSNR | 24.75 | CBUIFD75 |
| Denoising | CBSD68 sigma25 | PSNR | 30.76 | CBUIFD75 |
| Denoising | CBSD68 sigma35 | PSNR | 28.81 | CBUIFD75 |
| Denoising | CBSD68 sigma55 | PSNR | 25.95 | CBUIFD75 |
| Denoising | CBSD68 sigma10 | PSNR | 35.98 | CBUIFD75 |
| Denoising | CBSD68 sigma30 | PSNR | 29.71 | CBUIFD75 |
| Denoising | CBSD68 sigma70 | PSNR | 24.18 | CBUIFD75 |
| Denoising | CBSD68 sigma75 | PSNR | 23.63 | CBUIFD75 |
| Denoising | CBSD68 sigma50 | PSNR | 26.6 | CBUIFD75 |
| Denoising | BSD68 sigma65 | PSNR | 23.56 | BUIFD75 (blind) |
| Denoising | BSD68 sigma5 | PSNR | 37.25 | BUIFD75 (blind) |
| Denoising | BSD68 sigma40 | PSNR | 26.31 | BUIFD75 (blind) |
| Denoising | BSD68 sigma75 | PSNR | 22.67 | BUIFD75 (blind) |
| Denoising | BSD68 sigma20 | PSNR | 29.88 | BUIFD75 (blind) |
| Denoising | BSD68 sigma30 | PSNR | 27.82 | BUIFD75 (blind) |
| Denoising | BSD68 sigma15 | PSNR | 31.35 | BUIFD75 (blind) |
| Denoising | BSD68 sigma70 | PSNR | 23.1 | BUIFD75 (blind) |
| Denoising | BSD68 sigma45 | PSNR | 25.67 | BUIFD75 (blind) |
| Denoising | BSD68 sigma25 | PSNR | 28.75 | BUIFD75 (blind) |
| Denoising | BSD68 sigma10 | PSNR | 33.47 | BUIFD75 (blind) |
| Denoising | BSD68 sigma55 | PSNR | 24.55 | BUIFD75 (blind) |
| Denoising | BSD68 sigma35 | PSNR | 27.03 | BUIFD75 (blind) |
| Denoising | BSD68 sigma50 | PSNR | 25.1 | BUIFD75 (blind) |
| Denoising | BSD68 sigma60 | PSNR | 24.05 | BUIFD75 (blind) |
| 3D Architecture | CBSD68 sigma5 | PSNR | 40.05 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma20 | PSNR | 32.02 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma15 | PSNR | 33.66 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma45 | PSNR | 27.28 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma60 | PSNR | 25.34 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma40 | PSNR | 28.01 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma65 | PSNR | 24.75 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma25 | PSNR | 30.76 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma35 | PSNR | 28.81 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma55 | PSNR | 25.95 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma10 | PSNR | 35.98 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma30 | PSNR | 29.71 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma70 | PSNR | 24.18 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma75 | PSNR | 23.63 | CBUIFD75 |
| 3D Architecture | CBSD68 sigma50 | PSNR | 26.6 | CBUIFD75 |
| 3D Architecture | BSD68 sigma65 | PSNR | 23.56 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma5 | PSNR | 37.25 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma40 | PSNR | 26.31 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma75 | PSNR | 22.67 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma20 | PSNR | 29.88 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma30 | PSNR | 27.82 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma15 | PSNR | 31.35 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma70 | PSNR | 23.1 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma45 | PSNR | 25.67 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma25 | PSNR | 28.75 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma10 | PSNR | 33.47 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma55 | PSNR | 24.55 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma35 | PSNR | 27.03 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma50 | PSNR | 25.1 | BUIFD75 (blind) |
| 3D Architecture | BSD68 sigma60 | PSNR | 24.05 | BUIFD75 (blind) |