Kai Zhang, WangMeng Zuo, Yunjin Chen, Deyu Meng, Lei Zhang
Discriminative model learning for image denoising has been recently attracting considerable attentions due to its favorable denoising performance. In this paper, we take one step forward by investigating the construction of feed-forward denoising convolutional neural networks (DnCNNs) to embrace the progress in very deep architecture, learning algorithm, and regularization method into image denoising. Specifically, residual learning and batch normalization are utilized to speed up the training process as well as boost the denoising performance. Different from the existing discriminative denoising models which usually train a specific model for additive white Gaussian noise (AWGN) at a certain noise level, our DnCNN model is able to handle Gaussian denoising with unknown noise level (i.e., blind Gaussian denoising). With the residual learning strategy, DnCNN implicitly removes the latent clean image in the hidden layers. This property motivates us to train a single DnCNN model to tackle with several general image denoising tasks such as Gaussian denoising, single image super-resolution and JPEG image deblocking. Our extensive experiments demonstrate that our DnCNN model can not only exhibit high effectiveness in several general image denoising tasks, but also be efficiently implemented by benefiting from GPU computing.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Super-Resolution | BSD100 - 2x upscaling | PSNR | 31.9 | DnCNN-3 |
| Super-Resolution | Set14 - 3x upscaling | PSNR | 29.81 | DnCNN-3 |
| Super-Resolution | Set14 - 2x upscaling | PSNR | 33.03 | DnCNN-3 |
| Super-Resolution | Set14 - 4x upscaling | PSNR | 28.04 | DnCNN-3 |
| Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7672 | DnCNN-3 |
| Super-Resolution | Set5 - 3x upscaling | PSNR | 33.75 | DnCNN-3 |
| Super-Resolution | Urban100 - 2x upscaling | PSNR | 30.74 | DnCNN-3 |
| Super-Resolution | Set5 - 2x upscaling | PSNR | 37.58 | DnCNN-3 |
| Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.2 | DnCNN-3 |
| Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.7521 | DnCNN-3 |
| Super-Resolution | Urban100 - 3x upscaling | PSNR | 27.15 | DnCNN-3 |
| Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.29 | DnCNN-3 |
| Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.7253 | DnCNN-3 |
| Super-Resolution | BSD100 - 3x upscaling | PSNR | 28.85 | DnCNN-3 |
| Image Restoration | Live1 (Quality 10 Grayscale) | PSNR | 29.19 | DnCNN-3 |
| Image Restoration | Classic5 (Quality 30 Grayscale) | PSNR | 32.91 | DnCNN-3 |
| Image Restoration | LIVE1 (Quality 40 Grayscale) | PSNR | 33.96 | DnCNN-3 |
| Image Restoration | Classic5 (Quality 40 Grayscale) | PSNR | 33.77 | DnCNN-3 |
| Image Restoration | Classic5 (Quality 20 Grayscale) | PSNR | 31.63 | DnCNN-3 |
| Image Restoration | LIVE1 (Quality 30 Grayscale) | PSNR | 32.98 | DnCNN-3 |
| Image Restoration | Classic5 (Quality 10 Grayscale) | PSNR | 29.4 | DnCNN-3 |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | PSNR | 31.59 | DnCNN-3 |
| Denoising | Darmstadt Noise Dataset | PSNR | 32.43 | CDnCNN-B |
| Denoising | BSD68 sigma15 | PSNR | 31.46 | DnCNN-3 |
| Denoising | CBSD68 sigma35 | PSNR | 28.74 | DnCNN-B* |
| Denoising | BSD68 sigma25 | PSNR | 29.02 | DnCNN-3 |
| Denoising | urban100 sigma15 | Average PSNR | 32.98 | DnCNN |
| Denoising | Urban100 sigma25 | PSNR | 29.97 | DnCNN |
| Denoising | Urban100 sigma15 | PSNR | 32.67 | DnCNN |
| Denoising | BSD68 sigma25 | PSNR | 29.23 | DnCNN |
| Image Super-Resolution | BSD100 - 2x upscaling | PSNR | 31.9 | DnCNN-3 |
| Image Super-Resolution | Set14 - 3x upscaling | PSNR | 29.81 | DnCNN-3 |
| Image Super-Resolution | Set14 - 2x upscaling | PSNR | 33.03 | DnCNN-3 |
| Image Super-Resolution | Set14 - 4x upscaling | PSNR | 28.04 | DnCNN-3 |
| Image Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7672 | DnCNN-3 |
| Image Super-Resolution | Set5 - 3x upscaling | PSNR | 33.75 | DnCNN-3 |
| Image Super-Resolution | Urban100 - 2x upscaling | PSNR | 30.74 | DnCNN-3 |
| Image Super-Resolution | Set5 - 2x upscaling | PSNR | 37.58 | DnCNN-3 |
| Image Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.2 | DnCNN-3 |
| Image Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.7521 | DnCNN-3 |
| Image Super-Resolution | Urban100 - 3x upscaling | PSNR | 27.15 | DnCNN-3 |
| Image Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.29 | DnCNN-3 |
| Image Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.7253 | DnCNN-3 |
| Image Super-Resolution | BSD100 - 3x upscaling | PSNR | 28.85 | DnCNN-3 |
| 3D Architecture | Darmstadt Noise Dataset | PSNR | 32.43 | CDnCNN-B |
| 3D Architecture | BSD68 sigma15 | PSNR | 31.46 | DnCNN-3 |
| 3D Architecture | CBSD68 sigma35 | PSNR | 28.74 | DnCNN-B* |
| 3D Architecture | BSD68 sigma25 | PSNR | 29.02 | DnCNN-3 |
| 3D Architecture | urban100 sigma15 | Average PSNR | 32.98 | DnCNN |
| 3D Architecture | Urban100 sigma25 | PSNR | 29.97 | DnCNN |
| 3D Architecture | Urban100 sigma15 | PSNR | 32.67 | DnCNN |
| 3D Architecture | BSD68 sigma25 | PSNR | 29.23 | DnCNN |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | PSNR | 29.19 | DnCNN-3 |
| 10-shot image generation | Classic5 (Quality 30 Grayscale) | PSNR | 32.91 | DnCNN-3 |
| 10-shot image generation | LIVE1 (Quality 40 Grayscale) | PSNR | 33.96 | DnCNN-3 |
| 10-shot image generation | Classic5 (Quality 40 Grayscale) | PSNR | 33.77 | DnCNN-3 |
| 10-shot image generation | Classic5 (Quality 20 Grayscale) | PSNR | 31.63 | DnCNN-3 |
| 10-shot image generation | LIVE1 (Quality 30 Grayscale) | PSNR | 32.98 | DnCNN-3 |
| 10-shot image generation | Classic5 (Quality 10 Grayscale) | PSNR | 29.4 | DnCNN-3 |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | PSNR | 31.59 | DnCNN-3 |
| 3D Object Super-Resolution | BSD100 - 2x upscaling | PSNR | 31.9 | DnCNN-3 |
| 3D Object Super-Resolution | Set14 - 3x upscaling | PSNR | 29.81 | DnCNN-3 |
| 3D Object Super-Resolution | Set14 - 2x upscaling | PSNR | 33.03 | DnCNN-3 |
| 3D Object Super-Resolution | Set14 - 4x upscaling | PSNR | 28.04 | DnCNN-3 |
| 3D Object Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7672 | DnCNN-3 |
| 3D Object Super-Resolution | Set5 - 3x upscaling | PSNR | 33.75 | DnCNN-3 |
| 3D Object Super-Resolution | Urban100 - 2x upscaling | PSNR | 30.74 | DnCNN-3 |
| 3D Object Super-Resolution | Set5 - 2x upscaling | PSNR | 37.58 | DnCNN-3 |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.2 | DnCNN-3 |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.7521 | DnCNN-3 |
| 3D Object Super-Resolution | Urban100 - 3x upscaling | PSNR | 27.15 | DnCNN-3 |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.29 | DnCNN-3 |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.7253 | DnCNN-3 |
| 3D Object Super-Resolution | BSD100 - 3x upscaling | PSNR | 28.85 | DnCNN-3 |
| 16k | BSD100 - 2x upscaling | PSNR | 31.9 | DnCNN-3 |
| 16k | Set14 - 3x upscaling | PSNR | 29.81 | DnCNN-3 |
| 16k | Set14 - 2x upscaling | PSNR | 33.03 | DnCNN-3 |
| 16k | Set14 - 4x upscaling | PSNR | 28.04 | DnCNN-3 |
| 16k | Set14 - 4x upscaling | SSIM | 0.7672 | DnCNN-3 |
| 16k | Set5 - 3x upscaling | PSNR | 33.75 | DnCNN-3 |
| 16k | Urban100 - 2x upscaling | PSNR | 30.74 | DnCNN-3 |
| 16k | Set5 - 2x upscaling | PSNR | 37.58 | DnCNN-3 |
| 16k | Urban100 - 4x upscaling | PSNR | 25.2 | DnCNN-3 |
| 16k | Urban100 - 4x upscaling | SSIM | 0.7521 | DnCNN-3 |
| 16k | Urban100 - 3x upscaling | PSNR | 27.15 | DnCNN-3 |
| 16k | BSD100 - 4x upscaling | PSNR | 27.29 | DnCNN-3 |
| 16k | BSD100 - 4x upscaling | SSIM | 0.7253 | DnCNN-3 |
| 16k | BSD100 - 3x upscaling | PSNR | 28.85 | DnCNN-3 |