Kai Zhang, WangMeng Zuo, Lei Zhang
Due to the fast inference and good performance, discriminative learning methods have been widely studied in image denoising. However, these methods mostly learn a specific model for each noise level, and require multiple models for denoising images with different noise levels. They also lack flexibility to deal with spatially variant noise, limiting their applications in practical denoising. To address these issues, we present a fast and flexible denoising convolutional neural network, namely FFDNet, with a tunable noise level map as the input. The proposed FFDNet works on downsampled sub-images, achieving a good trade-off between inference speed and denoising performance. In contrast to the existing discriminative denoisers, FFDNet enjoys several desirable properties, including (i) the ability to handle a wide range of noise levels (i.e., [0, 75]) effectively with a single network, (ii) the ability to remove spatially variant noise by specifying a non-uniform noise level map, and (iii) faster speed than benchmark BM3D even on CPU without sacrificing denoising performance. Extensive experiments on synthetic and real noisy images are conducted to evaluate FFDNet in comparison with state-of-the-art denoisers. The results show that FFDNet is effective and efficient, making it highly attractive for practical denoising applications.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Denoising | Darmstadt Noise Dataset | PSNR | 34.4 | FFDNet |
| Denoising | McMaster sigma75 | PSNR | 27.33 | FFDNet |
| Denoising | McMaster sigma35 | PSNR | 30.81 | FFDNet |
| Denoising | CBSD68 sigma15 | PSNR | 33.87 | FFDNet |
| Denoising | McMaster sigma25 | PSNR | 32.35 | FFDNet |
| Denoising | McMaster sigma15 | PSNR | 34.66 | FFDNet |
| Denoising | Kodak25 sigma35 | PSNR | 30.57 | FFDNet |
| Denoising | CBSD68 sigma25 | PSNR | 31.21 | FFDNet |
| Denoising | CBSD68 sigma35 | PSNR | 29.58 | FFDNet |
| Denoising | Kodak25 sigma25 | PSNR | 32.13 | FFDNet |
| Denoising | Kodak25 sigma50 | PSNR | 28.98 | FFDNet |
| Denoising | Kodak25 sigma15 | PSNR | 34.63 | FFDNet |
| Denoising | urban100 sigma15 | Average PSNR | 33.83 | FFDNet |
| Denoising | McMaster sigma50 | PSNR | 29.18 | FFDNet |
| Denoising | Kodak25 sigma75 | PSNR | 27.27 | FFDNet |
| Denoising | CBSD68 sigma75 | PSNR | 26.24 | FFDNet |
| Denoising | CBSD68 sigma50 | PSNR | 27.96 | FFDNet |
| Denoising | Clip300 sigma25 | PSNR | 29.25 | FFDNet-Clip |
| Denoising | BSD68 sigma75 | PSNR | 24.79 | FFDNet |
| Denoising | Set12 sigma15 | PSNR | 25.49 | FFDNet |
| Denoising | Clip300 sigma50 | PSNR | 26.25 | FFDNet-Clip |
| Denoising | BSD68 sigma15 | PSNR | 31.63 | FFDNet |
| Denoising | BSD68 sigma25 | PSNR | 29.19 | FFDNet |
| Denoising | Clip300 sigma15 | PSNR | 31.68 | FFDNet-Clip |
| Denoising | Clip300 sigma35 | PSNR | 27.75 | FFDNet-Clip |
| Denoising | BSD68 sigma35 | PSNR | 27.73 | FFDNet |
| Denoising | BSD68 sigma50 | PSNR | 26.29 | FFDNet |
| Denoising | Clip300 sigma60 | PSNR | 25.51 | FFDNet-Clip |
| 3D Architecture | Darmstadt Noise Dataset | PSNR | 34.4 | FFDNet |
| 3D Architecture | McMaster sigma75 | PSNR | 27.33 | FFDNet |
| 3D Architecture | McMaster sigma35 | PSNR | 30.81 | FFDNet |
| 3D Architecture | CBSD68 sigma15 | PSNR | 33.87 | FFDNet |
| 3D Architecture | McMaster sigma25 | PSNR | 32.35 | FFDNet |
| 3D Architecture | McMaster sigma15 | PSNR | 34.66 | FFDNet |
| 3D Architecture | Kodak25 sigma35 | PSNR | 30.57 | FFDNet |
| 3D Architecture | CBSD68 sigma25 | PSNR | 31.21 | FFDNet |
| 3D Architecture | CBSD68 sigma35 | PSNR | 29.58 | FFDNet |
| 3D Architecture | Kodak25 sigma25 | PSNR | 32.13 | FFDNet |
| 3D Architecture | Kodak25 sigma50 | PSNR | 28.98 | FFDNet |
| 3D Architecture | Kodak25 sigma15 | PSNR | 34.63 | FFDNet |
| 3D Architecture | urban100 sigma15 | Average PSNR | 33.83 | FFDNet |
| 3D Architecture | McMaster sigma50 | PSNR | 29.18 | FFDNet |
| 3D Architecture | Kodak25 sigma75 | PSNR | 27.27 | FFDNet |
| 3D Architecture | CBSD68 sigma75 | PSNR | 26.24 | FFDNet |
| 3D Architecture | CBSD68 sigma50 | PSNR | 27.96 | FFDNet |
| 3D Architecture | Clip300 sigma25 | PSNR | 29.25 | FFDNet-Clip |
| 3D Architecture | BSD68 sigma75 | PSNR | 24.79 | FFDNet |
| 3D Architecture | Set12 sigma15 | PSNR | 25.49 | FFDNet |
| 3D Architecture | Clip300 sigma50 | PSNR | 26.25 | FFDNet-Clip |
| 3D Architecture | BSD68 sigma15 | PSNR | 31.63 | FFDNet |
| 3D Architecture | BSD68 sigma25 | PSNR | 29.19 | FFDNet |
| 3D Architecture | Clip300 sigma15 | PSNR | 31.68 | FFDNet-Clip |
| 3D Architecture | Clip300 sigma35 | PSNR | 27.75 | FFDNet-Clip |
| 3D Architecture | BSD68 sigma35 | PSNR | 27.73 | FFDNet |
| 3D Architecture | BSD68 sigma50 | PSNR | 26.29 | FFDNet |
| 3D Architecture | Clip300 sigma60 | PSNR | 25.51 | FFDNet-Clip |