Xin Tao, Hongyun Gao, Yi Wang, Xiaoyong Shen, Jue Wang, Jiaya Jia
In single image deblurring, the "coarse-to-fine" scheme, i.e. gradually restoring the sharp image on different resolutions in a pyramid, is very successful in both traditional optimization-based methods and recent neural-network-based approaches. In this paper, we investigate this strategy and propose a Scale-recurrent Network (SRN-DeblurNet) for this deblurring task. Compared with the many recent learning-based approaches in [25], it has a simpler network structure, a smaller number of parameters and is easier to train. We evaluate our method on large-scale deblurring datasets with complex motion. Results show that our method can produce better quality results than state-of-the-arts, both quantitatively and qualitatively.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Deblurring | RealBlur-J | PSNR (sRGB) | 31.38 | SRN |
| Deblurring | RealBlur-J | Params(M) | 8.06 | SRN |
| Deblurring | RealBlur-J | SSIM (sRGB) | 0.909 | SRN |
| Deblurring | RealBlur-R | PSNR (sRGB) | 38.65 | SRN |
| Deblurring | RealBlur-R | Params | 8.06 | SRN |
| Deblurring | RealBlur-R | SSIM (sRGB) | 0.965 | SRN |
| Deblurring | GoPro | SSIM | 0.9342 | SRN |
| Deblurring | RealBlur-R (trained on GoPro) | SSIM (sRGB) | 0.947 | SRN |
| Deblurring | RealBlur-J (trained on GoPro) | PSNR (sRGB) | 28.56 | SRN |
| Deblurring | HIDE (trained on GOPRO) | PSNR (sRGB) | 28.36 | SRN |
| Deblurring | HIDE (trained on GOPRO) | Params (M) | 8.06 | SRN |
| Deblurring | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.915 | SRN |
| Deblurring | RSBlur | Average PSNR | 32.53 | SRN-Deblur |
| Image Enhancement | VIDIT’20 validation set | LPIPS | 0.4319 | SRN |
| Image Enhancement | VIDIT’20 validation set | MPS | 0.567 | SRN |
| Image Enhancement | VIDIT’20 validation set | PSNR | 16.94 | SRN |
| Image Enhancement | VIDIT’20 validation set | Runtime(s) | 0.87 | SRN |
| Image Enhancement | VIDIT’20 validation set | SSIM | 0.566 | SRN |
| 2D Classification | RealBlur-J | PSNR (sRGB) | 31.38 | SRN |
| 2D Classification | RealBlur-J | Params(M) | 8.06 | SRN |
| 2D Classification | RealBlur-J | SSIM (sRGB) | 0.909 | SRN |
| 2D Classification | RealBlur-R | PSNR (sRGB) | 38.65 | SRN |
| 2D Classification | RealBlur-R | Params | 8.06 | SRN |
| 2D Classification | RealBlur-R | SSIM (sRGB) | 0.965 | SRN |
| 2D Classification | GoPro | SSIM | 0.9342 | SRN |
| 2D Classification | RealBlur-R (trained on GoPro) | SSIM (sRGB) | 0.947 | SRN |
| 2D Classification | RealBlur-J (trained on GoPro) | PSNR (sRGB) | 28.56 | SRN |
| 2D Classification | HIDE (trained on GOPRO) | PSNR (sRGB) | 28.36 | SRN |
| 2D Classification | HIDE (trained on GOPRO) | Params (M) | 8.06 | SRN |
| 2D Classification | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.915 | SRN |
| 2D Classification | RSBlur | Average PSNR | 32.53 | SRN-Deblur |
| Image Deblurring | GoPro | Params (M) | 8.06 | SRN |
| Image Deblurring | GoPro | SSIM | 0.9342 | SRN |
| 10-shot image generation | RealBlur-J | PSNR (sRGB) | 31.38 | SRN |
| 10-shot image generation | RealBlur-J | Params(M) | 8.06 | SRN |
| 10-shot image generation | RealBlur-J | SSIM (sRGB) | 0.909 | SRN |
| 10-shot image generation | RealBlur-R | PSNR (sRGB) | 38.65 | SRN |
| 10-shot image generation | RealBlur-R | Params | 8.06 | SRN |
| 10-shot image generation | RealBlur-R | SSIM (sRGB) | 0.965 | SRN |
| 10-shot image generation | GoPro | SSIM | 0.9342 | SRN |
| 10-shot image generation | RealBlur-R (trained on GoPro) | SSIM (sRGB) | 0.947 | SRN |
| 10-shot image generation | RealBlur-J (trained on GoPro) | PSNR (sRGB) | 28.56 | SRN |
| 10-shot image generation | HIDE (trained on GOPRO) | PSNR (sRGB) | 28.36 | SRN |
| 10-shot image generation | HIDE (trained on GOPRO) | Params (M) | 8.06 | SRN |
| 10-shot image generation | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.915 | SRN |
| 10-shot image generation | RSBlur | Average PSNR | 32.53 | SRN-Deblur |
| 10-shot image generation | GoPro | Params (M) | 8.06 | SRN |
| 10-shot image generation | GoPro | SSIM | 0.9342 | SRN |
| 1 Image, 2*2 Stitchi | GoPro | Params (M) | 8.06 | SRN |
| 1 Image, 2*2 Stitchi | GoPro | SSIM | 0.9342 | SRN |
| 16k | GoPro | Params (M) | 8.06 | SRN |
| 16k | GoPro | SSIM | 0.9342 | SRN |
| Blind Image Deblurring | RealBlur-J | PSNR (sRGB) | 31.38 | SRN |
| Blind Image Deblurring | RealBlur-J | Params(M) | 8.06 | SRN |
| Blind Image Deblurring | RealBlur-J | SSIM (sRGB) | 0.909 | SRN |
| Blind Image Deblurring | RealBlur-R | PSNR (sRGB) | 38.65 | SRN |
| Blind Image Deblurring | RealBlur-R | Params | 8.06 | SRN |
| Blind Image Deblurring | RealBlur-R | SSIM (sRGB) | 0.965 | SRN |
| Blind Image Deblurring | GoPro | SSIM | 0.9342 | SRN |
| Blind Image Deblurring | RealBlur-R (trained on GoPro) | SSIM (sRGB) | 0.947 | SRN |
| Blind Image Deblurring | RealBlur-J (trained on GoPro) | PSNR (sRGB) | 28.56 | SRN |
| Blind Image Deblurring | HIDE (trained on GOPRO) | PSNR (sRGB) | 28.36 | SRN |
| Blind Image Deblurring | HIDE (trained on GOPRO) | Params (M) | 8.06 | SRN |
| Blind Image Deblurring | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.915 | SRN |
| Blind Image Deblurring | RSBlur | Average PSNR | 32.53 | SRN-Deblur |