Xin Gao, Tianheng Qiu, Xinyu Zhang, Hanlin Bai, Kang Liu, Xuan Huang, Hu Wei, Guoying Zhang, Huaping Liu
Coarse-to-fine schemes are widely used in traditional single-image motion deblur; however, in the context of deep learning, existing multi-scale algorithms not only require the use of complex modules for feature fusion of low-scale RGB images and deep semantics, but also manually generate low-resolution pairs of images that do not have sufficient confidence. In this work, we propose a multi-scale network based on single-input and multiple-outputs(SIMO) for motion deblurring. This simplifies the complexity of algorithms based on a coarse-to-fine scheme. To alleviate restoration defects impacting detail information brought about by using a multi-scale architecture, we combine the characteristics of real-world blurring trajectories with a learnable wavelet transform module to focus on the directional continuity and frequency features of the step-by-step transitions between blurred images to sharp images. In conclusion, we propose a multi-scale network with a learnable discrete wavelet transform (MLWNet), which exhibits state-of-the-art performance on multiple real-world deblurred datasets, in terms of both subjective and objective quality as well as computational efficiency.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Deblurring | RealBlur-J | PSNR (sRGB) | 33.84 | MLWNet |
| Deblurring | RealBlur-J | SSIM (sRGB) | 0.941 | MLWNet |
| Deblurring | RealBlur-R | PSNR (sRGB) | 40.69 | MLWNet |
| Deblurring | RealBlur-R | SSIM (sRGB) | 0.976 | MLWNet |
| Deblurring | GoPro | PSNR | 33.83 | MLWNet |
| Deblurring | GoPro | SSIM | 0.968 | MLWNet |
| Deblurring | RSBlur | Average PSNR | 34.94 | MLWNet |
| Deblurring | RSBlur | SSIM | 0.88 | MLWNet |
| 2D Classification | RealBlur-J | PSNR (sRGB) | 33.84 | MLWNet |
| 2D Classification | RealBlur-J | SSIM (sRGB) | 0.941 | MLWNet |
| 2D Classification | RealBlur-R | PSNR (sRGB) | 40.69 | MLWNet |
| 2D Classification | RealBlur-R | SSIM (sRGB) | 0.976 | MLWNet |
| 2D Classification | GoPro | PSNR | 33.83 | MLWNet |
| 2D Classification | GoPro | SSIM | 0.968 | MLWNet |
| 2D Classification | RSBlur | Average PSNR | 34.94 | MLWNet |
| 2D Classification | RSBlur | SSIM | 0.88 | MLWNet |
| 10-shot image generation | RealBlur-J | PSNR (sRGB) | 33.84 | MLWNet |
| 10-shot image generation | RealBlur-J | SSIM (sRGB) | 0.941 | MLWNet |
| 10-shot image generation | RealBlur-R | PSNR (sRGB) | 40.69 | MLWNet |
| 10-shot image generation | RealBlur-R | SSIM (sRGB) | 0.976 | MLWNet |
| 10-shot image generation | GoPro | PSNR | 33.83 | MLWNet |
| 10-shot image generation | GoPro | SSIM | 0.968 | MLWNet |
| 10-shot image generation | RSBlur | Average PSNR | 34.94 | MLWNet |
| 10-shot image generation | RSBlur | SSIM | 0.88 | MLWNet |
| Blind Image Deblurring | RealBlur-J | PSNR (sRGB) | 33.84 | MLWNet |
| Blind Image Deblurring | RealBlur-J | SSIM (sRGB) | 0.941 | MLWNet |
| Blind Image Deblurring | RealBlur-R | PSNR (sRGB) | 40.69 | MLWNet |
| Blind Image Deblurring | RealBlur-R | SSIM (sRGB) | 0.976 | MLWNet |
| Blind Image Deblurring | GoPro | PSNR | 33.83 | MLWNet |
| Blind Image Deblurring | GoPro | SSIM | 0.968 | MLWNet |
| Blind Image Deblurring | RSBlur | Average PSNR | 34.94 | MLWNet |
| Blind Image Deblurring | RSBlur | SSIM | 0.88 | MLWNet |