Fu-Jen Tsai, Yan-Tsung Peng, Yen-Yu Lin, Chung-Chi Tsai, Chia-Wen Lin
Image motion blur results from a combination of object motions and camera shakes, and such blurring effect is generally directional and non-uniform. Previous research attempted to solve non-uniform blurs using self-recurrent multiscale, multi-patch, or multi-temporal architectures with self-attention to obtain decent results. However, using self-recurrent frameworks typically lead to a longer inference time, while inter-pixel or inter-channel self-attention may cause excessive memory usage. This paper proposes a Blur-aware Attention Network (BANet), that accomplishes accurate and efficient deblurring via a single forward pass. Our BANet utilizes region-based self-attention with multi-kernel strip pooling to disentangle blur patterns of different magnitudes and orientations and cascaded parallel dilated convolution to aggregate multi-scale content features. Extensive experimental results on the GoPro and RealBlur benchmarks demonstrate that the proposed BANet performs favorably against the state-of-the-arts in blurred image restoration and can provide deblurred results in real-time.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Deblurring | RealBlur-J | PSNR (sRGB) | 32 | BANet |
| Deblurring | RealBlur-J | SSIM (sRGB) | 0.923 | BANet |
| Deblurring | RealBlur-R | PSNR (sRGB) | 39.55 | BANet |
| Deblurring | RealBlur-R | SSIM (sRGB) | 0.971 | BANet |
| Deblurring | GoPro | PSNR | 32.54 | BANet |
| Deblurring | GoPro | SSIM | 0.957 | BANet |
| Deblurring | HIDE (trained on GOPRO) | PSNR (sRGB) | 30.16 | BANet |
| Deblurring | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.93 | BANet |
| 2D Classification | RealBlur-J | PSNR (sRGB) | 32 | BANet |
| 2D Classification | RealBlur-J | SSIM (sRGB) | 0.923 | BANet |
| 2D Classification | RealBlur-R | PSNR (sRGB) | 39.55 | BANet |
| 2D Classification | RealBlur-R | SSIM (sRGB) | 0.971 | BANet |
| 2D Classification | GoPro | PSNR | 32.54 | BANet |
| 2D Classification | GoPro | SSIM | 0.957 | BANet |
| 2D Classification | HIDE (trained on GOPRO) | PSNR (sRGB) | 30.16 | BANet |
| 2D Classification | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.93 | BANet |
| Image Deblurring | GoPro | SSIM | 0.957 | BANet |
| 10-shot image generation | RealBlur-J | PSNR (sRGB) | 32 | BANet |
| 10-shot image generation | RealBlur-J | SSIM (sRGB) | 0.923 | BANet |
| 10-shot image generation | RealBlur-R | PSNR (sRGB) | 39.55 | BANet |
| 10-shot image generation | RealBlur-R | SSIM (sRGB) | 0.971 | BANet |
| 10-shot image generation | GoPro | PSNR | 32.54 | BANet |
| 10-shot image generation | GoPro | SSIM | 0.957 | BANet |
| 10-shot image generation | HIDE (trained on GOPRO) | PSNR (sRGB) | 30.16 | BANet |
| 10-shot image generation | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.93 | BANet |
| 10-shot image generation | GoPro | SSIM | 0.957 | BANet |
| 1 Image, 2*2 Stitchi | GoPro | SSIM | 0.957 | BANet |
| 16k | GoPro | SSIM | 0.957 | BANet |
| Blind Image Deblurring | RealBlur-J | PSNR (sRGB) | 32 | BANet |
| Blind Image Deblurring | RealBlur-J | SSIM (sRGB) | 0.923 | BANet |
| Blind Image Deblurring | RealBlur-R | PSNR (sRGB) | 39.55 | BANet |
| Blind Image Deblurring | RealBlur-R | SSIM (sRGB) | 0.971 | BANet |
| Blind Image Deblurring | GoPro | PSNR | 32.54 | BANet |
| Blind Image Deblurring | GoPro | SSIM | 0.957 | BANet |
| Blind Image Deblurring | HIDE (trained on GOPRO) | PSNR (sRGB) | 30.16 | BANet |
| Blind Image Deblurring | HIDE (trained on GOPRO) | SSIM (sRGB) | 0.93 | BANet |