Wei-Sheng Lai, Jia-Bin Huang, Narendra Ahuja, Ming-Hsuan Yang
Convolutional neural networks have recently demonstrated high-quality reconstruction for single-image super-resolution. In this paper, we propose the Laplacian Pyramid Super-Resolution Network (LapSRN) to progressively reconstruct the sub-band residuals of high-resolution images. At each pyramid level, our model takes coarse-resolution feature maps as input, predicts the high-frequency residuals, and uses transposed convolutions for upsampling to the finer level. Our method does not require the bicubic interpolation as the pre-processing step and thus dramatically reduces the computational complexity. We train the proposed LapSRN with deep supervision using a robust Charbonnier loss function and achieve high-quality reconstruction. Furthermore, our network generates multi-scale predictions in one feed-forward pass through the progressive reconstruction, thereby facilitates resource-aware applications. Extensive quantitative and qualitative evaluations on benchmark datasets show that the proposed algorithm performs favorably against the state-of-the-art methods in terms of speed and accuracy.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Super-Resolution | Set14 - 4x upscaling | PSNR | 28.19 | LapSR |
| Super-Resolution | Set14 - 4x upscaling | SSIM | 0.772 | LapSR |
| Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.21 | LapSRN |
| Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.756 | LapSRN |
| Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.32 | LapSRN |
| Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.728 | LapSRN |
| Image Super-Resolution | Set14 - 4x upscaling | PSNR | 28.19 | LapSR |
| Image Super-Resolution | Set14 - 4x upscaling | SSIM | 0.772 | LapSR |
| Image Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.21 | LapSRN |
| Image Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.756 | LapSRN |
| Image Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.32 | LapSRN |
| Image Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.728 | LapSRN |
| 3D Object Super-Resolution | Set14 - 4x upscaling | PSNR | 28.19 | LapSR |
| 3D Object Super-Resolution | Set14 - 4x upscaling | SSIM | 0.772 | LapSR |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | PSNR | 25.21 | LapSRN |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.756 | LapSRN |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.32 | LapSRN |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.728 | LapSRN |
| 16k | Set14 - 4x upscaling | PSNR | 28.19 | LapSR |
| 16k | Set14 - 4x upscaling | SSIM | 0.772 | LapSR |
| 16k | Urban100 - 4x upscaling | PSNR | 25.21 | LapSRN |
| 16k | Urban100 - 4x upscaling | SSIM | 0.756 | LapSRN |
| 16k | BSD100 - 4x upscaling | PSNR | 27.32 | LapSRN |
| 16k | BSD100 - 4x upscaling | SSIM | 0.728 | LapSRN |