Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, Kyoung Mu Lee
Recent research on super-resolution has progressed with the development of deep convolutional neural networks (DCNN). In particular, residual learning techniques exhibit improved performance. In this paper, we develop an enhanced deep super-resolution network (EDSR) with performance exceeding those of current state-of-the-art SR methods. The significant performance improvement of our model is due to optimization by removing unnecessary modules in conventional residual networks. The performance is further improved by expanding the model size while we stabilize the training procedure. We also propose a new multi-scale deep super-resolution system (MDSR) and training method, which can reconstruct high-resolution images of different upscaling factors in a single model. The proposed methods show superior performance over the state-of-the-art methods on benchmark datasets and prove its excellence by winning the NTIRE2017 Super-Resolution Challenge.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Super-Resolution | Set5 - 4x upscaling | PSNR | 32.46 | EDSR |
| Super-Resolution | Set5 - 4x upscaling | SSIM | 0.8968 | EDSR |
| Super-Resolution | Set14 - 4x upscaling | PSNR | 28.8 | EDSR |
| Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7876 | EDSR |
| Super-Resolution | FFHQ 256 x 256 - 4x upscaling | FID | 129.14 | EDSR |
| Super-Resolution | FFHQ 256 x 256 - 4x upscaling | MS-SSIM | 0.901 | EDSR |
| Super-Resolution | FFHQ 256 x 256 - 4x upscaling | PSNR | 22.47 | EDSR |
| Super-Resolution | FFHQ 256 x 256 - 4x upscaling | SSIM | 0.706 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FED | 0.0843 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FID | 20.605 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LLE | 2.003 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LPIPS | 0.2475 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | MS-SSIM | 0.961 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | NIQE | 13.636 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | PSNR | 30.188 | EDSR |
| Super-Resolution | FFHQ 512 x 512 - 4x upscaling | SSIM | 0.824 | EDSR |
| Super-Resolution | DIV2K val - 4x upscaling | PSNR | 29.25 | EDSR |
| Super-Resolution | DIV2K val - 4x upscaling | SSIM | 0.9017 | EDSR |
| Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | FID | 15.54 | EDSR |
| Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | MS-SSIM | 0.933 | EDSR |
| Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | PSNR | 28.34 | EDSR |
| Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | SSIM | 0.827 | EDSR |
| Super-Resolution | Manga109 - 4x upscaling | PSNR | 31.02 | EDSR |
| Super-Resolution | Manga109 - 4x upscaling | SSIM | 0.9148 | EDSR |
| Super-Resolution | Urban100 - 4x upscaling | PSNR | 26.64 | EDSR |
| Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.8033 | EDSR |
| Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.71 | EDSR |
| Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.742 | EDSR |
| Image Restoration | ARAD-1K | MRAE | 0.3277 | EDSR |
| Image Restoration | ARAD-1K | PSNR | 28.29 | EDSR |
| Image Restoration | ARAD-1K | RMSE | 0.0437 | EDSR |
| Image Super-Resolution | Set5 - 4x upscaling | PSNR | 32.46 | EDSR |
| Image Super-Resolution | Set5 - 4x upscaling | SSIM | 0.8968 | EDSR |
| Image Super-Resolution | Set14 - 4x upscaling | PSNR | 28.8 | EDSR |
| Image Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7876 | EDSR |
| Image Super-Resolution | FFHQ 256 x 256 - 4x upscaling | FID | 129.14 | EDSR |
| Image Super-Resolution | FFHQ 256 x 256 - 4x upscaling | MS-SSIM | 0.901 | EDSR |
| Image Super-Resolution | FFHQ 256 x 256 - 4x upscaling | PSNR | 22.47 | EDSR |
| Image Super-Resolution | FFHQ 256 x 256 - 4x upscaling | SSIM | 0.706 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FED | 0.0843 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FID | 20.605 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LLE | 2.003 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LPIPS | 0.2475 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | MS-SSIM | 0.961 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | NIQE | 13.636 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | PSNR | 30.188 | EDSR |
| Image Super-Resolution | FFHQ 512 x 512 - 4x upscaling | SSIM | 0.824 | EDSR |
| Image Super-Resolution | DIV2K val - 4x upscaling | PSNR | 29.25 | EDSR |
| Image Super-Resolution | DIV2K val - 4x upscaling | SSIM | 0.9017 | EDSR |
| Image Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | FID | 15.54 | EDSR |
| Image Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | MS-SSIM | 0.933 | EDSR |
| Image Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | PSNR | 28.34 | EDSR |
| Image Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | SSIM | 0.827 | EDSR |
| Image Super-Resolution | Manga109 - 4x upscaling | PSNR | 31.02 | EDSR |
| Image Super-Resolution | Manga109 - 4x upscaling | SSIM | 0.9148 | EDSR |
| Image Super-Resolution | Urban100 - 4x upscaling | PSNR | 26.64 | EDSR |
| Image Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.8033 | EDSR |
| Image Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.71 | EDSR |
| Image Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.742 | EDSR |
| 10-shot image generation | ARAD-1K | MRAE | 0.3277 | EDSR |
| 10-shot image generation | ARAD-1K | PSNR | 28.29 | EDSR |
| 10-shot image generation | ARAD-1K | RMSE | 0.0437 | EDSR |
| 3D Object Super-Resolution | Set5 - 4x upscaling | PSNR | 32.46 | EDSR |
| 3D Object Super-Resolution | Set5 - 4x upscaling | SSIM | 0.8968 | EDSR |
| 3D Object Super-Resolution | Set14 - 4x upscaling | PSNR | 28.8 | EDSR |
| 3D Object Super-Resolution | Set14 - 4x upscaling | SSIM | 0.7876 | EDSR |
| 3D Object Super-Resolution | FFHQ 256 x 256 - 4x upscaling | FID | 129.14 | EDSR |
| 3D Object Super-Resolution | FFHQ 256 x 256 - 4x upscaling | MS-SSIM | 0.901 | EDSR |
| 3D Object Super-Resolution | FFHQ 256 x 256 - 4x upscaling | PSNR | 22.47 | EDSR |
| 3D Object Super-Resolution | FFHQ 256 x 256 - 4x upscaling | SSIM | 0.706 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FED | 0.0843 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | FID | 20.605 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LLE | 2.003 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | LPIPS | 0.2475 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | MS-SSIM | 0.961 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | NIQE | 13.636 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | PSNR | 30.188 | EDSR |
| 3D Object Super-Resolution | FFHQ 512 x 512 - 4x upscaling | SSIM | 0.824 | EDSR |
| 3D Object Super-Resolution | DIV2K val - 4x upscaling | PSNR | 29.25 | EDSR |
| 3D Object Super-Resolution | DIV2K val - 4x upscaling | SSIM | 0.9017 | EDSR |
| 3D Object Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | FID | 15.54 | EDSR |
| 3D Object Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | MS-SSIM | 0.933 | EDSR |
| 3D Object Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | PSNR | 28.34 | EDSR |
| 3D Object Super-Resolution | FFHQ 1024 x 1024 - 4x upscaling | SSIM | 0.827 | EDSR |
| 3D Object Super-Resolution | Manga109 - 4x upscaling | PSNR | 31.02 | EDSR |
| 3D Object Super-Resolution | Manga109 - 4x upscaling | SSIM | 0.9148 | EDSR |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | PSNR | 26.64 | EDSR |
| 3D Object Super-Resolution | Urban100 - 4x upscaling | SSIM | 0.8033 | EDSR |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | PSNR | 27.71 | EDSR |
| 3D Object Super-Resolution | BSD100 - 4x upscaling | SSIM | 0.742 | EDSR |
| 16k | Set5 - 4x upscaling | PSNR | 32.46 | EDSR |
| 16k | Set5 - 4x upscaling | SSIM | 0.8968 | EDSR |
| 16k | Set14 - 4x upscaling | PSNR | 28.8 | EDSR |
| 16k | Set14 - 4x upscaling | SSIM | 0.7876 | EDSR |
| 16k | FFHQ 256 x 256 - 4x upscaling | FID | 129.14 | EDSR |
| 16k | FFHQ 256 x 256 - 4x upscaling | MS-SSIM | 0.901 | EDSR |
| 16k | FFHQ 256 x 256 - 4x upscaling | PSNR | 22.47 | EDSR |
| 16k | FFHQ 256 x 256 - 4x upscaling | SSIM | 0.706 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | FED | 0.0843 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | FID | 20.605 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | LLE | 2.003 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | LPIPS | 0.2475 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | MS-SSIM | 0.961 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | NIQE | 13.636 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | PSNR | 30.188 | EDSR |
| 16k | FFHQ 512 x 512 - 4x upscaling | SSIM | 0.824 | EDSR |
| 16k | DIV2K val - 4x upscaling | PSNR | 29.25 | EDSR |
| 16k | DIV2K val - 4x upscaling | SSIM | 0.9017 | EDSR |
| 16k | FFHQ 1024 x 1024 - 4x upscaling | FID | 15.54 | EDSR |
| 16k | FFHQ 1024 x 1024 - 4x upscaling | MS-SSIM | 0.933 | EDSR |
| 16k | FFHQ 1024 x 1024 - 4x upscaling | PSNR | 28.34 | EDSR |
| 16k | FFHQ 1024 x 1024 - 4x upscaling | SSIM | 0.827 | EDSR |
| 16k | Manga109 - 4x upscaling | PSNR | 31.02 | EDSR |
| 16k | Manga109 - 4x upscaling | SSIM | 0.9148 | EDSR |
| 16k | Urban100 - 4x upscaling | PSNR | 26.64 | EDSR |
| 16k | Urban100 - 4x upscaling | SSIM | 0.8033 | EDSR |
| 16k | BSD100 - 4x upscaling | PSNR | 27.71 | EDSR |
| 16k | BSD100 - 4x upscaling | SSIM | 0.742 | EDSR |