Bolun Zheng, Yaowu Chen, Xiang Tian, Fan Zhou, Xuesong Liu
Several dual-domain convolutional neural network-based methods show outstanding performance in reducing image compression artifacts. However, they suffer from handling color images because the compression processes for gray-scale and color images are completely different. Moreover, these methods train a specific model for each compression quality and require multiple models to achieve different compression qualities. To address these problems, we proposed an implicit dual-domain convolutional network (IDCN) with the pixel position labeling map and the quantization tables as inputs. Specifically, we proposed an extractor-corrector framework-based dual-domain correction unit (DCU) as the basic component to formulate the IDCN. A dense block was introduced to improve the performance of extractor in DRU. The implicit dual-domain translation allows the IDCN to handle color images with the discrete cosine transform (DCT)-domain priors. A flexible version of IDCN (IDCN-f) was developed to handle a wide range of compression qualities. Experiments for both objective and subjective evaluations on benchmark datasets show that IDCN is superior to the state-of-the-art methods and IDCN-f exhibits excellent abilities to handle a wide range of compression qualities with little performance sacrifice and demonstrates great potential for practical applications.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Image Restoration | Live1 (Quality 10 Grayscale) | PSNR | 29.71 | IDCN |
| Image Restoration | Live1 (Quality 10 Grayscale) | PSNR-B | 29.66 | IDCN |
| Image Restoration | Live1 (Quality 10 Grayscale) | SSIM | 0.838 | IDCN |
| Image Restoration | ICB (Quality 20 Color) | PSNR | 33.99 | IDCN |
| Image Restoration | ICB (Quality 20 Color) | PSNR-B | 34.37 | IDCN |
| Image Restoration | ICB (Quality 20 Color) | SSIM | 0.838 | IDCN |
| Image Restoration | LIVE1 (Quality 10 Color) | PSNR | 27.63 | IDCN |
| Image Restoration | LIVE1 (Quality 10 Color) | PSNR-B | 27.63 | IDCN |
| Image Restoration | LIVE1 (Quality 10 Color) | SSIM | 0.816 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Color) | PSNR | 30.04 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Color) | PSNR-B | 30.01 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Color) | SSIM | 0.882 | IDCN |
| Image Restoration | ICB (Quality 20 Grayscale) | PSNR | 34.3 | IDCN |
| Image Restoration | ICB (Quality 20 Grayscale) | PSNR-B | 34.18 | IDCN |
| Image Restoration | ICB (Quality 20 Grayscale) | SSIM | 0.851 | IDCN |
| Image Restoration | ICB (Quality 10 Grayscale) | PSNR | 32.5 | IDCN |
| Image Restoration | ICB (Quality 10 Grayscale) | PSNR-B | 32.42 | IDCN |
| Image Restoration | ICB (Quality 10 Grayscale) | SSIM | 0.826 | IDCN |
| Image Restoration | ICB (Quality 10 Color) | PSNR | 31.71 | IDCN |
| Image Restoration | ICB (Quality 10 Color) | PSNR-B | 32.02 | IDCN |
| Image Restoration | ICB (Quality 10 Color) | SSIM | 0.809 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | PSNR | 32.09 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | PSNR-B | 32 | IDCN |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | SSIM | 0.9006 | IDCN |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | PSNR | 29.71 | IDCN |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | PSNR-B | 29.66 | IDCN |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | SSIM | 0.838 | IDCN |
| 10-shot image generation | ICB (Quality 20 Color) | PSNR | 33.99 | IDCN |
| 10-shot image generation | ICB (Quality 20 Color) | PSNR-B | 34.37 | IDCN |
| 10-shot image generation | ICB (Quality 20 Color) | SSIM | 0.838 | IDCN |
| 10-shot image generation | LIVE1 (Quality 10 Color) | PSNR | 27.63 | IDCN |
| 10-shot image generation | LIVE1 (Quality 10 Color) | PSNR-B | 27.63 | IDCN |
| 10-shot image generation | LIVE1 (Quality 10 Color) | SSIM | 0.816 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Color) | PSNR | 30.04 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Color) | PSNR-B | 30.01 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Color) | SSIM | 0.882 | IDCN |
| 10-shot image generation | ICB (Quality 20 Grayscale) | PSNR | 34.3 | IDCN |
| 10-shot image generation | ICB (Quality 20 Grayscale) | PSNR-B | 34.18 | IDCN |
| 10-shot image generation | ICB (Quality 20 Grayscale) | SSIM | 0.851 | IDCN |
| 10-shot image generation | ICB (Quality 10 Grayscale) | PSNR | 32.5 | IDCN |
| 10-shot image generation | ICB (Quality 10 Grayscale) | PSNR-B | 32.42 | IDCN |
| 10-shot image generation | ICB (Quality 10 Grayscale) | SSIM | 0.826 | IDCN |
| 10-shot image generation | ICB (Quality 10 Color) | PSNR | 31.71 | IDCN |
| 10-shot image generation | ICB (Quality 10 Color) | PSNR-B | 32.02 | IDCN |
| 10-shot image generation | ICB (Quality 10 Color) | SSIM | 0.809 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | PSNR | 32.09 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | PSNR-B | 32 | IDCN |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | SSIM | 0.9006 | IDCN |