Max Ehrlich, Larry Davis, Ser-Nam Lim, Abhinav Shrivastava
The JPEG image compression algorithm is the most popular method of image compression because of its ability for large compression ratios. However, to achieve such high compression, information is lost. For aggressive quantization settings, this leads to a noticeable reduction in image quality. Artifact correction has been studied in the context of deep neural networks for some time, but the current state-of-the-art methods require a different model to be trained for each quality setting, greatly limiting their practical application. We solve this problem by creating a novel architecture which is parameterized by the JPEG files quantization matrix. This allows our single model to achieve state-of-the-art performance over models trained for specific quality settings.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Image Restoration | Live1 (Quality 10 Grayscale) | PSNR | 29.53 | QGAC |
| Image Restoration | Live1 (Quality 10 Grayscale) | PSNR-B | 29.15 | QGAC |
| Image Restoration | Live1 (Quality 10 Grayscale) | SSIM | 0.84 | QGAC |
| Image Restoration | Classic5 (Quality 30 Grayscale) | PSNR | 33.22 | QGAC |
| Image Restoration | Classic5 (Quality 30 Grayscale) | PSNR-B | 32.42 | QGAC |
| Image Restoration | Classic5 (Quality 30 Grayscale) | SSIM | 0.907 | QGAC |
| Image Restoration | ICB (Quality 20 Color) | PSNR | 34.23 | QGAC |
| Image Restoration | ICB (Quality 20 Color) | PSNR-B | 34.67 | QGAC |
| Image Restoration | ICB (Quality 20 Color) | SSIM | 0.845 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Color) | PSNR | 31.21 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Color) | PSNR-B | 30.71 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Color) | SSIM | 0.908 | QGAC |
| Image Restoration | LIVE1 (Quality 10 Color) | PSNR | 27.65 | QGAC |
| Image Restoration | LIVE1 (Quality 10 Color) | PSNR-B | 27.4 | QGAC |
| Image Restoration | LIVE1 (Quality 10 Color) | SSIM | 0.819 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Grayscale) | PSNR | 31.79 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Grayscale) | PSNR-B | 30.96 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Grayscale) | SSIM | 0.894 | QGAC |
| Image Restoration | Classic5 (Quality 20 Grayscale) | PSNR | 31.98 | QGAC |
| Image Restoration | Classic5 (Quality 20 Grayscale) | PSNR-B | 31.37 | QGAC |
| Image Restoration | Classic5 (Quality 20 Grayscale) | SSIM | 0.885 | QGAC |
| Image Restoration | ICB (Quality 30 Color) | PSNR | 35.2 | QGAC |
| Image Restoration | ICB (Quality 30 Color) | PSNR-B | 35.67 | QGAC |
| Image Restoration | ICB (Quality 30 Color) | SSIM | 0.86 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Grayscale) | PSNR | 29.54 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Grayscale) | PSNR-B | 29.04 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Grayscale) | SSIM | 0.833 | QGAC |
| Image Restoration | ICB (Quality 30 Grayscale) | PSNR | 38.43 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Grayscale) | PSNR | 33.12 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Grayscale) | PSNR-B | 32.42 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Grayscale) | SSIM | 0.907 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Grayscale) | PSNR | 33.23 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Grayscale) | PSNR-B | 32.5 | QGAC |
| Image Restoration | LIVE1 (Quality 30 Grayscale) | SSIM | 0.925 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Color) | PSNR | 27.69 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Color) | PSNR-B | 27.36 | QGAC |
| Image Restoration | BSDS500 (Quality 10 Color) | SSIM | 0.81 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Color) | PSNR | 29.92 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Color) | PSNR-B | 29.51 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Color) | SSIM | 0.882 | QGAC |
| Image Restoration | ICB (Quality 20 Grayscale) | PSNR | 37.12 | QGAC |
| Image Restoration | ICB (Quality 20 Grayscale) | PSNR-B | 36.88 | QGAC |
| Image Restoration | ICB (Quality 20 Grayscale) | SSIM | 0.924 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Color) | PSNR | 29.89 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Color) | PSNR-B | 29.29 | QGAC |
| Image Restoration | BSDS500 (Quality 20 Color) | SSIM | 0.876 | QGAC |
| Image Restoration | ICB (Quality 10 Grayscale) | PSNR | 34.73 | QGAC |
| Image Restoration | ICB (Quality 10 Grayscale) | PSNR-B | 34.58 | QGAC |
| Image Restoration | ICB (Quality 10 Grayscale) | SSIM | 0.896 | QGAC |
| Image Restoration | ICB (Quality 10 Color) | PSNR | 32.11 | QGAC |
| Image Restoration | ICB (Quality 10 Color) | PSNR-B | 32.47 | QGAC |
| Image Restoration | ICB (Quality 10 Color) | SSIM | 0.815 | QGAC |
| Image Restoration | Classic5 (Quality 10 Grayscale) | PSNR | 29.84 | QGAC |
| Image Restoration | Classic5 (Quality 10 Grayscale) | PSNR-B | 29.43 | QGAC |
| Image Restoration | Classic5 (Quality 10 Grayscale) | SSIM | 0.837 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | PSNR | 31.86 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | PSNR-B | 31.27 | QGAC |
| Image Restoration | LIVE1 (Quality 20 Grayscale) | SSIM | 0.901 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Color) | PSNR | 31.15 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Color) | PSNR-B | 30.37 | QGAC |
| Image Restoration | BSDS500 (Quality 30 Color) | SSIM | 0.903 | QGAC |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | PSNR | 29.53 | QGAC |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | PSNR-B | 29.15 | QGAC |
| 10-shot image generation | Live1 (Quality 10 Grayscale) | SSIM | 0.84 | QGAC |
| 10-shot image generation | Classic5 (Quality 30 Grayscale) | PSNR | 33.22 | QGAC |
| 10-shot image generation | Classic5 (Quality 30 Grayscale) | PSNR-B | 32.42 | QGAC |
| 10-shot image generation | Classic5 (Quality 30 Grayscale) | SSIM | 0.907 | QGAC |
| 10-shot image generation | ICB (Quality 20 Color) | PSNR | 34.23 | QGAC |
| 10-shot image generation | ICB (Quality 20 Color) | PSNR-B | 34.67 | QGAC |
| 10-shot image generation | ICB (Quality 20 Color) | SSIM | 0.845 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Color) | PSNR | 31.21 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Color) | PSNR-B | 30.71 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Color) | SSIM | 0.908 | QGAC |
| 10-shot image generation | LIVE1 (Quality 10 Color) | PSNR | 27.65 | QGAC |
| 10-shot image generation | LIVE1 (Quality 10 Color) | PSNR-B | 27.4 | QGAC |
| 10-shot image generation | LIVE1 (Quality 10 Color) | SSIM | 0.819 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Grayscale) | PSNR | 31.79 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Grayscale) | PSNR-B | 30.96 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Grayscale) | SSIM | 0.894 | QGAC |
| 10-shot image generation | Classic5 (Quality 20 Grayscale) | PSNR | 31.98 | QGAC |
| 10-shot image generation | Classic5 (Quality 20 Grayscale) | PSNR-B | 31.37 | QGAC |
| 10-shot image generation | Classic5 (Quality 20 Grayscale) | SSIM | 0.885 | QGAC |
| 10-shot image generation | ICB (Quality 30 Color) | PSNR | 35.2 | QGAC |
| 10-shot image generation | ICB (Quality 30 Color) | PSNR-B | 35.67 | QGAC |
| 10-shot image generation | ICB (Quality 30 Color) | SSIM | 0.86 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Grayscale) | PSNR | 29.54 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Grayscale) | PSNR-B | 29.04 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Grayscale) | SSIM | 0.833 | QGAC |
| 10-shot image generation | ICB (Quality 30 Grayscale) | PSNR | 38.43 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Grayscale) | PSNR | 33.12 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Grayscale) | PSNR-B | 32.42 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Grayscale) | SSIM | 0.907 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Grayscale) | PSNR | 33.23 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Grayscale) | PSNR-B | 32.5 | QGAC |
| 10-shot image generation | LIVE1 (Quality 30 Grayscale) | SSIM | 0.925 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Color) | PSNR | 27.69 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Color) | PSNR-B | 27.36 | QGAC |
| 10-shot image generation | BSDS500 (Quality 10 Color) | SSIM | 0.81 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Color) | PSNR | 29.92 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Color) | PSNR-B | 29.51 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Color) | SSIM | 0.882 | QGAC |
| 10-shot image generation | ICB (Quality 20 Grayscale) | PSNR | 37.12 | QGAC |
| 10-shot image generation | ICB (Quality 20 Grayscale) | PSNR-B | 36.88 | QGAC |
| 10-shot image generation | ICB (Quality 20 Grayscale) | SSIM | 0.924 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Color) | PSNR | 29.89 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Color) | PSNR-B | 29.29 | QGAC |
| 10-shot image generation | BSDS500 (Quality 20 Color) | SSIM | 0.876 | QGAC |
| 10-shot image generation | ICB (Quality 10 Grayscale) | PSNR | 34.73 | QGAC |
| 10-shot image generation | ICB (Quality 10 Grayscale) | PSNR-B | 34.58 | QGAC |
| 10-shot image generation | ICB (Quality 10 Grayscale) | SSIM | 0.896 | QGAC |
| 10-shot image generation | ICB (Quality 10 Color) | PSNR | 32.11 | QGAC |
| 10-shot image generation | ICB (Quality 10 Color) | PSNR-B | 32.47 | QGAC |
| 10-shot image generation | ICB (Quality 10 Color) | SSIM | 0.815 | QGAC |
| 10-shot image generation | Classic5 (Quality 10 Grayscale) | PSNR | 29.84 | QGAC |
| 10-shot image generation | Classic5 (Quality 10 Grayscale) | PSNR-B | 29.43 | QGAC |
| 10-shot image generation | Classic5 (Quality 10 Grayscale) | SSIM | 0.837 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | PSNR | 31.86 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | PSNR-B | 31.27 | QGAC |
| 10-shot image generation | LIVE1 (Quality 20 Grayscale) | SSIM | 0.901 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Color) | PSNR | 31.15 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Color) | PSNR-B | 30.37 | QGAC |
| 10-shot image generation | BSDS500 (Quality 30 Color) | SSIM | 0.903 | QGAC |