TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Towards Flexible Blind JPEG Artifacts Removal

Towards Flexible Blind JPEG Artifacts Removal

Jiaxi Jiang, Kai Zhang, Radu Timofte

2021-09-29ICCV 2021 10Image DenoisingImage ForensicsImage RestorationJPEG Artifact CorrectionImage Compression
PaperPDFCode(official)Code

Abstract

Training a single deep blind model to handle different quality factors for JPEG image artifacts removal has been attracting considerable attention due to its convenience for practical usage. However, existing deep blind methods usually directly reconstruct the image without predicting the quality factor, thus lacking the flexibility to control the output as the non-blind methods. To remedy this problem, in this paper, we propose a flexible blind convolutional neural network, namely FBCNN, that can predict the adjustable quality factor to control the trade-off between artifacts removal and details preservation. Specifically, FBCNN decouples the quality factor from the JPEG image via a decoupler module and then embeds the predicted quality factor into the subsequent reconstructor module through a quality factor attention block for flexible control. Besides, we find existing methods are prone to fail on non-aligned double JPEG images even with only a one-pixel shift, and we thus propose a double JPEG degradation model to augment the training data. Extensive experiments on single JPEG images, more general double JPEG images, and real-world JPEG images demonstrate that our proposed FBCNN achieves favorable performance against state-of-the-art methods in terms of both quantitative metrics and visual quality.

Results

TaskDatasetMetricValueModel
Image RestorationLive1 (Quality 10 Grayscale)PSNR29.75FBCNN
Image RestorationLive1 (Quality 10 Grayscale)PSNR-B29.4FBCNN
Image RestorationLive1 (Quality 10 Grayscale)SSIM0.827FBCNN
Image RestorationClassic5 (Quality 30 Grayscale)PSNR33.54FBCNN
Image RestorationClassic5 (Quality 30 Grayscale)PSNR-B32.78FBCNN
Image RestorationClassic5 (Quality 30 Grayscale)SSIM0.894FBCNN
Image RestorationLIVE1 (Quality 40 Grayscale)PSNR34.53FBCNN
Image RestorationLIVE1 (Quality 40 Grayscale)SSIM0.931FBCNN
Image RestorationICB (Quality 20 Color)PSNR34.38FBCNN
Image RestorationICB (Quality 20 Color)PSNR-B34.34FBCNN
Image RestorationICB (Quality 20 Color)SSIM0.844FBCNN
Image RestorationLIVE1 (Quality 30 Color)PSNR31.43FBCNN
Image RestorationLIVE1 (Quality 30 Color)PSNR-B30.92FBCNN
Image RestorationLIVE1 (Quality 30 Color)SSIM0.897FBCNN
Image RestorationLIVE1 (Quality 10 Color)PSNR27.77FBCNN
Image RestorationLIVE1 (Quality 10 Color)PSNR-B27.51FBCNN
Image RestorationLIVE1 (Quality 10 Color)SSIM0.803FBCNN
Image RestorationBSDS500 (Quality 20 Grayscale)PSNR32FBCNN
Image RestorationBSDS500 (Quality 20 Grayscale)PSNR-B31.19FBCNN
Image RestorationBSDS500 (Quality 20 Grayscale)SSIM0.885FBCNN
Image RestorationClassic5 (Quality 40 Grayscale)PSNR34.35FBCNN
Image RestorationClassic5 (Quality 40 Grayscale)SSIM0.907FBCNN
Image RestorationClassic5 (Quality 20 Grayscale)PSNR32.31FBCNN
Image RestorationClassic5 (Quality 20 Grayscale)PSNR-B31.74FBCNN
Image RestorationClassic5 (Quality 20 Grayscale)SSIM0.872FBCNN
Image RestorationICB (Quality 30 Color)PSNR35.41FBCNN
Image RestorationICB (Quality 30 Color)PSNR-B35.35FBCNN
Image RestorationICB (Quality 30 Color)SSIM0.857FBCNN
Image RestorationBSDS500 (Quality 10 Grayscale)PSNR29.67FBCNN
Image RestorationBSDS500 (Quality 10 Grayscale)PSNR-B29.22FBCNN
Image RestorationBSDS500 (Quality 10 Grayscale)SSIM0.821FBCNN
Image RestorationBSDS500 (Quality 30 Grayscale)PSNR33.37FBCNN
Image RestorationBSDS500 (Quality 30 Grayscale)PSNR-B32.32FBCNN
Image RestorationBSDS500 (Quality 30 Grayscale)SSIM0.913FBCNN
Image RestorationLIVE1 (Quality 30 Grayscale)PSNR33.54FBCNN
Image RestorationLIVE1 (Quality 30 Grayscale)PSNR-B32.83FBCNN
Image RestorationLIVE1 (Quality 30 Grayscale)SSIM0.916FBCNN
Image RestorationBSDS500 (Quality 10 Color)PSNR27.85FBCNN
Image RestorationBSDS500 (Quality 10 Color)PSNR-B27.52FBCNN
Image RestorationBSDS500 (Quality 10 Color)SSIM0.799FBCNN
Image RestorationLIVE1 (Quality 20 Color)PSNR30.11FBCNN
Image RestorationLIVE1 (Quality 20 Color)PSNR-B29.7FBCNN
Image RestorationLIVE1 (Quality 20 Color)SSIM0.868FBCNN
Image RestorationBSDS500 (Quality 20 Color)PSNR30.14FBCNN
Image RestorationBSDS500 (Quality 20 Color)PSNR-B29.56FBCNN
Image RestorationBSDS500 (Quality 20 Color)SSIM0.867FBCNN
Image RestorationICB (Quality 10 Color)PSNR32.18FBCNN
Image RestorationICB (Quality 10 Color)PSNR-B32.15FBCNN
Image RestorationICB (Quality 10 Color)SSIM0.815FBCNN
Image RestorationClassic5 (Quality 10 Grayscale)PSNR30.12FBCNN
Image RestorationClassic5 (Quality 10 Grayscale)PSNR-B29.8FBCNN
Image RestorationClassic5 (Quality 10 Grayscale)SSIM0.822FBCNN
Image RestorationLIVE1 (Quality 20 Grayscale)PSNR32.13FBCNN
Image RestorationLIVE1 (Quality 20 Grayscale)PSNR-B31.57FBCNN
Image RestorationLIVE1 (Quality 20 Grayscale)SSIM0.889FBCNN
Image RestorationBSDS500 (Quality 30 Color)PSNR31.45FBCNN
Image RestorationBSDS500 (Quality 30 Color)PSNR-B30.72FBCNN
Image RestorationBSDS500 (Quality 30 Color)SSIM0.897FBCNN
10-shot image generationLive1 (Quality 10 Grayscale)PSNR29.75FBCNN
10-shot image generationLive1 (Quality 10 Grayscale)PSNR-B29.4FBCNN
10-shot image generationLive1 (Quality 10 Grayscale)SSIM0.827FBCNN
10-shot image generationClassic5 (Quality 30 Grayscale)PSNR33.54FBCNN
10-shot image generationClassic5 (Quality 30 Grayscale)PSNR-B32.78FBCNN
10-shot image generationClassic5 (Quality 30 Grayscale)SSIM0.894FBCNN
10-shot image generationLIVE1 (Quality 40 Grayscale)PSNR34.53FBCNN
10-shot image generationLIVE1 (Quality 40 Grayscale)SSIM0.931FBCNN
10-shot image generationICB (Quality 20 Color)PSNR34.38FBCNN
10-shot image generationICB (Quality 20 Color)PSNR-B34.34FBCNN
10-shot image generationICB (Quality 20 Color)SSIM0.844FBCNN
10-shot image generationLIVE1 (Quality 30 Color)PSNR31.43FBCNN
10-shot image generationLIVE1 (Quality 30 Color)PSNR-B30.92FBCNN
10-shot image generationLIVE1 (Quality 30 Color)SSIM0.897FBCNN
10-shot image generationLIVE1 (Quality 10 Color)PSNR27.77FBCNN
10-shot image generationLIVE1 (Quality 10 Color)PSNR-B27.51FBCNN
10-shot image generationLIVE1 (Quality 10 Color)SSIM0.803FBCNN
10-shot image generationBSDS500 (Quality 20 Grayscale)PSNR32FBCNN
10-shot image generationBSDS500 (Quality 20 Grayscale)PSNR-B31.19FBCNN
10-shot image generationBSDS500 (Quality 20 Grayscale)SSIM0.885FBCNN
10-shot image generationClassic5 (Quality 40 Grayscale)PSNR34.35FBCNN
10-shot image generationClassic5 (Quality 40 Grayscale)SSIM0.907FBCNN
10-shot image generationClassic5 (Quality 20 Grayscale)PSNR32.31FBCNN
10-shot image generationClassic5 (Quality 20 Grayscale)PSNR-B31.74FBCNN
10-shot image generationClassic5 (Quality 20 Grayscale)SSIM0.872FBCNN
10-shot image generationICB (Quality 30 Color)PSNR35.41FBCNN
10-shot image generationICB (Quality 30 Color)PSNR-B35.35FBCNN
10-shot image generationICB (Quality 30 Color)SSIM0.857FBCNN
10-shot image generationBSDS500 (Quality 10 Grayscale)PSNR29.67FBCNN
10-shot image generationBSDS500 (Quality 10 Grayscale)PSNR-B29.22FBCNN
10-shot image generationBSDS500 (Quality 10 Grayscale)SSIM0.821FBCNN
10-shot image generationBSDS500 (Quality 30 Grayscale)PSNR33.37FBCNN
10-shot image generationBSDS500 (Quality 30 Grayscale)PSNR-B32.32FBCNN
10-shot image generationBSDS500 (Quality 30 Grayscale)SSIM0.913FBCNN
10-shot image generationLIVE1 (Quality 30 Grayscale)PSNR33.54FBCNN
10-shot image generationLIVE1 (Quality 30 Grayscale)PSNR-B32.83FBCNN
10-shot image generationLIVE1 (Quality 30 Grayscale)SSIM0.916FBCNN
10-shot image generationBSDS500 (Quality 10 Color)PSNR27.85FBCNN
10-shot image generationBSDS500 (Quality 10 Color)PSNR-B27.52FBCNN
10-shot image generationBSDS500 (Quality 10 Color)SSIM0.799FBCNN
10-shot image generationLIVE1 (Quality 20 Color)PSNR30.11FBCNN
10-shot image generationLIVE1 (Quality 20 Color)PSNR-B29.7FBCNN
10-shot image generationLIVE1 (Quality 20 Color)SSIM0.868FBCNN
10-shot image generationBSDS500 (Quality 20 Color)PSNR30.14FBCNN
10-shot image generationBSDS500 (Quality 20 Color)PSNR-B29.56FBCNN
10-shot image generationBSDS500 (Quality 20 Color)SSIM0.867FBCNN
10-shot image generationICB (Quality 10 Color)PSNR32.18FBCNN
10-shot image generationICB (Quality 10 Color)PSNR-B32.15FBCNN
10-shot image generationICB (Quality 10 Color)SSIM0.815FBCNN
10-shot image generationClassic5 (Quality 10 Grayscale)PSNR30.12FBCNN
10-shot image generationClassic5 (Quality 10 Grayscale)PSNR-B29.8FBCNN
10-shot image generationClassic5 (Quality 10 Grayscale)SSIM0.822FBCNN
10-shot image generationLIVE1 (Quality 20 Grayscale)PSNR32.13FBCNN
10-shot image generationLIVE1 (Quality 20 Grayscale)PSNR-B31.57FBCNN
10-shot image generationLIVE1 (Quality 20 Grayscale)SSIM0.889FBCNN
10-shot image generationBSDS500 (Quality 30 Color)PSNR31.45FBCNN
10-shot image generationBSDS500 (Quality 30 Color)PSNR-B30.72FBCNN
10-shot image generationBSDS500 (Quality 30 Color)SSIM0.897FBCNN

Related Papers

Unsupervised Part Discovery via Descriptor-Based Masked Image Restoration with Optimized Constraints2025-07-16Energy-Based Transformers are Scalable Learners and Thinkers2025-07-02Perception-Oriented Latent Coding for High-Performance Compressed Domain Semantic Inference2025-07-02LD-RPS: Zero-Shot Unified Image Restoration via Latent Diffusion Recurrent Posterior Sampling2025-07-01Double-Diffusion: Diffusion Conditioned Diffusion Probabilistic Model For Air Quality Prediction2025-06-29EAMamba: Efficient All-Around Vision State Space Model for Image Restoration2025-06-27Wild refitting for black box prediction2025-06-26Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration2025-06-26