TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Exploring The Effect of High-frequency Components in GANs ...

Exploring The Effect of High-frequency Components in GANs Training

Ziqiang Li, Pengfei Xia, Xue Rui, Bin Li

2021-03-20Vocal Bursts Intensity Prediction
PaperPDFCode(official)Code

Abstract

Generative Adversarial Networks (GANs) have the ability to generate images that are visually indistinguishable from real images. However, recent studies have revealed that generated and real images share significant differences in the frequency domain. In this paper, we explore the effect of high-frequency components in GANs training. According to our observation, during the training of most GANs, severe high-frequency differences make the discriminator focus on high-frequency components excessively, which hinders the generator from fitting the low-frequency components that are important for learning images' content. Then, we propose two simple yet effective frequency operations for eliminating the side effects caused by high-frequency differences in GANs training: High-Frequency Confusion (HFC) and High-Frequency Filter (HFF). The proposed operations are general and can be applied to most existing GANs with a fraction of the cost. The advanced performance of the proposed operations is verified on multiple loss functions, network architectures, and datasets. Specifically, the proposed HFF achieves significant improvements of $42.5\%$ FID on CelebA (128*128) unconditional generation based on SNGAN, $30.2\%$ FID on CelebA unconditional generation based on SSGAN, and $69.3\%$ FID on CelebA unconditional generation based on InfoMAXGAN.

Related Papers

Hierarchical DCC-HEAVY Model for High-Dimensional Covariance Matrices2023-05-15An Object SLAM Framework for Association, Mapping, and High-Level Tasks2023-05-12Scaling Laws of Dynamic High-Capacity Ride-Sharing2023-05-12Band-Pass Filtering with High-Dimensional Time Series2023-05-11Text-guided High-definition Consistency Texture Model2023-05-10HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion2023-05-10CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators2023-05-10CUTS+: High-dimensional Causal Discovery from Irregular Time-series2023-05-10