4.6 Article

Improving generative adversarial networks with simple latent distributions

期刊

NEURAL COMPUTING & APPLICATIONS
卷 33, 期 20, 页码 13193-13203

出版社

SPRINGER LONDON LTD
DOI: 10.1007/s00521-021-05946-3

关键词

Generative adversarial network; Deep generative model; Information theory; Deep learning; Generation

资金

  1. National Natural Science Foundation of China [61876155]
  2. Jiangsu Science and Technology Programme (Natural Science Foundation of Jiangsu Province) [BE2020006-4, BK20181189]
  3. Key Program Special Fund in XJTLU [KSF-T-06]

向作者/读者索取更多资源

SimpleGAN is proposed in this study to address the issues of unstable training and poor generation in GANs. By learning and utilizing an additional latent space with simple low-dimensional distributions, SimpleGAN tackles the difficulties in measuring the divergence between highly complex distributions in high-dimensional space from a different perspective.
Generative Adversarial Networks (GANs) have drawn great attention recently since they are the powerful models to generate high-quality images. Although GANs have achieved great success, they usually suffer from unstable training and consequently may lead to the poor generations in some cases. Such drawback is argued mainly due to the difficulties in measuring the divergence between the highly complicated the real and fake data distributions, which are normally in the high-dimensional space. To tackle this problem, previous researchers attempt to search a proper divergence capable of measuring the departure of the complex distributions. In contrast, we attempt to alleviate this problem from a different perspective: while retaining the information as much as possible of the original high dimensional distributions, we learn and leverage an additional latent space where simple distributions are defined in a low-dimensional space; as a result, we can readily compute the distance between two simple distributions with an available divergence measurement. Concretely, to retain the data information, the mutual information is maximized between the variables for the high dimensional complex distributions and the low dimensional simple distributions. The departure of the resulting simple distributions are then measured in the original way of GANs. Additionally, for simplifying the optimization further, we optimize directly the lower bound for mutual information. Termed as SimpleGAN, we conduct the proposed approach over the several different baseline models, i.e., conventional GANs, DCGAN, WGAN-GP, WGAN-GP-res, and LSWGAN-GP on the benchmark CIFAR-10 and STL-10 datasets. SimpleGAN shows the obvious superiority on these baseline models. Furthermore, in comparison with the existing methods measuring directly the distribution departure in the high-dimensional space, our method clearly demonstrates its superiority. Finally, a series of experiments show the advantages of the proposed SimpleGAN.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据