Skip to content
Back to the collection

Improved Techniques for Training GANs

Tim Salimans, Ian Goodfellow, Wojciech Zaremba

Show all 6 authors

Vicki Cheung, Alec Radford, Xi Chen

2016 · arXiv

Read the paper
HN score
0
Mentions
3
Readers
3
Months
3
What’s in a score?

From the abstract

We present a variety of new architectural features and training procedures that we apply to the generative adversarial networks (GANs) framework. We focus on two applications of GANs: semi-supervised learning, and the generation of images that humans find visually realistic. Unlike most work on generative models, our primary goal is not to train a model that assigns high likelihood to test data, nor do we require the model to be able to learn well without using any labels. Using our new techniques, we achieve state-of-the-art results in semi-supervised classification on MNIST, CIFAR-10 and SVHN. The generated images are of high quality as confirmed by a visual Turing test: our model generates MNIST samples that humans cannot distinguish from real data, and CIFAR-10 samples that yield a human error rate of 21.3%. We also present ImageNet samples with unprecedented resolution and show that our methods enable the model to learn recognizable features of ImageNet classes.

Metadata: arXiv. Abstracts retain their original authors’ rights.

In the conversation

Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels

3 selected excerpts · 3 total mentions

attractivechaos
Neutral mention · rule
> I don't see how game theory is relevant or what insights it provides. The wiki entry of Nash equilibrium [1] and this recent preprint on improving GAN training [2] may help you understand the link between GAN and game theory. To me, this link seems plausible but very vague so far. Training GAN has not directly benefited from the math foundation of game theory. Correct me if I am wrong. [1]: https://en.wikipedia.org/wiki/Nash_equilibrium [2]: https://arxiv.org/abs/1606.03498
nl
Neutral mention · rule
They have plenty of results. All their work on GANs[1][2] has been great, and the OpenAI gym has proven to be pretty popular for reinforcement learning research already. I'm not sure how "hype" is measured - perhaps people thought they were going to invent some kind of AI entity we would have to persuade not to shoot us all by now or something. I know that all the papers coming out of OpenAI get hyped just as much as anything from DeepMind, Google Brain or FAIR, so there seems to be decent amount of hype still? But then usually that hype is justified, in which case maybe it is better characterised as "excitement"? [1] http://arxiv.org/pdf/1606.03657.pdf [2] http://arxiv.org/pdf/1606.03498.pdf
andreyk
Neutral mention · rule
Brief summary: a nice intro about what generative models are and the current popular approaches/papers, followed by descriptions of recent work by OpenAI in the space. Quick links to papers mentioned: Improving GANs https://arxiv.org/abs/1606.03498 Improving VAEs http://arxiv.org/abs/1606.04934 InfoGAN https://arxiv.org/abs/1606.03657 Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural Networks http://arxiv.org/abs/1605.09674 Generative Adversarial Imitation Learning http://arxiv.org/abs/1606.03476 I think the last one seems very exciting, I expect Imitation Learning would be a great approach for many robotics tasks.

Keep following the thread.

More in Machine learning

More from the same topics.