> I don't see how game theory is relevant or what insights it provides. The wiki entry of Nash equilibrium [1] and this recent preprint on improving GAN training [2] may help you understand the link between GAN and game theory. To me, this link seems plausible but very vague so far. Training GAN has not directly benefited from the math foundation of game theory. Correct me if I am wrong. [1]: https://en.wikipedia.org/wiki/Nash_equilibrium [2]: https://arxiv.org/abs/1606.03498
Improved Techniques for Training GANs
Tim Salimans, Ian Goodfellow, Wojciech Zaremba
Show all 6 authors
Vicki Cheung, Alec Radford, Xi Chen
2016 · arXiv
- HN score
- 0
- Mentions
- 3
- Readers
- 3
- Months
- 3
From the abstract
We present a variety of new architectural features and training procedures that we apply to the generative adversarial networks (GANs) framework. We focus on two applications of GANs: semi-supervised learning, and the generation of images that humans find visually realistic. Unlike most work on generative models, our primary goal is not to train a model that assigns high likelihood to test data, nor do we require the model to be able to learn well without using any labels. Using our new techniques, we achieve state-of-the-art results in semi-supervised classification on MNIST, CIFAR-10 and SVHN. The generated images are of high quality as confirmed by a visual Turing test: our model generates MNIST samples that humans cannot distinguish from real data, and CIFAR-10 samples that yield a human error rate of 21.3%. We also present ImageNet samples with unprecedented resolution and show that our methods enable the model to learn recognizable features of ImageNet classes.
Metadata: arXiv. Abstracts retain their original authors’ rights.
In the conversation
Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels
3 selected excerpts · 3 total mentions
They have plenty of results. All their work on GANs[1][2] has been great, and the OpenAI gym has proven to be pretty popular for reinforcement learning research already. I'm not sure how "hype" is measured - perhaps people thought they were going to invent some kind of AI entity we would have to persuade not to shoot us all by now or something. I know that all the papers coming out of OpenAI get hyped just as much as anything from DeepMind, Google Brain or FAIR, so there seems to be decent amount of hype still? But then usually that hype is justified, in which case maybe it is better characterised as "excitement"? [1] http://arxiv.org/pdf/1606.03657.pdf [2] http://arxiv.org/pdf/1606.03498.pdf
Brief summary: a nice intro about what generative models are and the current popular approaches/papers, followed by descriptions of recent work by OpenAI in the space. Quick links to papers mentioned: Improving GANs https://arxiv.org/abs/1606.03498 Improving VAEs http://arxiv.org/abs/1606.04934 InfoGAN https://arxiv.org/abs/1606.03657 Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural Networks http://arxiv.org/abs/1605.09674 Generative Adversarial Imitation Learning http://arxiv.org/abs/1606.03476 I think the last one seems very exciting, I expect Imitation Learning would be a great approach for many robotics tasks.
Keep following the thread.
More in Machine learningMore from the same topics.
Language Models are Few-Shot Learners
Tom B. Brown, Benjamin Mann, Nick Ryder +28
Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task.
Understanding deep learning requires rethinking generalization
Chiyuan Zhang, Samy Bengio, Moritz Hardt +2
Despite their massive size, successful deep artificial neural networks can exhibit a remarkably small difference between training and test performance.
End to End Learning for Self-Driving Cars
Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski +10
We trained a convolutional neural network (CNN) to map raw pixels from a single front-facing camera directly to steering commands.
Categorizing Variants of Goodhart's Law
David Manheim, Scott Garrabrant
There are several distinct failure modes for overoptimization of systems on the basis of metrics.