Skip to content
Back to the collection

Visual Attribute Transfer through Deep Image Analogy

Jing Liao, Yuan Yao, Lu Yuan, Gang Hua, Sing Bing Kang

2017 · arXiv

Read the paper
HN score
0
Mentions
3
Readers
3
Months
3
What’s in a score?

From the abstract

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as color, tone, texture, and style) from one image to another. For example, one image could be that of a painting or a sketch while the other is a photo of a real scene, and both depict the same type of scene. Our technique finds semantically-meaningful dense correspondences between two input images. To accomplish this, it adapts the notion of "image analogy" with features extracted from a Deep Convolutional Neutral Network for matching; we call our technique Deep Image Analogy. A coarse-to-fine strategy is used to compute the nearest-neighbor field for generating the results. We validate the effectiveness of our proposed method in a variety of cases, including style/texture transfer, color/style swap, sketch/painting to photo, and time lapse.

Metadata: arXiv. Abstracts retain their original authors’ rights.

In the conversation

Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels

3 selected excerpts · 3 total mentions

tanilama
Neutral mention · rule
https://arxiv.org/abs/1512.03385 Deep Residual Learning for Image Recognition Citation 4000+. Milestone of image recognition. https://arxiv.org/abs/1502.01852 Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Also known as PreLU, citation 1600+. The initialization scheme is widely adapted by a lot of following works. Those are the most influential ones, all come from Kaiming He. He is now in FAIR, and keeps very good publication record, with works like MASK-RCNN, but that doesn't really count as purely Chinese contribution, so we skipped here. Some recent memory: 1. https://arxiv.org/abs/1703.06211 2. https://arxiv.org/abs/1709.01507 3. https://arxiv.org/abs/1707.01083 4. https://arxiv.org/pdf/1608.06993 5. https://arxiv.org/abs/1705.01088 Those are all good papers.
visarga
Neutral mention · rule
One way to make CG images more real is to pass them through a neural network. Some GANs can do that. Apple had a paper about synthesizing eyes using such a process. Here: "Improving the Realism of Synthetic Images" https://machinelearning.apple.com/2017/07/07/GAN.html Also: "Visual Attribute Transfer through Deep Image Analogy" https://arxiv.org/abs/1705.01088 (this paper even shows a refined CG Mona Lisa)
projectorlochsa
Neutral mention · rule
Deep learning based style transfer that got viral a year or two ago was worse than this 2008 result, especially worse for that hone application to portraits. The hype was nowhere near just because there's no deepness. I admit that https://arxiv.org/abs/1705.01088 this beats everything and is extremely powerful and simple but the hype for deep things seems a bit too strong.

Keep following the thread.

More in Computer vision

More from the same topics.