2018-03-11-Data Argument with domain/style-transfer-network


Interesting Paper
Reference:
github domain-transfer-network
DTN:Unsupervised Cross-Domain Image Generation

Reference:
overview of CycleGAN
Reference:
Tips for TF CycleGAN
Cycle GAN: no label no pairing, two generator, two Discriminator


what is GAN?
overview of GAN
generative network learns to map from a latent space
discriminative network discriminates between instances from the true data distribution and candidates produced by the generator.
so that means:
generator increase the error rate of the discriminative network

by the way:
variational autoencoders (VAE) is also a way to generate the images without supervision.

GAN VS VAE

because of the limited time, so I only study GAN hier:


Loss Function of Generator

the part of fake data from generator, which is judged as real by Discriminative network

Loss Function of Discriminative network

the part of fake data from generator, which is judged as fake by Discriminative network as well as the part of real data, which is judged as real by Discriminative network

note that: the loss function is in form of cross entropy


some new GAN:

LSGAN

LSGAN

use the Least Squares to strictly punish outliers, which far away from groundtruth (i 'm afraid it means more weak style transform?)

WGAN

WGAN

weight of D net : clip by value (-0.01,0.01)

ps: WGAN-GP and DRAGAN also use clip by value, but on gradient.

SGAN

SGAN

very similar as Cascade network


now go back to Cycle GAN

New GAN

the biggest difference between traditional GAN and new GAN is that, the generator do not generate fake image just from the noise signal, but from the feature of the original image.

we already know Conv layer can separate higher-order features from original image. And then Transpose Conv layer can in turn generate ein image based on the features.
So that we use a number of Conv- layers to build a encoded and transposed Conv layers to build a decoder.
ans we use a deep network to ** make changes ** to act as a feature converter!
and Cycle GAN use ResNet50 as the feature converter!


Details of Cycle GAN

Details of Cycle GAN

because of Cycle GAN is No Pairing, so we need more restrictions to control the training process.

according to the graph, we know there are 2 generator. G Net A2B is used as generating Class B from A, B2A is in turn.
and 2 Discriminator in the same way.

最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容

  • 经过通宵蕴藉 黎明时分雨至 咚咚锵地敲着窗户 好像快递员焦躁地按着门铃 成行的雨丝是天空的秧苗 着急地播种 着急地...
    树梢的雪阅读 196评论 17 19
  • 2017年1月1日的新年照 第一次单独带队去户外,虽然只是简单的把人集合再带到南岳但对于从未有过组织能力的我来说如...
    忠贞_55f8阅读 327评论 4 3
  • 窗口之内1~~年过完了,上班的人都不开心。
    瘦人碗子阅读 131评论 0 4
  • 对于商业化的app来说,集成支付宝还是比较重要的,在这里发几个自己收藏的链接。 1.配置支付宝环境:http://...
    哈哈大p孩阅读 497评论 0 3