Skip to content

Latest commit

 

History

History
140 lines (124 loc) · 22.5 KB

README.md

File metadata and controls

140 lines (124 loc) · 22.5 KB

Guided Image-to-Image Translation papers

Feel free to send a PR or issue. (constantly updating)

Class Label Guided

Model Paper Conference Arxiv Code
IcGAN Invertible Conditional GANs for image editing NeurIPSW 2016 1611.06355 Guim3/IcGAN
Conditional CycleGAN Conditional CycleGAN for Attribute Guided Face Image Generation ECCV 2018 1705.09966
StarGAN StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation CVPR 2018 1711.09020 yunjey/StarGAN
AGUIT Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning 1904.12428 imlixinyang/AGUIT
AttGAN AttGAN: Facial Attribute Editing by Only Changing What You Want TIP 2019 1711.10678 LynnHo/AttGAN-Tensorflow
SGGAN Sparsely Grouped Multi-task Generative Adversarial Networks for Facial Attribute Manipulation MM 2018 1805.07509 zhangqianhui/Sparsely-Grouped-GAN
RelGAN RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes ICCV 2019 1908.07269 elvisyjlin/RelGAN-PyTorch, willylulu/RelGAN

Action Unit Guided

Model Paper Conference Arxiv Code
GANimation GANimation: Anatomically-aware Facial Animation from a Single Image ECCV 2018 1807.09251 albertpumarola/GANimation

Facial Landmark Guided

Model Paper Conference Arxiv Code
G2GAN Geometry Guided Adversarial Facial Expression Synthesis MM 2018 1712.03474
CMM-Net Every Smile is Unique: Landmark-Guided Diverse Smile Generation CVPR 2018 1802.01873
C2GAN Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation MM 2019 1908.00999 Ha0Tang/C2GAN
Few-Shot Adversarial Learning of Realistic Neural Talking Head Models ICCV 2019 1905.08233 grey-eye/talking-heads

Pose Guided Person Image Generation

Model Paper Conference Arxiv Code
PG2 Pose Guided Person Image Generation NeurIPS 2017 1705.09368 charliememory/Pose-Guided-Person-Image-Generation
PoseGAN Deformable GANs for Pose-Based Human Image Generation CVPR 2018 1801.00055 AliaksandrSiarohin/pose-gan
VUnet A Variational U-Net for Conditional Appearance and Shape Generation CVPR 2018 1804.04694 CompVis/vunet
PoseWarp Synthesizing Images of Humans in Unseen Poses CVPR 2018 1804.07739 posewarp-cvpr2018
DPIG Disentangled Person Image Generation CVPR 2018 1712.02621 charliememory/Disentangled-Person-Image-Generation
FD-GAN FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification NeurIPS 2018 1810.02936 yxgeee/FD-GAN
PN-GAN Pose-Normalized Image Generation for Person Re-identification ECCV 2018 1712.02225 naiq/PN_GAN
GestureGAN GestureGAN for Hand Gesture-to-Gesture Translation in the Wild MM 2018 1808.04859 Ha0Tang/GestureGAN
PATN Progressive Pose Attention for Person Image Generation CVPR 2019 1904.03349 tengteng95/Pose-Transfer
SPT Unsupervised Person Image Generation with Semantic Parsing Transformation CVPR 2019 1904.03379 SijieSong/person_generation_spt
Coordinate-based Texture Inpainting for Pose-Guided Human Image Generation CVPR 2019 1811.11459 project
IntrinsicFlow Dense intrinsic appearance flow for human pose transfer CVPR 2019 1903.11326 ly015/intrinsic_flow
TriangleGAN Gesture-to-Gesture Translation in the Wild via Category-Independent Conditional Maps MM 2019 1907.05916 yhlleo/TriangleGAN
Pix2pixHD + Temporal Smoothing + FaceGAN Everybody Dance Now ICCV 2019 1808.07371 project
LiquidWarpingGAN Liquid warping gan: A unified framework for human motion imitation, appearance transfer and novel view synthesis ICCV 2019 1909.12224 svip-lab/impersonator
Global-Flow-Local-Attention Deep Image Spatial Transformation for Person Image Generation CVPR 2020 2003.00696 RenYurui/Global-Flow-Local-Attention
ADGAN Controllable Person Image Synthesis With Attribute-Decomposed GAN CVPR 2020 2003.12267 menyifang/ADGAN
CoCosNet Cross-domain Correspondence Learning for Exemplar-based Image Translation CVPR 2020 2004.05571 microsoft/CoCosNet
SMIS Semantically Multi-modal Image Synthesis CVPR 2020 2003.12697 Seanseattle/SMIS
MISC MISC: Multi-Condition Injection and Spatially-Adaptive Compositing for Conditional Person Image Synthesis CVPR 2020 cvpr20
Warp3d_Reposing Reposing Humans by Warping 3D Features CVPR 2020 Workshop 2006.04898 MKnoche/warp3d_reposing
Wish You Were Here: Context-Aware Human Generation CVPR 2020 2005.10663
PoseStylizer Generating Person Images with Appearance-aware Pose Stylizer IJCAI 2020 2007.09077 siyuhuang/PoseStylizer
XingGAN XingGAN for Person Image Generation ECCV 2020 2007.09278 Ha0Tang/XingGAN

Segmentation Map Guided Scene Image Generation

Model Paper Conference Arxiv Code
CRN Photographic Image Synthesis with Cascaded Refinement Networks ICCV 2017 1707.09405 CQFIO/PhotographicImageSynthesis
CrossNet Predicting Ground-Level Scene Layout from Aerial Imagery CVPR 2017 1612.02709 viibridges/crossnet
SIMS Semi-parametric Image Synthesis CVPR 2018 1804.10992 xjqicuhk/SIMS
Pix2PixHD High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs CVPR 2018 1711.11585 NVIDIA/pix2pixHD
X-Fork & X-Seq Cross-View Image Synthesis using Conditional GANs CVPR 2018 1803.03396 kregmi/cross-view-image-synthesis
Vid2Vid Video-to-Video Synthesis NeurIPS 2018 1808.06601 NVIDIA/vid2vid
SPADE Semantic Image Synthesis with Spatially-Adaptive Normalization CVPR 2019 1903.07291 NVlabs/SPADE
SelectionGAN Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation CVPR 2019 1904.06807 Ha0Tang/SelectionGAN
Art2Real Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation CVPR 2019 1811.10666 aimagelab/art2real
Mask-Guided Portrait Editing with Conditional GANs CVPR 2019 1905.10346 cientgu/Mask_Guided_Portrait_Editing
Seg2Vid Video Generation from Single Semantic Label Map CVPR 2019 1903.04480 junting/seg2vid
Semantic Bottleneck Scene Generation 1911.11357
Few-shot Vid2Vid Few-shot Video-to-Video Synthesis NeurIPS 2019 1910.12713 NVlabs/few-shot-vid2vid
CC-FPSE Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis NeurIPS 2019 1910.06809 xh-liu/CC-FPSE
SEAN SEAN: Image Synthesis with Semantic Region-Adaptive Normalization CVPR 2020 1911.12861 ZPdesu/SEAN
BachGAN BachGAN: High-Resolution Image Synthesis from Salient Object Layout CVPR 2020 2003.11690 Cold-Winter/BachGAN
Panoptic-based Image Synthesis CVPR 2020 2004.10289
SMIS Semantically Multi-modal Image Synthesis CVPR 2020 2003.12697 Seanseattle/SMIS
GAN Compression GAN Compression: Efficient Architectures for Interactive Conditional GANs CVPR 2020 2003.08936 mit-han-lab/gan-compression
LGGAN Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation CVPR 2020 1912.12215 Ha0Tang/LGGAN
TSIT TSIT: A Simple and Versatile Framework for Image-to-Image Translation ECCV 2020 2007.12072 EndlessSora/TSIT
SegVAE Controllable Image Synthesis via SegVAE ECCV 2020 2007.08397 yccyenchicheng/SegVAE
SESAME SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objects ECCV 2020 2004.04977
Style Semantics Controlling Style and Semantics in Weakly-Supervised Image Generation ECCV 2020 1912.03161 dariopavllo/style-semantics

Texture Patch Guided

Model Paper Conference Arxiv Code
TextureGAN TextureGAN: Controlling Deep Image Synthesis with Texture Patches CVPR 2018 1706.02823 janesjanes/Pytorch-TextureGAN
Guided-pix2pix Guided Image-to-Image Translation with Bi-Directional Feature Transformation ICCV 2019 1910.11328 vt-vl-lab/Guided-pix2pix

Example Guided

Model Paper Conference Arxiv Code
EG-UNIT Exemplar Guided Unsupervised Image-to-Image Translation ICLR 2019 1805.11145 charliememory/EGSC-IT
Pix2pixSC Example-Guided Style-Consistent Image Synthesis from Semantic Labeling CVPR 2019 1906.01314 cxjyxxme/pix2pixSC

Attention Guided

Model Paper Conference Arxiv Code
DA-GAN DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks CVPR 2018 1802.06454
Attention-GAN Attention-GAN for Object Transfiguration in Wild Images ECCV 2018 1803.06798
UAIT Unsupervised Attention-guided Image to Image Translation NeurIPS 2018 1806.02311 AlamiMejjati/Unsupervised-Attention-guided-Image-to-Image-Translation
Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention TIP 2019 1806.06195
AttentionGAN Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation IJCNN 2019 1903.12296 Ha0Tang/AttentionGAN
U-GAT-IT U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation ICLR 2020 1907.10830 taki0112/UGATIT, znxlwm/UGATIT-pytorch

Mask Guided

Model Paper Conference Arxiv Code
ContrastGAN Generative Semantic Manipulation with Mask-Contrasting GAN ECCV 2018 1708.00315
InstaGAN Instance-aware image-to-image translation ICLR 2019 1812.10889 sangwoomo/instagan
INIT Towards Instance-level Image-to-Image Translation CVPR 2019 1905.01744 project

Text Guided

Model Paper Conference Arxiv Code
ControlGAN Controllable Text-to-Image Generation NeurIPS 2019 1909.07083 mrlibw/ControlGAN
DMIT Multi-mapping Image-to-Image Translation via Learning Disentanglement NeurIPS 2019 1909.07877 Xiaoming-Yu/DMIT
ManiGAN ManiGAN: Text-Guided Image Manipulation 1912.06203
RefinedGAN Image-to-Image Translation with Text Guidance 2002.05235

Audio Guided

Model Paper Conference Arxiv Code
X2Face X2Face: A Network for Controlling Face Generation using Images, Audio, and Pose Codes ECCV 2018 1807.10550 oawiles/X2Face