Awesome Face Generation

Contents

• Awesome Face Generation
  • Contents
    • Basic Nets - Image2Image
    • Basic Nets - Vector2Image
    • Face Swap
    • Face Reenactment
    • Face Stylizing
    • Audio-driven talking face
    • Tools
    • Datasets
    • Great Repos

---

Basic Nets - Image2Image

• [arXiv'21.06] [AttnFlow] Generative Flows with Invertible Attentions
• [arXiv'21.04] [StyleGAN-Inversion] A Simple Baseline for StyleGAN Inversion [web] [pytorch]
• [arXiv'21.02] [TransUNet] TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation [pytorch]
• [CVPR'21] [GH-Feat] Generative Hierarchical Features from Synthesizing Images [pytorch]
• [CVPR'21] [pSp] Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation [pytorch]
• [CVPR'21] [DivCo] DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network [pytorch]
• [CVPR'21] [GPEN] GAN Prior Embedded Network for Blind Face Restoration in the Wild [pytorch]
• [ICLR'21] [Score-SDE] Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation [pytorch] [tensorflow]
• [ICLR'21] [DINO] DINO: A Conditional Energy-Based GAN for Domain Translation [pytorch]
• [ICML'20] [AGD] AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks [pytorch]
• [NIPS'20] [ContraGAN] ContraGAN: Contrastive Learning for Conditional Image Generation [tensorflow]
• [NIPS'20] [CircleGAN] CircleGAN: Generative Adversarial Learning across Spherical Circles [tensorflow]
• [NIPS'20] [DeepI2I] DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs [pytorch]
• [NIPS'20] [NVAE] NVAE: A Deep Hierarchical Variational Autoencoder [pytorch]
• [NIPS'20] [Swapping-Autoencoder] Swapping Autoencoder for Deep Image Manipulation [web] [pytorch]
• [ECCV'20] [COCO-FUNIT] COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder [web] [pytorch]
• [ECCV'20] [TopologyGAN] TopologyGAN: Topology Optimization Using Generative Adversarial Networks Based on Physical Fields Over the Initial Domain [pytorch]
• [ECCV'20] [wc-Vid2Vid] World-Consistent Video-to-Video Synthesis [web] [pytorch]
• [CVPR'20] [StarGAN2] StarGAN v2: Diverse Image Synthesis for Multiple Domains [pytorch]
• [CVPR'20] [Spectral-Regularization] Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributions [pytorch]
• [NeurIPS'19] [fs-Vid2Vid] Few-shot Video-to-Video Synthesis [web] [pytorch]
• [ICCV'19] [FUNIT] Few-Shot Unsupervised Image-to-Image Translation [web] [pytorch]
• [CVPR'19] [SPADE] Semantic Image Synthesis with Spatially-Adaptive Normalization [web] [pytorch]
• [NeurIPS'18] [Glow] Glow: Generative Flow with Invertible 1x1 Convolutions [pytorch] [tensorflow]
• [NeurIPS'18] [Vid2Vid] Video-to-Video Synthesis [web] [pytorch]
• [CVPR'18] [StarGAN] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [pytorch]
• [CVPR'18] [Pix2PixHD] High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs [web] [pytorch]
• [ECCV'18] [MUNIT] Multimodal Unsupervised Image-to-Image Translation [pytorch]
• [NeurIPS'17] [UNIT] Unsupervised Image-to-Image Translation Networks [pytorch]
• [ICCV'17] [CycleGAN] Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks [web] [pytorch]
• [CVPR'17] [Pix2Pix] Image-to-Image Translation with Conditional Adversarial Networks [web] [pytorch]

---

Basic Nets - Vector2Image

• [arXiv'21.04] [ViTGAN] ViTGAN: Training GANs with Vision Transformers
• [arXiv'21.06] [Alias-Free-GAN] Alias-Free Generative Adversarial Networks
• [arXiv'21.04] [MobileStyleGAN] MobileStyleGAN: A Lightweight Convolutional Neural Network for High-Fidelity Image Synthesis [pytorch]
• [arXiv'21.03] [GANformer] GANformer: Generative Adversarial Transformers [tensorflow]
• [arXiv'21.02] [TransGAN] TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up [pytorch]
• [arXiv'21.02] [SWAGAN] SWAGAN: A Style-based Wavelet-driven Generative Model [pytorch]
• [arXiv'21.02] [MedT] Medical Transformer: Gated Axial-Attention for Medical Image Segmentation [pytorch]
• [arXiv'20.06] [StyleGAN2-ADA] Training Generative Adversarial Networks with Limited Data [pytorch]
• [CVPR'21] [BNCR-GAN] Blur, Noise, and Compression Robust Generative Adversarial Networks [web]
• [CVPR'21] [P2GAN] Posterior Promoted GAN with Distribution Discriminator for Unsupervised Image Synthesis
• [CVPR'21] [OSGAN] Training Generative Adversarial Networks in One Stage [pytorch]
• [CVPR'21] [LeCam-GAN] Regularizing Generative Adversarial Networks under Limited Data [tensorflow]
• [CVPR'21] [EFTs] Efficient Feature Transformations for Discriminative and Generative Continual Learning
• [CVPR'21] [CIPS] Image Generators with Conditionally-Independent Pixel Synthesis [pytorch]
• [ICLR'21] [ContraD] Training GANs with Stronger Augmentations via Contrastive Discriminator [pytorch]
• [ICLR'21] [CcGAN] CcGAN: Continuous Conditional Generative Adversarial Networks for Image Generation [pytorch]
• [CVPR'20] [StyleGAN2] Analyzing and Improving the Image Quality of StyleGAN [pytorch] [tensorflow]
• [CVPR'20] [MSG-GAN] MSG-GAN: Multi-Scale Gradients for Generative Adversarial Networks [pytorch]
• [CVPR'20] [UNet-GAN] A U-Net Based Discriminator for Generative Adversarial Networks [pytorch]
• [CVPR'20] [AdversarialNAS] AdversarialNAS: Adversarial Neural Architecture Search for GANs [pytorch]
• [CVPR'19] [StyleGAN] A Style-Based Generator Architecture for Generative Adversarial Networks [pytorch] [tensorflow]
• [ICLR'19] [BigGAN] Large Scale GAN Training for High Fidelity Natural Image Synthesis [pytorch] [tensorflow]
• [ICLR'19] [COCO-GAN] COCO-GAN: Generation by Parts via Conditional Coordinating [pytorch] [tensorflow]
• [ICLR'18] [PGGAN] Progressive Growing of GANs for Improved Quality, Stability, and Variation [tensorflow]
• [ICLR'16] [DCGAN] Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks [pytorch]
• [NIPS'16] [CPixelCNN] Conditional Image Generation with PixelCNN Decoders [tensorflow]
• [PMLR'16] [PixelRNN] Pixel Recurrent Neural Networks [pytorch] [tensorflow]
• [arXiv'14.11] [CGAN] Conditional Generative Adversarial Nets [pytorch]

---

Face Swap

• [IJCAI'21] [HifiFace] HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping [web]
• [CVPR'21] [HFaceInpainter] HFaceInpainter: High Fidelity Face Adaptation to Heterogeneous Domains
• [CVPR'21] [MegaFS] One Shot Face Swapping on Megapixels [pytorch]
• [CVPR'20] [Faceshifter] FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping [web]
• [SIGGRAPH'20] [IDDis] Face Identity Disentanglement via Latent Space Mapping [pytorch]
• [AAAI'20] [Facecontroller] FaceController: Controllable Attribute Editing for Face in the Wild
• [ACCV'20] [UnifiedSR] Unified Application of Style Transfer for Face Swapping and Reenactment
• [ACM'20] [SimSwap] SimSwap: An Efficient Framework For High Fidelity Face Swapping [pytorch]
• [arXiv'20.05] [DeepFaceLab] DeepFaceLab: Integrated, flexible and extensible face-swapping framework
• [ICCV'19] [FSGAN] FSGAN: Subject Agnostic Face Swapping and Reenactment [pytorch]
• [arXiv'18.04] [RSGAN] RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spaces
• [CVPR'18] [OIPFS] Towards Open-Set Identity Preserving Face Synthesis
• [arXiv'18.04] [RSGAN] RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spaces
• [CVPR'18] [IPNet] Towards Open-Set Identity Preserving Face Synthesis
• [ACCV'18] [FSNet] FSNet: An Identity-Aware Generative Model for Image-based Face Swapping [web]

---

Face Reenactment

• [CVPR'21] [face-vid2vid] One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing [web]
• [CVPR'20] [FReeNet] FReeNet: Multi-Identity Face Reenactment [pytorch]
• [ICASSP'20] [APB2Face] APB2Face: Audio-guided face reenactment with auxiliary pose and blink signals [pytorch]
• [ECCV'20] [Bi-layer] Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars [pytorch]
• [arXiv'20.12] [HeadGAN] HeadGAN: One-shot Neural Head Synthesis and Editing
• [arXiv'20.05] [FaR-GAN] FaR-GAN for One-Shot Face Reenactment
• [AAAI'20] [DAE-GAN] Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose
• [NIPS'19] [FOMM] First Order Motion Model for Image Animation [web] [pytorch]
• [ECCV'18] [OSFR] One-shot Face Reenactment [pytorch]
• [ECCV'18] [X2Face] X2Face: A network for controlling face generation by using images, audio, and pose codes [pytorch]
• [ECCV'18] [ReenactGAN] ReenactGAN: Learning to Reenact Faces via Boundary Transfer [pytorch]

---

Face Stylizing

• [arXiv'21.06] [Cartoon-StyleGan2] Fine-Tuning StyleGAN2 For Cartoon Face Generation [pytorch]
• [Siggraph'21] [AgileGAN] AgileGAN: Stylizing Portraits by Inversion-Consistent Transfer Learning [web]
• [ACM TOG'21] [StyleFlow] StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows [pytorch]
• [NeurIPSW'20] [Toonify] Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains [web] [tensorflow]

---

Audio-driven talking face

• [TIFS'22] [EBT] Everybody’s talkin’: Let me talk as you want [pytorch]
• [CVPR'21] [EVP] Audio-Driven Emotional Video Portraits [pytorch]
• [ACMMM'21] [style_avatar] Imitating Arbitrary Talking Style for Realistic Audio-Driven Talking Face Synthesis [pytorch]
• [ICCV'21] [AD-NeRF] Audio Driven Neural Radiance Fields for Talking Head Synthesis [pytorch]
• [CVPR'21] [Talking-Face_PC-AVS] Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation [pytorch]
• [arXiv'20] [Audio-driven-TalkingFace-HeadPose] Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose [pytorch]
• [ECCV'20] [Neural voice puppetry] Neural voice puppetry: Audio-driven facial reenactment [pytorch]
• [CVPR'19] [ATVGnet] Hierarchical cross-modal talking face generation with dynamic pixel-wise loss [pytorch]
• [AAAI'19] [Talking-Face-Generation-DAVS] Talking Face Generation by Adversarially Disentangled Audio-Visual Representation [pytorch]
• [ECCV'18] [X2Face] X2Face: A network for controlling face generation using images, audio, and pose codes [pytorch]
• [SIGGRAPH'17] [obama] Audio-Driven Emotional Video Portraits [tensorflow]

---

Tools

• [CVPR'19] [Face Recognition] [ArcFace] ArcFace: Additive Angular Margin Loss for Deep Face Recognition [code]
• [ECCV'18] [Face Segmentation] [BiSeNet] BiSeNet: Bilateral segmentation network for real-time semantic segmentation [code]
• [Face Segmentation] [CeleAMask-HQ] [code]
• [CVPRW'19] [3DMM] Accurate 3D face reconstruction with weakly-supervised learning: From single image to image set [code]
• [IEEE SPL'16] [Face Alignment / Detection] [MTCNN] Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks [code]
• [IJCB'17] [Face Alignment / Detection] [Faceboxes] FaceBoxes: A CPU Real-time Face Detector with High Accuracy [code]
• [CVPR'20] [Face Alignment / Detection] [RetinaFace] RetinaFace: Single-stage Dense Face Localisation in the Wild [code]
• [Face Alignment / Detection] [DLIB] [code]

---

Datasets

• [CelebA]
• [CelebA-HQ]
• [CelebAMask-HQ]
• [CelebA-Spoof]
• [FFHQ]
• [VoxCeleb1]
• [VoxCeleb2]
• [VGGFace]
• [VGGFace2]
• [RaFD]
• [Multi-PIE]
• [FaceForensics++]
• [SCUT-FBP]
• [MakeUp]

---

Great Repos

• [awesome-gan-inversion]