A curated, but probably biased and incomplete, list of awesome Deepfakes resources.
If you want to contribute to this list, feel free to pull a request. Also you can contact Mengnan Du from the Data Lab at Texas A&M University through email: dumengnan@tamu.edu, or Twitter @DuMNCH.
In December 2017, a user with name “DeepFakes” posted realistic looking videos of famous celebrities on Reddit. These fake videos are generated using deep learning, by swapping faces of original adult movies with celebrities’ faces. Since then, the topic of DeepFakes goes viral on internet.
Here, we denote DeepFakes as any fake contents generated by deep learning techniques. DeepFakes comes in different forms, perhaps the most typical ones are: 1) Videos and images, 2) Texts, and 3) Voices. Different deep learning techniques are used to generate DeepFakes. For instance, videos and images are usually created by Generative adversarial networks (GAN), while texts are mostly generated by deep language models based on Transformers.
- HeadOn: Real-time Reenactment of Human Portrait Videos
- Face2Face: Real-time Face Capture and Reenactment of RGB Videos
- Synthesizing Obama: Learning Lip Sync from Audio
-
Review and General Papers
-
Relying on Artifacts
- Exposing DeepFake Videos By Detecting Face Warping Artifacts
- Exposing Deep Fakes Using Inconsistent Head Poses
- In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking
- Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
- Protecting World Leaders Against Deep Fakes
-
Binary Classifiers
-
Generalization performance
- Deepfake detection for the masses
- Exposing DeepFake Videos By Detecting Face Warping Artifacts
- Vulnerability assessment and detection of Deepfake videos
- FaceForensics++
- Celeb-DF
- Deepfakes detection challenge by Facebook, Microsoft, etc.
- DeepfakeTIMIT
- Kaggle Deepfake Detection Challenge
- Deepfake: The Good, The Bad and the Ugly - Medium
- DeepFakes: AI-powered deception machines
- Exploring DeepFakes - KDnuggets
- Family fun with deepfakes. Or how I got my wife onto the Tonight Show - Towards Data Science
- Deepfake propaganda is not a real problem - The Verge
- GLTR: Statistical Detection and Visualization of Generated Text
- Defending Against Neural Fake News
- CTRL: A Conditional Transformer Language Model for Controllable Generation
- GLTR: Giant Language Model Test Room
- Grover
- CTRL - A Conditional Transformer Language Model for Controllable Generation
- OpenAI: Please Open Source Your Language Model
- OpenAI Shouldn’t Release Their Full Language Model
- Better fact-checking for fake news
- Tacotron: Towards End-to-End Speech Synthesis
- Neural Voice Cloning with a Few Samples
- Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning
- Deep Voice 3: Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention