Skip to content

Latest commit

 

History

History
106 lines (53 loc) · 5.13 KB

AWESOME_CONTRASTIVE_LEARNING.md

File metadata and controls

106 lines (53 loc) · 5.13 KB
Raw

Awesome Contrastive Learning

General

  • Dimensionality Reduction by Learning an Invariant Mapping. [Paper]

  • Improved Deep Metric Learning with Multi-class N-pair Loss Objective. [Paper].

  • A Theoretical Analysis of Contrastive Unsupervised Representation Learning. [Paper]

  • What Makes for Good Views for Contrastive Learning? [Paper]

  • Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere [Paper]

  • How Well Do Self-Supervised Models Transfer? [Paper]

Unsupervised Image Contrastive Learning

ImageNet:

  • Unsupervised Feature Learning via Non-parameteric Instance Discrimination. [Paper]

  • Representation Learning with Contrastive Predictive Coding. [Paper]

  • Data-Efficient Image Recognition with Contrastive Predictive Coding. [Paper]

  • Contrastive Multiview Coding. [Paper]

  • Local Aggregation for Unsupervised Learning of Visual Embeddings. [Paper]

  • Learning Representations by Maximizing Mutual Information Across Views. [Paper]

  • Momentum Contrast for Unsupervised Visual Representation Learning. [Paper]

  • Self-Supervised Learning of Pretext-Invariant Representations. [Paper]

  • A Simple Framework for Contrastive Learning of Visual Representations. [paper]

  • Improved Baselines with Momentum Contrastive Learning. [Paper]

  • What Makes for Good Views for Contrastive Learning? [Paper]

  • Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning [Paper]

  • Big Self-Supervised Models are Strong Semi-Supervised Learners [Paper]

None-ImageNet:

  • Learning deep representations by mutual information estimation and maximization. [Paper]

  • Unsupervised embedding learning via invariant and spreading instance feature. [Paper]

Supervised Image Contrastive Learning

  • Supervised Contrastive Learning. [Paper]

Contrastive Learning in Audio

  • wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. [Paper]

Contrastive Learning in Videos

  • Time-Contrastive Networks: Self-Supervised Learning from Video. [Paper]

  • Contrastive Multiview Coding. [Paper]

  • Learning Video Representations using Contrastive Bidirectional Transformer. [Paper]

  • End-to-End Learning of Visual Representations from Uncurated Instructional Videos. [Paper]

  • Multi-modal Self-Supervision from Generalized Data Transformations. [Paper]

  • AVLnet: Learning Audio-Visual Language Representations from Instructional Videos. [Paper]

  • Self-Supervised MultiModal Versatile Networks. [Paper]

  • Memory-augmented Dense Predictive Coding for Video Representation Learning. [Paper]

  • Spatiotemporal Contrastive Video Representation Learning [Paper]

  • Self-supervised Co-training for Video Representation Learning [Paper]

Language Contrastive Learning

  • Distributed Representations of Words and Phrases and their Compositionality [Paper]

  • An efficient framework for learning sentence representations [Paper]

  • XLNet: Generalized Autoregressive Pretraining for Language Understanding [Paper]

  • A Mutual Information Maximization Perspective of Language Representation Learning. [Paper]

  • InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. [Paper]

Contrastive Learning in Graph

  • Contrastive Multi-View Representation Learning on Graphs. [ICML 2020] [Paper]

  • GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training. [KDD 2020] [Paper]

  • InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization. [ICLR 2020] [Paper]

Applications

  • Contrastive Learning for Unpaired Image-to-Image Translation