Paper-review

하나하나씩 해보는 논문 리뷰!

---

To-Do

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting -> rl idea2

BETTER FINE-TUNING BY REDUCING REPRESENTATIONAL COLLAPSE -> r3f idea

SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization 2021 -> rerank idea?

---

Done

1. Computer Vision

• StarGAN v2: Diverse Image Synthesis for Multiple Domains

2. NLP Models

• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

• DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION

• DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

• Attention is all you need

Abstractive Summarization

• Reference and Document Aware Semantic Evaluation Methods for Korean Language Summarization -> Korean Abstractive summarization: RDASS(KAKAO)

• A DEEP REINFORCED MODEL FOR ABSTRACTIVE SUMMARIZATION -> RL loss + CE loss

3. TTS

• TACOTRON: TOWARDS END-TO-END SPEECH SYNTHESIS