Skip to content

Latest commit

 

History

History
13 lines (11 loc) · 447 Bytes

README.md

File metadata and controls

13 lines (11 loc) · 447 Bytes

FAST: Feed-forward Assisted Transformers

Creating faster and more efficient transformers through novel fine-tuning methods

FAST: Feedforward-Augmented Sentence Transformers

Generalizing sentence embeddings to a wide range of natural language tasks using feedforward neural networks, with massive speedup on fine-tuning.

Setup

cd fast
conda create -y --name fast python==3.9
conda activate fast
pip install -r requirements.in