Skip to content

aikindergarten/fasthugs

Repository files navigation

FastHugs

Training HuggingFace models using fastai

Install

pip install git+git://github.com/aikindergarten/fasthugs.git

How to use

Pre-training

Masked Language modeling

Fine-tuning

  1. Sentiment classification: IMDB
  2. GLUE benchmark
  3. Machine Translation
  4. Summarization
  5. Multiple Choice
  6. Token Classification

Hyper-parameter search

W&B sweeps

And more coming soon...

Acknoledgements

This library is lightweight wrapper for this two awesome libraries: HuggingFace transformers and fastai and is inspired by other work in same direction namely earlier fasthugs by @morganmcg1 and blurr by @ohmeow.