Skip to content

Managed pipeline for training, evaluating, inferencing & deploying HF NLP models.

License

Notifications You must be signed in to change notification settings

SpellcraftAI/hfl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

hfl

Static Badge Static Badge

hfl is a single-file static configuration pipeline tool for HF.

hfl only works with common NLP tasks & is configured with PyTorch.

This is currently experimental (WIP).

Motivation

This section is incomplete.

Feature Matrix

  • Basic pipelines.
  • Inherited checkpoints (model & tokenizer).
  • Multi-sequence tokenization.
  • Training on train datasets (local & AWS SageMaker).
  • Deploying fine-tuned models (push_to_hub).
  • Localized metrics from test sets.
  • Specifying custom preprocessor scripts.
  • Integration with custom training loops.

Installation

Target a global pip installation to this repository.

Build from Source

Windows Compat

You can either make create_env_win_cmd or if you require to change the execution policy then make create_env_win_pow followed by the relevant load target.

Usage

This section is incomplete.

About

Managed pipeline for training, evaluating, inferencing & deploying HF NLP models.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published