Skip to content

VectorLM v0.1.0
Compare
Choose a tag to compare
@adil-a adil-a released this 23 Jan 19:43
· 17 commits to master since this release
v0.1.0
69f6309
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

This release officially puts out our lightweight package designed to train medium-sized LLMs in communication-bottlenecked environments!

  • Support for dense fine-tuning LLMs in single/multi-node settings.
  • Added support for several optimization techniques out of the box that were covered.
  • Added example scripts for LLaMa model fine-tuning.

As we move forward, we will be additionally providing support for distributed fine-tuning models using PEFT methods!

Assets 2
Loading