Overview
This patch includes support for fine-tuning Llama3.1 with torchtune as well as various improvements to the library.
New Features & Improvements
Models
- Added support for Llama3.1 (#1208)
Modules
- Tokenizer refactor to improve the extensibility of our tokenizer components (#1082)