Files

.cursor
.github
docs
examples
- contributor-guide
- custom-dataloader
- doremi
- inference
- llama
- mamba
- moe
- mup
- __init__.py
- bench_llama_7b.py
- config_nanoset.yaml
- config_qwen.py
- config_qwen.yaml
- config_qwen_with_moe.yaml
- config_resume_training.py
- config_resume_training.yaml
- config_tiny_llama.py
- config_tiny_llama.yaml
- config_tiny_llama_with_s3_upload.yaml
- train_tiny_llama.sh
scripts
src
tests
tools
.gitignore
.pre-commit-config-check.yaml
.pre-commit-config.yaml
.pylintrc
CODE_OF_CONDUCT.md
CONTRIBUTING.md
LICENSE
Makefile
README.md
pyproject.toml
run_evals.py
run_generate.py
run_train.py
slurm_launcher.py
test_timer_decorator.py

init.py

Mar 13, 2025

2f420d2 · Mar 13, 2025