Backend de "La Leaderboard"

To evaluate the models in the requests dataset, run python3 -m main_eval_basic_queue.py
To evaluate the combination of models and tasks in tasks_todo.json, run python3 -m main_eval_internal_queue.py
To evaluate the models in the cluster's queue managed by slurm, run python3 -m main_eval_slurm_queue.py

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
basic_queue		basic_queue
internal_queue		internal_queue
slurm_queue		slurm_queue
.gitattributes		.gitattributes
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
README.md		README.md
main_eval_basic_queue.py		main_eval_basic_queue.py
main_eval_internal_queue.py		main_eval_internal_queue.py
main_eval_slurm_queue.py		main_eval_slurm_queue.py
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt

Provide feedback