Skip to content

Commit

Permalink
link text
Browse files Browse the repository at this point in the history
  • Loading branch information
slobentanzer committed Feb 6, 2024
1 parent 26a3815 commit dc5bac2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/benchmarking.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ We need to constantly evaluate the multitude of combinations of individual model
To this end, we are maintaining a living benchmarking framework that allows us to continuously compare the performance of different models and configurations on a variety of tasks.

The benchmark uses the pytest framework to orchestrate the evaluation of a number of models on a number of tasks.
The benchmark is run on a regular basis, and the results are published on the [BioChatter website](https://biochatter.org/benchmark-overview/).
The benchmark is run on a regular basis, and the results are published in the [benchmark section](https://biochatter.org/benchmark/).
The benchmarking suite can be found in the `benchmark` directory of the BioChatter repository.
It can be executed using standard pytest syntax, e.g., `poetry run pytest benchmark`.
As default behavior it checks, which test cases have already been executed and only executes the tests that have not been executed yet.
Expand Down

0 comments on commit dc5bac2

Please sign in to comment.