ci: Use configurable !benchmark
PR comment
#1114
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Configurable
!benchmark
PR commentUses the reusable workflow from argumentcomputer/ci-workflows#38. This replaces the existing
!gpu-benchmark
command with!benchmark
, as shown in the following examples:This will run the default benchmark settings, specified in the workflow file of this PR.
Alternatively:
This will run with each of the input benchmarks, features, and env vars.
Important
--features cuda
in the comment body (see above example). Otherwise, the benchmarks will still run on the same GPU-equipped benchmark machine, but will run using the CPU only.Details
!gpu-benchmark
syntax will no longer work. The command must start with!benchmark
.--bench
will spawn a new CI job, which means they will each output a separate comment.The default env vars specified in this PR are
If identically named env vars are specified in the
!benchmark
comment, they will overwrite the above defaults.