Skip to content

Commit cfbaff2

Browse files
authoredOct 25, 2024
ci: benchmark only BenchmarkBenchdata (#3007)
A bit radical, but I'm open to other benchmarks we should include. Essentially, in an effort to have a small amount of meaningful benchmarks, I'd like for these to only be those in BenchmarkBenchdata. Yes, I recognize this is tooting my own horn, but I think they are good benchmarks that tell us, overall, if the GnoVM on a few reference programs got slower or faster, and I found them useful in the past while doing manual execution. Most other benchmarks are micro-benchmarks, which aren't likely to change often or to give us useful insight. I'm open to suggestions for others that make sense to be tracked, but I think it's for the better if we keep the number low so the CI for benchmarks can run in just a few minutes.
1 parent 49e718c commit cfbaff2

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed
 

‎.github/workflows/benchmark-master-push.yml

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -34,9 +34,12 @@ jobs:
3434
go-version: "1.22.x"
3535

3636
- name: Run benchmark
37+
# add more benchmarks by adding additional lines for different packages;
38+
# or modify the -bench regexp.
3739
run: |
38-
go test -benchmem -bench=. ./... -run=^$ \
39-
-cpu 1,2 -timeout 50m | tee benchmarks.txt
40+
set -xeuo pipefail && (
41+
go test ./gnovm/pkg/gnolang -bench='BenchmarkBenchdata' -benchmem -run='^$' -v -cpu=1,2
42+
) | tee benchmarks.txt
4043
4144
- name: Download previous benchmark data
4245
uses: actions/cache@v4

0 commit comments

Comments
 (0)