Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ci): tweak heavy fuzz run parameters #11894

Merged
merged 1 commit into from
Sep 12, 2024
+9 −4
Merged

fix(ci): tweak heavy fuzz run parameters #11894

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion .circleci/config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -559,6 +559,10 @@ jobs:
test_command:
description: List of test files to run
type: string
test_timeout:
description: Timeout for running tests
type: string
default: 15m
parallelism: <<parameters.test_parallelism>>
steps:
- checkout
Expand Down Expand Up @@ -596,7 +600,7 @@ jobs:
environment:
FOUNDRY_PROFILE: ci
working_directory: packages/contracts-bedrock
no_output_timeout: 15m
no_output_timeout: <<parameters.test_timeout>>
- run:
name: print failed test traces
command: just test-rerun
Expand Down Expand Up @@ -1579,6 +1583,7 @@ workflows:
# Heavily fuzz any fuzz tests that have been added or modified.
name: contracts-bedrock-tests-heavy-fuzz-modified
test_parallelism: 1
test_timeout: 1h
test_command: just test-heavy-fuzz-modified-tests
- contracts-bedrock-coverage
- contracts-bedrock-checks:
Expand Down
6 changes: 3 additions & 3 deletions packages/contracts-bedrock/scripts/testing/test-heavy-fuzz-modified-tests.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,10 +12,10 @@ set -euo pipefail
# modified.

# Set the number of fuzz runs to run.
# 350000 fuzz runs will guarantee that any test that fails 1% of the time with
# the default 512 fuzz runs will fail 99.9% of the time (on average) inside of
# 75000 fuzz runs will guarantee that any test that fails 5% of the time with
# the default 512 fuzz runs will fail >99.9% of the time (on average) inside of
# this script.
FUZZ_RUNS=${1:-350000}
FUZZ_RUNS=${1:-75000}

# Set the number of invariant runs to run.
# Invariant runs are generally slower than fuzz runs so we can't afford to run
Expand Down