-
-
Notifications
You must be signed in to change notification settings - Fork 3.1k
fuzzing: implement limited fuzzing #25342
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Adds the limit option to `--fuzz=[limit]`. the limit expresses a number of iterations that *each fuzz test* will perform at maximum before exiting. The limit argument supports also 'K', 'M', and 'G' suffixeds (e.g. '10K'). Does not imply `--web-ui` (like unlimited fuzzing does) and prints a fuzzing report at the end. Closes #22900 but does not implement the time based limit, as after internal discussions we concluded to be problematic to both implement and use correctly.
d84a078 to
0feacc2
Compare
andrewrk
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I didn't get a chance to look at the fuzzer lib changes yet but I think the requested changes to test runner are important enough they should be fixed before moving forward with this.
I'm happy to help with this
| f.start(); | ||
| f.waitAndPrintReport(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fine for this branch, but noting for any contributors watching this PR: a future enhancement will be to make fuzzing limited mode be part of the main build graph pipeline. In other words, limited mode fuzzing should run at the same time as the rest of the build.
c3a0246 to
9bb0b43
Compare
andrewrk
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks ready to land - thanks for the changes!
--debug-rt previously would make rt libs match the root module. Now they are always debug when --debug-rt is passed. This includes compiler-rt, fuzzer lib, and others.
This would cause the web ui to crash in js or wasm.
Adds the limit option to
--fuzz. the limit expresses a number of iterations that each fuzz test will perform at maximum before exiting. The limit argument supports also 'K', 'M', and 'G' suffixes (e.g. '10K').Does not imply
--webui(like unlimited fuzzing does) and prints a fuzzing report at the end.Closes #22900 but does not implement the time based limit, as after internal discussions we concluded to be problematic to both implement and use correctly.