Show Atheris+Hypothesis #2
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Hypothesis, the property-based testing library, has great support for external fuzzers. This makes developing fuzz harnesses easy, and it can automatically replay and minimize failing examples.
Closed
TheShiftedBit
added a commit
that referenced
this pull request
Dec 4, 2020
…thon Using ASan or UBSan breaks Python code coverage and severely harms native code coverage. This can be solved by linking libFuzzer into the Python runtime directly, rather than into Atheris. This change does the following: 1) pip now installs both "atheris" and "atheris_no_libfuzzer". atheris_no_libfuzzer doesn't include libFuzzer in its .so, requiring it to be provided by the Python runtime. 2) Instructions and a script are provided for building CPython 3.8.6 with libFuzzer linked in. 3) pip now installs the version of libFuzzer used when building Atheris to site-packages. The hack used to create this version from outdated libFuzzers is now less hacky and more stable, requiring only one objcopy instead of two. This is used by the script in #2 to build CPython. 4) Debug information is added to alert the user when coverage symbols aren't coming from libFuzzer. PiperOrigin-RevId: 345675056 Change-Id: I41d5e74ab77079c09f94b9d599d61d687065cbc9
TheShiftedBit
added a commit
that referenced
this pull request
Jul 28, 2021
…thon Using ASan or UBSan breaks Python code coverage and severely harms native code coverage. This can be solved by linking libFuzzer into the Python runtime directly, rather than into Atheris. This change does the following: 1) pip now installs both "atheris" and "atheris_no_libfuzzer". atheris_no_libfuzzer doesn't include libFuzzer in its .so, requiring it to be provided by the Python runtime. 2) Instructions and a script are provided for building CPython 3.8.6 with libFuzzer linked in. 3) pip now installs the version of libFuzzer used when building Atheris to site-packages. The hack used to create this version from outdated libFuzzers is now less hacky and more stable, requiring only one objcopy instead of two. This is used by the script in #2 to build CPython. 4) Debug information is added to alert the user when coverage symbols aren't coming from libFuzzer. PiperOrigin-RevId: 345675056 Change-Id: I41d5e74ab77079c09f94b9d599d61d687065cbc9
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hypothesis, the property-based testing library, has great support for external fuzzers - while making it easy to develop fuzz harnesses. We can also automatically replay and minimize failing examples found by the fuzzer, which is a lovely debugging workflow 😁
I know that (an old version of) Hypothesis is used internally at Google, and I've been looking forward to this since @inferno-chromium mentioned a Python fuzzer was in the works in google/oss-fuzz#4121. My PhD is about how to upgrade familiar test tools and workflows with the power of fuzzing (among other tricks), and Atheris looks like an awesome upgrade to the Python ecosystem. Thanks for open-sourcing it!
(final note: I haven't fuzzed my example script for long, so Atheris may or may not find
ujsonbugs if left running)