Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement a cmdline tool #1799

Closed
sametmax opened this issue Feb 7, 2019 · 3 comments
Closed

Implement a cmdline tool #1799

sametmax opened this issue Feb 7, 2019 · 3 comments

Comments

@sametmax
Copy link

sametmax commented Feb 7, 2019

Fuzzying is something that is generally very useful, not just for function testing, and we could use hypothesis like afl.

Beside, ideas like hypothesis-pip (https://twitter.com/vorpalsmith/status/1093346524367474688) would be easier to implement.

@Zac-HD
Copy link
Member

Zac-HD commented Feb 7, 2019

@njsmith's hypothesis-pip concept could be implemented like this actually: a custom strategy that finds "allowed but probably invalid" dependency combinations, and a function that shells out to install them and run the tests. A really nasty option would be to do this to transitive dependencies too! But that's not really in scope for the core Hypothesis project; it's two functions and a pile of shell scripting.

We do have #171 for a long-running fuzzing mode, but it will still be running functions just like the current Hypothesis API! If it's not running Python functions (which can of course "shell out" to other programs...), a classic fuzzer like AFL might be better for the job than a property-based testing library like Hypothesis. What use-case did you have in mind?

@sametmax
Copy link
Author

sametmax commented Feb 8, 2019

Just having an afl equivalent in pure Python: it would work anywhere python is available, and not just Linux.

@Zac-HD
Copy link
Member

Zac-HD commented Feb 8, 2019

That's quite a distinct project from Hypothesis unfortunately - it would probably be easier to start from scratch, though I guess you could use Hypothesis as part of the project. Closing the issue as out of scope 😕

@Zac-HD Zac-HD closed this as completed Feb 8, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants