Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add NoFuzzing() testing option #296

Merged
merged 1 commit into from
Feb 6, 2023
Merged

feat: add NoFuzzing() testing option #296

merged 1 commit into from
Feb 6, 2023

Conversation

ivokub
Copy link
Collaborator

@ivokub ivokub commented Mar 25, 2022

The new testing option allows to run assertions on test.Assert without fuzzing. My use case for running tests without fuzzing is in gadget where some errors panic to simplify the API.

Additionally, I was not sure if we should omit fuzzing when the tests are run in short mode? Should we?

@ivokub ivokub self-assigned this Mar 25, 2022
@ivokub ivokub added this to the v0.7.0 milestone Mar 25, 2022
@ivokub ivokub requested a review from gbotrel March 25, 2022 14:38
@gbotrel
Copy link
Collaborator

gbotrel commented Mar 25, 2022

maybe it shouldn't be ran actually with "PRoverSucceeded" call. The point of this method is to test constraint system solver against the big.Int test engine -> if a witness fails/succeeds with one, it should with the others.

What about just calling that separately on our integration tests?

@ivokub
Copy link
Collaborator Author

ivokub commented Mar 25, 2022

Yup, removing fuzz testing in ProverSucceeded and then fuzzing separately in integration tests makes sense.
On a similar note -- maybe also remove marshalling tests from ProverSucceeded and move them into a new method? And add assert.AllTests etc. method for doing marshalling, compiling/solving, fuzzing etc.

@ivokub ivokub marked this pull request as draft March 25, 2022 23:41
@ivokub
Copy link
Collaborator Author

ivokub commented Mar 25, 2022

(converted to draft until figuring what direction to take)

@ivokub ivokub mentioned this pull request Jul 13, 2022
@ivokub
Copy link
Collaborator Author

ivokub commented Jul 15, 2022

@gbotrel, do you have suggestion what to do with this PR? Someone stumbled against a similar problem why this PR was created (#336).

@gbotrel gbotrel marked this pull request as ready for review February 6, 2023 16:05
@gbotrel gbotrel merged commit 22f5cbc into develop Feb 6, 2023
@gbotrel gbotrel deleted the feat/nofuzzing branch February 6, 2023 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants