Skip to content
This repository has been archived by the owner on Oct 9, 2019. It is now read-only.

Document limitations of nested fuzzers #237

Open
c-fraser opened this issue Apr 30, 2018 · 0 comments
Open

Document limitations of nested fuzzers #237

c-fraser opened this issue Apr 30, 2018 · 0 comments
Labels

Comments

@c-fraser
Copy link

When testing with fuzzers for a large/complex model with many nested models I encountered issues with test performance. My tests would either take a very long time to complete or threw an out of memory exception. To prevent encountering the out of memory exception I reduced the amount of fuzzers used per test by decomposing my tests into smaller components, which also increased test performance. Documentation on the limitations of nested fuzzers would be helpful to people in the future who experience the same problems as myself.

@mgold mgold added the docs label May 1, 2018
WToma added a commit to WToma/featurematrix that referenced this issue Aug 26, 2018
  Works, but very slow: a 100 item run takes 50-65s. Printing timing info revealed that
only about 1/3rd of the time is spent running the test validation. The rest is presumably
the fuzzer. The shrinker never seems to come into play (which makes sense since all
tests pass). This seems to be a known issue with fuzzers:

  elm-community/elm-test#237

  With that said, I'll put this branch on hold. The code is as-is, as in not in a state
of which I'm particularly proud of but whatever :)
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants