Tasks:
- Fix plugin speed (maybe: https://github.com/dropd/reentry)
- Save junit test results
- Add a cachedir
- Add logging
- Add a way of specifying where sources are
- make a coverage file prefix
- show cov diffs
- fix failing null test
- add plugin monitor controls
- fix schema validation between plugins
- make shareable assert checks (dict includes, dict doesnt incl, regex keys)
- add pytest, mypy, coverage
- fix mypy asserts
- increase coverage
- yea should copy files and run in work dir
- yea should support directory tests
- add check expressions