Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Benchmarking plugin (take two) #4283

Merged
merged 2 commits into from
Jul 14, 2023

Conversation

robin-aws
Copy link
Member

Redoes #4215, which had to be reverted. Weakens the test that caused trouble due to the non-determinism of benchmarking (see second commit).

By submitting this pull request, I confirm that my contribution is made under the terms of the MIT license.

robin-aws and others added 2 commits July 13, 2023 13:54
Adds a compiler plugin to implement support for a class-level
`{:benchmarks}` attribute. See `DafnyBenchmarkingPlugin/README.md` for
details.

Since the existing plugin interface didn't support this use case, and
we'd like it to so other similar features like `{:test}` and coverage
instrumentation can also be plugins in the future, I also added a new
`CompilerInstrumenter` plugin interface similar to `Rewriter`.

The integration test for this plugin is also a negative test for
dafny-lang#1454, which will be fixed in
a separate pending PR.

<small>By submitting this pull request, I confirm that my contribution
is made under the terms of the [MIT
license](https://github.com/dafny-lang/dafny/blob/master/LICENSE.txt).</small>

---------

Co-authored-by: Remy Willems <rwillems@amazon.com>
@robin-aws robin-aws added the run-deep-tests Tells CI to run all tests label Jul 13, 2023
Copy link
Member

@atomb atomb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems like a reasonable change, since we can't guarantee to get a failure from JMH.

@robin-aws robin-aws merged commit faf8880 into dafny-lang:master Jul 14, 2023
33 checks passed
@robin-aws robin-aws deleted the benchmarking-plugin-take-two branch July 14, 2023 00:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run-deep-tests Tells CI to run all tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants