-
-
Notifications
You must be signed in to change notification settings - Fork 368
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Benchmark: Enable 9.6, 9.8 #4118
Conversation
"Two highest" would also be reasonable, as those are the ones we are going to support for longest. But "highest and lowest" captures the most difference, so is maybe indeed the most interesting. If we do this we should write it down. |
Due to its error behaviour on lsp-types-3.1.1.0, In favor of using basic configuration for hie.yaml.
Some thing problematic with the hie.yaml generated by implicit-hie for lsp-types-2.1.1.0. Bench for 4 versions of ghc: Total duration If not I'll chunk it to only run for newest and oldest and add the comment as @michaelpj suggest. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great work!
I'm not really sure which option is the best (2 highest vs. newest+oldest) but having all 4 seems too much.
From maintenance point of view 2 highest sounds easiest to maintain.
When we add a new ghc (e.g. 9.10)
- 2 highest will require dropping the older one and adding a new one (e.g. drop 9.6, add 9.10)
- newest+oldest will require updating the oldest to one higher (9.2->9.4) + newest to one higher (9.8->9.10)
So I would vote for "2 highest", but don't feel too strongly about it.
@@ -1835,8 +1835,6 @@ test-suite wrapper-test | |||
benchmark benchmark | |||
import: defaults, warnings | |||
-- Depends on shake-bench which is unbuildable after this point | |||
if impl(ghc >= 9.5) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The comment above belongs to this if, so I think it should be removed too.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
indeed
@@ -17,8 +17,6 @@ source-repository head | |||
|
|||
library | |||
-- Depends on Chart which is unbuildable after this point | |||
if impl(ghc >= 9.5) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this comment still true? Is chart now buildable?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not true, we can build chart, I forget to delete them.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks for fixing up the benchmark!
I think just do two. 51 minutes is a lot, and the benchmark job does actually run quite a bit, so we're just burning CPU cycles for not much benefit. |
Co-authored-by: fendor <fendor@users.noreply.github.com>
After hearing you guys opinion. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks! LGTM
~~ Enable 4 version to do bench seems to be taking too long, considering picking two: highest and lowest ~~
Fix bench for newer ghc versions
The following have been done:
Cabal version: 3.10.2.1, lsp-types version: 2.1.1.0
*.hp
files duplicates its extension name