-
Notifications
You must be signed in to change notification settings - Fork 383
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Build Nix flake checks in test
mode
#5491
Conversation
430a747
to
eb0728f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm mostly approving this based on the CI, in the hopes it will decrease flakyness. We can revert things if they don't work. Or, if some more Nix-y person wants to review this before it's merged, please leave a comment.
I also did check that nix flake check
, nix build
, and nix shell
work with this, though I'm not sure how optimized they are.
eb0728f
to
971910e
Compare
Some of our builds have been timing out, and one angle I want to look at is whether any tests are hanging. Nextest can help us keep track of slow tests in CI where the underlying hosts will have significantly higher load. In general this should also help keep our tests healthy, IMO. I don't see any reason why any existing test should take over 20 seconds, but it should at least help control for really slow runners that have huge latency spikes. we can start there and see how it goes in practice. Signed-off-by: Austin Seipp <aseipp@pobox.com>
This should help reduce time spent on closure downloads. Signed-off-by: Austin Seipp <aseipp@pobox.com>
Overall, building in the test profile should significantly speed up the overall build pipeline because so many less cycles are spent (on GHA runners that are certainly at high load). The goal here is to help reduce CI flake outs due to things timing out; I suspect part of the problem may be a lot of the ~15 minute time limit being used up just compiling things. This is a partial revert of b714592, which removed this previous override of the Flake `checks`. Signed-off-by: Austin Seipp <aseipp@pobox.com>
971910e
to
83c3ac4
Compare
Also includes an extra tidbit to track down slow tests in CI.
Checklist
If applicable:
CHANGELOG.md