Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build Nix flake checks in test mode #5491

Merged
merged 3 commits into from
Jan 29, 2025
Merged

Conversation

thoughtpolice
Copy link
Member

Also includes an extra tidbit to track down slow tests in CI.

Checklist

If applicable:

  • I have updated CHANGELOG.md
  • I have updated the documentation (README.md, docs/, demos/)
  • I have updated the config schema (cli/src/config-schema.json)
  • I have added tests to cover my changes

@thoughtpolice thoughtpolice force-pushed the aseipp/push-lstzunxprqtv branch 3 times, most recently from 430a747 to eb0728f Compare January 27, 2025 21:38
.config/nextest.toml Outdated Show resolved Hide resolved
flake.nix Show resolved Hide resolved
Copy link
Contributor

@ilyagr ilyagr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm mostly approving this based on the CI, in the hopes it will decrease flakyness. We can revert things if they don't work. Or, if some more Nix-y person wants to review this before it's merged, please leave a comment.

I also did check that nix flake check, nix build, and nix shell work with this, though I'm not sure how optimized they are.

flake.nix Outdated Show resolved Hide resolved
@thoughtpolice thoughtpolice force-pushed the aseipp/push-lstzunxprqtv branch from eb0728f to 971910e Compare January 29, 2025 19:50
Some of our builds have been timing out, and one angle I want to look at
is whether any tests are hanging. Nextest can help us keep track of slow
tests in CI where the underlying hosts will have significantly higher
load. In general this should also help keep our tests healthy, IMO.

I don't see any reason why any existing test should take over 20
seconds, but it should at least help control for really slow runners
that have huge latency spikes. we can start there and see how it goes
in practice.

Signed-off-by: Austin Seipp <aseipp@pobox.com>
This should help reduce time spent on closure downloads.

Signed-off-by: Austin Seipp <aseipp@pobox.com>
Overall, building in the test profile should significantly speed up
the overall build pipeline because so many less cycles are spent (on
GHA runners that are certainly at high load). The goal here is to help
reduce CI flake outs due to things timing out; I suspect part of the
problem may be a lot of the ~15 minute time limit being used up just
compiling things.

This is a partial revert of b714592, which removed this previous
override of the Flake `checks`.

Signed-off-by: Austin Seipp <aseipp@pobox.com>
@thoughtpolice thoughtpolice force-pushed the aseipp/push-lstzunxprqtv branch from 971910e to 83c3ac4 Compare January 29, 2025 20:00
@thoughtpolice thoughtpolice added this pull request to the merge queue Jan 29, 2025
Merged via the queue into main with commit 6f1d15b Jan 29, 2025
35 checks passed
@thoughtpolice thoughtpolice deleted the aseipp/push-lstzunxprqtv branch January 29, 2025 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants