Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up build & tests on Circle #618

Merged
merged 4 commits into from
Nov 5, 2015
Merged

Speed up build & tests on Circle #618

merged 4 commits into from
Nov 5, 2015

Conversation

tomwilkie
Copy link
Contributor

Fixes #587

Lots of changes:

  • do the darwin build on one shard, the arm build on another.
  • Ensure we use up to date build container when running tests
  • Parallelise host setup for integration tests. (~30s saved)
  • Pass some more circle env vars through to ./tools/tests so the scheduler works. (~2mins saved)
  • Gather coverage from multiple shards.
  • Create files as the right owner inside the container (so we can compile the coverage stats)
  • Parallelise the circle.yaml
  • Build experimental in parallel. (~1min saved)

@tomwilkie tomwilkie self-assigned this Nov 3, 2015
@tomwilkie tomwilkie force-pushed the 587-parallelise branch 7 times, most recently from 621db84 to 419b1df Compare November 4, 2015 12:41
@tomwilkie tomwilkie changed the title [WIP] Parallelise tests on Circle [WIP] Speed up tests on Circle Nov 4, 2015
@tomwilkie tomwilkie changed the title [WIP] Speed up tests on Circle [WIP] Speed up build & tests on Circle Nov 4, 2015
- Ensure we use up to date build container when running tests.
- Parallelise host setup for integration tests.
- Pass some more circle env vars through to ./tools/tests so the scheduler works.
- Gather coverage from multiple shards.
- Create files as the right owner inside the container.
- Parallelise the circle.yaml
- Parallelise the intergration tests using existing machinery
- Build experimental in parallel.
- Use custom scheduler prefix for integration tests, so schedules don't clash with weave.
28c6aa0 Make prefix on runner schedule optional.
452f2b7 Merge pull request #8 from weaveworks/7-gzip
4be5541 Add gather_coverage.sh script.
e22c576 Compress cached images.
f250a3b Add sched CLI and update readme.
6b3c735 Add scheduler from weave

git-subtree-dir: tools
git-subtree-split: 28c6aa063c1b171c3ba42d958ad640d49f8c39f2
@tomwilkie
Copy link
Contributor Author

This disappointingly only seems to shave a few minutes off. There is scope for a couple more, but after that we'll have to get more aggressive.

Now is a good time to stick this in.

@tomwilkie tomwilkie changed the title [WIP] Speed up build & tests on Circle Speed up build & tests on Circle Nov 5, 2015
paulbellamy added a commit that referenced this pull request Nov 5, 2015
Speed up build & tests on Circle
@paulbellamy paulbellamy merged commit 73e05d0 into master Nov 5, 2015
@paulbellamy paulbellamy deleted the 587-parallelise branch November 5, 2015 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants