Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vendored dependendencies are incomplete in the beta and nightly tarballs #38690

Closed
dvc94ch opened this issue Dec 29, 2016 · 5 comments
Closed
Labels
P-high High priority regression-from-stable-to-beta Performance or correctness regression from stable to beta.

Comments

@dvc94ch
Copy link
Contributor

dvc94ch commented Dec 29, 2016

The process of creating the tarballs doesn't include .gitignore files from src/vendor. This results in a missmatched hash failure when building with vendoring enabled. Hoping to switch to rustbuild with the next rust release!

FYI: I'd be happy with the vendoring happening during the create tarball process, having enormous vendoring commits in the git history is ugly...

screenshot from 2016-12-29 22-06-37

@brson
Copy link
Contributor

brson commented Dec 29, 2016

Needs to be fixed for 1.15.

@brson brson added regression-from-stable-to-beta Performance or correctness regression from stable to beta. I-nominated labels Dec 29, 2016
@brson
Copy link
Contributor

brson commented Dec 29, 2016

cc @alexcrichton

@brson
Copy link
Contributor

brson commented Dec 29, 2016

Seems like the vendoring process should include a sanity check that the vendored sources hash correctly.

@alexcrichton
Copy link
Member

Fixed in #38708

bors added a commit that referenced this issue Dec 31, 2016
Gate on distcheck on Travis

This commit adds a new entry to the Travis matrix to gate on distcheck, the illustrious test process that has historically taken *8 hours* to complete and also breaks all the time on nightly. By adding it to Travis we should hope to never see nightly breakage (like #38690) because of this ever again!

"But wait, surely we can't wait 8 hours for all PRs!" you might be thinking, and you are indeed correct. The distcheck added here is much more optimized for speed than the old buildbot instances for a number of reasons:

* We're not building *two host compilers* beforehand. The current distcheck bot does a cross for i686 Linux and x86_64 Linux before it actually runs distcheck, building 6 compilers and LLVM twice. None of this is done in parallel as well (e.g. `-j1`). Not doing any of this work will be a huge win!
* We're using sccache to compile LLVM, so it should be much faster. Distcheck on the bots didn't cache LLVM well and rebuilt it every time.

All in all, this version of "distcheck" should be exactly like other matrix entries that run tests except that it's a *little* slower to start as it has to create the source tarball then rebuild the build system in the distcheck dir. Overall this should be well under the 2 hours that Android is currently taking anyway.

Closes #38691
@bors bors closed this as completed in d0881ea Jan 1, 2017
@dvc94ch
Copy link
Contributor Author

dvc94ch commented Jan 1, 2017 via email

nikomatsakis pushed a commit to nikomatsakis/rust that referenced this issue Jan 6, 2017
The source tarball creation step would attempt to skip a number of files that we
want to ignore ourselves, but once we've hit the vendor directory we don't want
to skip anything so be sure to vendor everything inside that directory.

Closes rust-lang#38690
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P-high High priority regression-from-stable-to-beta Performance or correctness regression from stable to beta.
Projects
None yet
Development

No branches or pull requests

3 participants