Clean out unused directories for extra disk space #69252

Mark-Simulacrum · 2020-02-18T00:40:46Z

This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.

Mark-Simulacrum · 2020-02-18T00:41:12Z

@bors try

We know that we can hit the problem on a try build, I believe, so let's try that.

bors · 2020-02-18T00:41:31Z

⌛ Trying commit dd6e41c with merge 9e7396e...

@ghost

Dump largest files on disk, not just in cwd. This will try to debug the disk space issues we're seeing (and potentially become the "fix" PR). r? @ghost

rust-highfive · 2020-02-18T00:59:32Z

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2020-02-18T00:58:44.1191206Z ========================== Starting Command Output ===========================
2020-02-18T00:58:44.1193945Z [command]/bin/bash --noprofile --norc /home/vsts/work/_temp/b4018b75-9173-48e9-bcea-a382c75e6a5a.sh
2020-02-18T00:58:44.1193991Z 
2020-02-18T00:58:44.1197953Z ##[section]Finishing: Disable git automatic line ending conversion
2020-02-18T00:58:44.1204847Z ##[section]Starting: Checkout rust-lang/rust@refs/pull/69252/merge to s
2020-02-18T00:58:44.1206451Z Task         : Get sources
2020-02-18T00:58:44.1206485Z Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
2020-02-18T00:58:44.1206562Z Version      : 1.0.0
2020-02-18T00:58:44.1206595Z Author       : Microsoft
---
2020-02-18T00:58:46.4227405Z ##[command]git remote add origin https://github.com/rust-lang/rust
2020-02-18T00:58:46.4240471Z ##[command]git config gc.auto 0
2020-02-18T00:58:46.4242666Z ##[command]git config --get-all http.https://github.com/rust-lang/rust.extraheader
2020-02-18T00:58:46.4245472Z ##[command]git config --get-all http.proxy
2020-02-18T00:58:46.4251862Z ##[command]git -c http.extraheader="AUTHORIZATION: basic ***" fetch --force --tags --prune --progress --no-recurse-submodules --depth=2 origin +refs/heads/*:refs/remotes/origin/* +refs/pull/69252/merge:refs/remotes/pull/69252/merge

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

rust-highfive · 2020-02-18T01:01:39Z

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

2020-02-18T01:00:56.0092437Z ========================== Starting Command Output ===========================
2020-02-18T01:00:56.0095351Z [command]/bin/bash --noprofile --norc /home/vsts/work/_temp/1eec2dd7-002a-47aa-98cd-b0076075d7c4.sh
2020-02-18T01:00:56.0095402Z 
2020-02-18T01:00:56.0098762Z ##[section]Finishing: Disable git automatic line ending conversion
2020-02-18T01:00:56.0104670Z ##[section]Starting: Checkout rust-lang/rust@refs/pull/69252/merge to s
2020-02-18T01:00:56.0106540Z Task         : Get sources
2020-02-18T01:00:56.0106567Z Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
2020-02-18T01:00:56.0106594Z Version      : 1.0.0
2020-02-18T01:00:56.0106630Z Author       : Microsoft
---
2020-02-18T01:00:56.8542922Z ##[command]git remote add origin https://github.com/rust-lang/rust
2020-02-18T01:00:56.8631688Z ##[command]git config gc.auto 0
2020-02-18T01:00:56.8718144Z ##[command]git config --get-all http.https://github.com/rust-lang/rust.extraheader
2020-02-18T01:00:56.8769728Z ##[command]git config --get-all http.proxy
2020-02-18T01:00:56.8904634Z ##[command]git -c http.extraheader="AUTHORIZATION: basic ***" fetch --force --tags --prune --progress --no-recurse-submodules --depth=2 origin +refs/heads/*:refs/remotes/origin/* +refs/pull/69252/merge:refs/remotes/pull/69252/merge

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

JohnTitor · 2020-02-18T01:22:08Z

Rubber-stamping
@bors r+ rollup

bors · 2020-02-18T01:22:10Z

📌 Commit 304d1a9 has been approved by JohnTitor

bors · 2020-02-18T01:22:10Z

🌲 The tree is currently closed for pull requests below priority 100, this pull request will be tested once the tree is reopened

Clean out unused directories for extra disk space This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.

@ghost

Rollup of 8 pull requests Successful merges: - #67272 (recursion_limit parsing handles overflows) - #68597 (Simplify `Skip::nth` and `Skip::last` implementations) - #68767 (macOS: avoid calling pthread_self() twice) - #69175 (Do not ICE when encountering `yield` inside `async` block) - #69223 (Ignore GDB versions with broken str printing.) - #69244 (configure: set LLVM flags with a value) - #69249 (Stabilize {f32, f64}::{LOG2_10, LOG10_2}) - #69252 (Clean out unused directories for extra disk space) Failed merges: r? @ghost

src/ci/scripts/dump-environment.sh

This helps us have enough disk space for our builders to be able to complete successfully. For now, the choices are ad-hoc and 'definitely not needed'. This should never fail the build, as everything our build needs should be inside Docker.

pietroalbini · 2020-02-18T10:35:45Z

@bors r+ p=1000

bors · 2020-02-18T10:35:46Z

📌 Commit c992ab2 has been approved by pietroalbini

bors · 2020-02-18T10:35:47Z

🌲 The tree is currently closed for pull requests below priority 100, this pull request will be tested once the tree is reopened

bors · 2020-02-18T10:35:59Z

⌛ Testing commit c992ab2 with merge 2d1a6b42b8261195b845bc597fdf5f815ad76ca3...

…lbini Clean out unused directories for extra disk space This cleans out some of the unused (but large) directories on our linux builders to hopefully allow them to complete without running out of disk space.

JohnTitor · 2020-02-18T11:10:44Z

It works well, let's include this to rollup
@bors retry

@ghost

Rollup of 8 pull requests Successful merges: - #67272 (recursion_limit parsing handles overflows) - #68597 (Simplify `Skip::nth` and `Skip::last` implementations) - #68767 (macOS: avoid calling pthread_self() twice) - #69175 (Do not ICE when encountering `yield` inside `async` block) - #69223 (Ignore GDB versions with broken str printing.) - #69244 (configure: set LLVM flags with a value) - #69249 (Stabilize {f32, f64}::{LOG2_10, LOG10_2}) - #69252 (Clean out unused directories for extra disk space) Failed merges: r? @ghost

bors · 2020-02-18T14:48:32Z

⌛ Testing commit c992ab2 with merge 6317721...

bors added a commit that referenced this pull request Feb 18, 2020

Auto merge of #69252 - Mark-Simulacrum:disk-try, r=<try>

9e7396e

Dump largest files on disk, not just in cwd. This will try to debug the disk space issues we're seeing (and potentially become the "fix" PR). r? @ghost

Mark-Simulacrum force-pushed the disk-try branch 2 times, most recently from 6027618 to 20f79b6 Compare February 18, 2020 00:58

Mark-Simulacrum changed the title ~~Dump largest files on disk, not just in cwd.~~ Clean out unused directories for extra disk space Feb 18, 2020

Mark-Simulacrum force-pushed the disk-try branch from 20f79b6 to 9f4e757 Compare February 18, 2020 01:00

Mark-Simulacrum force-pushed the disk-try branch from 9f4e757 to 304d1a9 Compare February 18, 2020 01:04

bors added the S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. label Feb 18, 2020

JohnTitor mentioned this pull request Feb 18, 2020

Rollup of 8 pull requests #69253

Closed

JohnTitor reviewed Feb 18, 2020

View reviewed changes

src/ci/scripts/dump-environment.sh Outdated Show resolved Hide resolved

Clean out some default-installed directories

c992ab2

This helps us have enough disk space for our builders to be able to complete successfully. For now, the choices are ad-hoc and 'definitely not needed'. This should never fail the build, as everything our build needs should be inside Docker.

pietroalbini force-pushed the disk-try branch from 304d1a9 to c992ab2 Compare February 18, 2020 10:35

JohnTitor mentioned this pull request Feb 18, 2020

Rollup of 8 pull requests #69258

Merged

bors merged commit c992ab2 into rust-lang:master Feb 18, 2020

Mark-Simulacrum deleted the disk-try branch February 23, 2020 02:31

Mark-Simulacrum added beta-accepted Accepted for backporting to the compiler in the beta channel. beta-nominated Nominated for backporting to the compiler in the beta channel. stable-accepted Accepted for backporting to the compiler in the stable channel. labels Feb 23, 2020

Mark-Simulacrum mentioned this pull request Feb 23, 2020

[stable] 1.41.1 release #69359

Merged

Mark-Simulacrum removed the beta-nominated Nominated for backporting to the compiler in the beta channel. label Feb 28, 2020

spunit262 mentioned this pull request Mar 7, 2020

Don't give invalid suggestion on desugared span. #69120

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Clean out unused directories for extra disk space #69252

Clean out unused directories for extra disk space #69252

Mark-Simulacrum commented Feb 18, 2020 •

edited

Loading

Mark-Simulacrum commented Feb 18, 2020

bors commented Feb 18, 2020

rust-highfive commented Feb 18, 2020

rust-highfive commented Feb 18, 2020

JohnTitor commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

pietroalbini commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

JohnTitor commented Feb 18, 2020

bors commented Feb 18, 2020

Clean out unused directories for extra disk space #69252

Clean out unused directories for extra disk space #69252

Conversation

Mark-Simulacrum commented Feb 18, 2020 • edited Loading

Mark-Simulacrum commented Feb 18, 2020

bors commented Feb 18, 2020

rust-highfive commented Feb 18, 2020

rust-highfive commented Feb 18, 2020

JohnTitor commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

pietroalbini commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

bors commented Feb 18, 2020

JohnTitor commented Feb 18, 2020

bors commented Feb 18, 2020

Mark-Simulacrum commented Feb 18, 2020 •

edited

Loading