Extremely slow toolchain download

[ferologics]

Verification

• I searched for recent similar issues at https://github.com/rust-lang/rustup/issues?q=is%3Aissue+is%3Aopen%2Cclosed and found no duplicates.
• I am on the latest version of Rustup according to https://github.com/rust-lang/rustup/tags and am still able to reproduce my issue.

Problem

rustup toolchain install nightly-2024-10-19-aarch64-apple-darwin

.. no firewall or vpn ..

starts 4mib/s then immediately drops to 17kib/s

Steps

rustup toolchain install nightly-2024-10-19-aarch64-apple-darwin

Possible Solution(s)

wait 🤷

Notes

it's not the first time this happens

Rustup version

$ rustup --version
rustup 1.27.1 (54dd3d00f 2024-04-24)

Installed toolchains

$ rustup toolchain list
stable-aarch64-apple-darwin (default)

OS version

macOS Sequoia 15.1 (24B82)

[djc]

How much memory does your machine have? How much free disk space?

[ferologics]

100GB free space, 32GB memory, pressure is suuper low.

the installation is still ongoing... also i got a couple of error: component download failed for rustc-aarch64-apple-darwin: error decoding response body, possible because it just stalls.

[rami3l]

Hmmm I do remember downloading nightlies are slower, but I don't expect it to be this slow... Could this be a infra/peering problem or something?

@jdno have you seen anything like this before?

[rami3l]

@ferologics OTOH you're using macOS 15.1 which is AFAIK still in prerelease state. Does it work alright on other machines/network environments, if you happen to have access to any?

[ferologics]

imo this is not beta macos related, usually my toolchain update is smooth, but can occasionally be painfully slow, like now. my peers haven't had this issue, they're running stable macos.

[ChrisDenton]

This might be a server issue. I've had a few instances where downloads crawled because I got routed to a bad CDN server.

[rami3l]

This might be a server issue. I've had a few instances where downloads crawled because I got routed to a bad CDN server.

@ChrisDenton Thanks for sharing! I was reminded of the dual-CDN problem in #3791 (comment).

@ferologics Would you mind explicitly telling Rustup the CDN you'd like to use as described in that post and see if it gets any better?

Hint:

export RUSTUP_UPDATE_ROOT=https://fastly-static.rust-lang.org/rustup
export RUSTUP_DIST_SERVER=https://fastly-static.rust-lang.org

... or, replace fastly with cloudfront.

[jdno]

@ferologics It would also be helpful to get the output of curl -I https://static.rust-lang.org to see which point-of-presence your hitting in the CDN.

[ferologics]

my install went through later that day, but I will try to repro and see if pointing it helps @rami3l

$ curl -I https://static.rust-lang.org
HTTP/2 200 
x-amz-id-2: hOPMMeM5UPVzIy5pQogkQHIRhMSz1YnYy8U27UxgAA5agN0sBpm+uavBD+fmIyBNT2ZHTYRts2Q=
x-amz-request-id: EJ9DSB8A3A1YN6P9
x-amz-bucket-region: us-west-1
content-type: application/xml
server: AmazonS3
accept-ranges: bytes
age: 1
date: Wed, 23 Oct 2024 10:21:03 GMT
via: 1.1 varnish
x-served-by: cache-vie6354-VIE
x-cache: MISS
x-cache-hits: 0
x-timer: S1729678862.622280,VS0,VE1664
content-length: 342529

^ @jdno this is the current output, not sure if that changed since yesterday.
my hunch is it's different b/c it recovered and significantly sped up..