Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inconsistent Slow downloads from nodejs.org #3898

Open
broksonic21 opened this issue Aug 6, 2024 · 13 comments
Open

Inconsistent Slow downloads from nodejs.org #3898

broksonic21 opened this issue Aug 6, 2024 · 13 comments
Labels

Comments

@broksonic21
Copy link

broksonic21 commented Aug 6, 2024

URL:

https://nodejs.org/dist/v20.16.0/node-v20.16.0-linux-x64.tar.gz

Browser Name:

curl

Browser Version:

n/a -multiple

Operating System:

Mac, Linux

How to reproduce the issue:

I am not sure if nodejs/build is the right place to file, so feel free to move

When trying to download a nodejs version, we usually are very fast. We see similar speeds from our CI servers, local, etc across multiple networks

Example:

> curl https://nodejs.org/dist/v20.16.0/node-v20.16.0-linux-x64.tar.gz --output a.tar.gz

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 44.5M  100 44.5M    0     0  10.7M      0  0:00:04  0:00:04 --:--:-- 10.7M

However, at random times, we get super slow. I can rerun this download 10 times, and 3 will fail with this slowness

it's not a local network issue, as this is happening across multiple networks and people, and appears worse over the last 3 days.

Any insight or additional info I can provide support for?

Example - before I killed it 6 minutes in - 152K download:

> curl https://nodejs.org/dist/v20.16.0/node-v20.16.0-linux-x64.tar.gz --output a.tar.gz

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
 87 44.5M   87 38.8M    0     0   102k      0  0:07:27  0:06:30  0:00:57  152k^C

Realized that nodejs.org might be better place for this than nodejs/build - sorry for double post. #3853 - I know when there were 500 errors at Fastly, the fix was somewhere in the middle, so not sure which team this is.

@AugustinMauroy
Copy link
Member

it's still slow for you ???
This may be due to the fact that it is at the time of release.

@matthiaz
Copy link

matthiaz commented Aug 8, 2024

Yep, still happening. Over the past few days many people reporting this same issue
Different example:
image

@broksonic21
Copy link
Author

Yes, I see slowness and cancellations both now on certain downloads. as per @matthiaz 's view. Something got worse over the last week, IMO

@broksonic21 broksonic21 changed the title Inconsistent Slow downloas from nodejs.org Inconsistent Slow downloads from nodejs.org Aug 8, 2024
@jamesgecko
Copy link

I'm also seeing slowness and timeouts trying to download https://nodejs.org/dist/v20.6.1/node-v20.6.1-darwin-arm64.tar.gz, both in my browser and with Mise.

12:15 gitbook on  main
><((x> mise install node@20.6.1 --verbose
[DEBUG] ARGS: /opt/homebrew/bin/mise install node@20.6.1 --verbose
[DEBUG] Config {
    Config Files: [
        "~/src/opt/gitbook/.nvmrc",
        "~/.config/mise/config.toml",
    ],
}
[DEBUG] ToolRequestSet.build(28.5µs): ToolRequestSet: node@20.6 ruby@system

[DEBUG] install_versions: node@20.6.1
downloading node-v20.6.1-darwin-arm64.tar.gz
[DEBUG] GET Downloading https://nodejs.org/dist/v20.6.1/node-v20.6.1-darwin-arm64.tar.gz to ~/.local/share/mise/downloads/node/20.6.1/node-v20.6.1-darwin-arm64.tar.gz
[DEBUG] GET https://nodejs.org/dist/v20.6.1/node-v20.6.1-darwin-arm64.tar.gz
[DEBUG] starting new connection: https://nodejs.org/
[DEBUG] GET https://nodejs.org/dist/v20.6.1/node-v20.6.1-darwin-arm64.tar.gz 200 OK
Error:
   0: error decoding response body
   1: request or response body error
   2: operation timed out

Location:
   src/http.rs:130

Version:
   2024.8.5 macos-arm64 (2024-08-03)

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.

@shanecav84
Copy link

FYI, I was dealing with slow/failed downloads using nodenv install 20.16.0 since 11AM EDT today. I retried nodenv a few times, then tried in my browser, and it was still slow/failing. A download was able to finish around 11:55AM EDT - it took about 10 mins

@rx-ted
Copy link

rx-ted commented Aug 30, 2024

I want to download the link https://nodejs.org/dist/v20.16.0/node-v20.16.0-linux-x64.tar.gz , but I found it's not working...
opening https://nodejs.org, it's no response. why?

@flakey5
Copy link
Member

flakey5 commented Aug 31, 2024

This is most likely due to the origin server being overloaded due to a cache purge done by a release (as @AugustinMauroy pointed out). We're still working on better infra for downloads (#3461), but in the meantime, the fix is to just try it again until the download succeeds unfortunately

@AugustinMauroy
Copy link
Member

AugustinMauroy commented Aug 31, 2024

opening https://nodejs.org/, it's no response. why?

That strange because nodejs.org is deployed on vercel and it's shouldn't do that

@ovflowd
Copy link
Member

ovflowd commented Sep 10, 2024

opening nodejs.org, it's no response. why?

That strange because nodejs.org is deployed on vercel and it's shouldn't do that

I'm not sure if they meant nodejs.org or nodejs.org/dist

Anyhow, download issues are outside the scope of this repository. I'm moving this issue to nodejs/build.

@ovflowd ovflowd transferred this issue from nodejs/nodejs.org Sep 10, 2024
@matthiaz
Copy link

Another example that ends falling back to source downloading...

[2024-09-11T12:10:48+00:00]     W: Binary download from https://nodejs.org/dist/v18.17.1/node-v18.17.1-linux-x64.tar.xz failed, trying source.
[2024-09-11T12:10:48+00:00]     W: grep: /app/.nvm/.cache/bin/node-v18.17.1-linux-x64/node-v18.17.1-linux-x64.tar.xz: No such file or directory
[2024-09-11T12:10:48+00:00]     W: Provided file to checksum does not exist.
[2024-09-11T12:10:48+00:00]     W: Binary download failed, trying source.
[2024-09-11T12:10:48+00:00]     Detected that you have 8 CPU core(s)
[2024-09-11T12:10:48+00:00]     Running with 7 threads to speed up the build
[2024-09-11T12:10:48+00:00]     W: Downloading https://nodejs.org/dist/v18.17.1/node-v18.17.1.tar.xz...
[2024-09-11T12:13:17+00:00]     W: #=#=#    ``` 

Any idea why nodejs.org downloads continue to fail intermittently?

@flakey5
Copy link
Member

flakey5 commented Sep 12, 2024

Any idea why nodejs.org downloads continue to fail intermittently?

We're still working on the new infra re #3898 (comment)

@emilyz-github
Copy link

I ran into this issue today and would appreciate a fix as soon as possible.

# curl --output node-v20.11.1-linux-x64.tar.xz https://nodejs.org/dist/v20.11.1/node-v20.11.1-linux-x64.tar.xz 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:03:35 --:--:--     0
curl: (28) Failed to connect to nodejs.org port 443: Connection timed out

@ovflowd
Copy link
Member

ovflowd commented Sep 17, 2024

I ran into this issue today and would appreciate a fix as soon as possible.

# curl --output node-v20.11.1-linux-x64.tar.xz https://nodejs.org/dist/v20.11.1/node-v20.11.1-linux-x64.tar.xz 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:03:35 --:--:--     0
curl: (28) Failed to connect to nodejs.org port 443: Connection timed out

https://status.nodejs.org

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

9 participants