429 Too Many Requests

[mark-i-m]

Recently a bunch of CI failures have occurred with this error, mostly from YouTube. Not sure what the solution is. I'm also not sure if this is Travis or YouTube...

@Mark-Simulacrum @pietroalbini do you know if this would be mitigated by moving to Azure?

[Mark-Simulacrum]

Do you have links to some of these CI failures? Are you intentionally contacting YouTube?

[shepmaster]

Is the link checker still active?

[mark-i-m]

https://travis-ci.com/rust-lang/rustc-guide/builds/118875063

https://travis-ci.com/rust-lang/rustc-guide/builds/119000366

https://travis-ci.com/rust-lang/rustc-guide/builds/118874560

There are a few more I think.

We link to the compiler lecture series videos on YT. These failures are from the linkchecker attempting to contact YT and failing with 429.

[pietroalbini]

Hmm, does linkchecker set a browser user agent?

[mark-i-m]

No idea... cc @Michael-F-Bryan

[Michael-F-Bryan]

I don't believe we set a user agent. The validator just calls reqwest::get() without doing anything fancy.

[mark-i-m]

For now, I am just going to blacklist yt feom the linkchecker because CI has been down for a while.

[mark-i-m]

We haven't seen this in a while, so I am closing...

[camelid]

This has been occurring (spuriously) again. Can we ignore 429 Too Many Requests errors in linkcheck? (See #885 for some discussion.)