Feature: Retry on rate limit

[koppor]

Type of feature

💡 Feature

Current behavior

I sometimes get

You have exceeded a secondary rate limit. Please wait a few minutes before you try again. If you reach out to GitHub Support for help, please include the request ID AFC1:31FAC3:48D749:894FD1:671992DA.

Suggested solution

Please add a sleep and a retry in case of a rate limit warning.

Additional context

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

Contributing Docs

• I agree to follow this project's Contribution Docs

[koppor]

This refs https://stackoverflow.com/q/70030298/873282

making a request every 2s to stay within the primary rate limit of 30 reqs per minute (so not concurrently)

I am also validating every request with the GitHub rate limit API before I make the actual search API call.

---

when you trigger the secondary api rate limit you have to wait a time same as the one indicated in the Retry-After attribute of the response header.

[koppor]

This is kind of a blocker, because I get a "workflow failed" notification daily - example: https://github.com/JabRef/user-documentation/actions/runs/11648873086

[takanome-dev]

I'm so sorry @koppor 🙏 been busy lately. Will fix this ASAP

[koppor]

@takanome-dev Would be really nice if you could resume work on this nice project!