Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Queue length metrics vs Queue delay metrics is confusing #2385

Open
xemul opened this issue Aug 7, 2024 · 0 comments
Open

Queue length metrics vs Queue delay metrics is confusing #2385

xemul opened this issue Aug 7, 2024 · 0 comments

Comments

@xemul
Copy link
Contributor

xemul commented Aug 7, 2024

A rough experiment -- disk capacity is 1000 requests/second. Tick is 1ms, which means scheduler can dispatch 1 request/tick.
Next, 100 requests get queued instantly. Scheduler will dispatch them every 1ms. The total queue delay is going to be 1 + 2 + ... + 100 = 5050 ms.

Average delay is 50ms
Disk consumption is 10%
Queue length is likely 0, because it's scraped every few minutes

A load-average-like queue lengths might be helpful, it should make those "spikes" more evident

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant