Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

better defaults for flush queue parallelism #5091

Merged
merged 2 commits into from
Jan 11, 2022

Conversation

owen-d
Copy link
Member

@owen-d owen-d commented Jan 10, 2022

Ref #5090

Doubles the flush queue length to 32 parallelism. This is small in the goroutine world and helps prevent OOMing issues when flushing cannot keep up with ingestion, especially on leaner-provisioned ingesters.

Copy link
Collaborator

@slim-bean slim-bean left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cyriltovena
Copy link
Contributor

cyriltovena commented Jan 10, 2022

This one is catching people off-guard so often specially with slow object store. We should add it to troubleshooting

If your ingester are OOMing check the flush queue size.

Copy link
Contributor

@cyriltovena cyriltovena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM off course !

Copy link
Contributor

@KMiller-Grafana KMiller-Grafana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple doc changes LGTM.

@owen-d owen-d merged commit e823a50 into grafana:main Jan 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants