Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make max-readahead configurable to enhance read performance #5224

Closed
ddrid opened this issue Oct 12, 2024 · 2 comments · Fixed by #5704
Closed

Make max-readahead configurable to enhance read performance #5224

ddrid opened this issue Oct 12, 2024 · 2 comments · Fixed by #5704
Assignees
Labels
kind/feature New feature or request
Milestone

Comments

@ddrid
Copy link
Contributor

ddrid commented Oct 12, 2024

Currently, readAheadMax is a non-configurable parameter for fuse users, set by default to conf.Chunk.BlockSize * 8, typically 32MB. This isn't sufficient for low-concurrency read requests. I intend to make max-readahead a user-configurable parameter.

After testing, I set max-readahead to 512MB and observed that under single-threaded, with uncached local disk reads, the throughput increased from 230MB/s to 2.2GB/s, showing a 10x improvement.

@solracsf
Copy link
Contributor

Thanks for the PR. Maybe also document it (in docs) too?

@davies
Copy link
Contributor

davies commented Mar 3, 2025

we can provide --max-readahead to overwrite this default setting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants