Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better support for random file access #3321

Closed
lemmih opened this issue Aug 3, 2023 · 1 comment · Fixed by #3338
Closed

Better support for random file access #3321

lemmih opened this issue Aug 3, 2023 · 1 comment · Fixed by #3338
Assignees
@ruseinov
Labels
Priority: 2 - High Very important and should be addressed ASAP

Comments

@lemmih
Copy link
Contributor

lemmih commented Aug 3, 2023

Issue summary

Consider using positioned-io in the CAR-back block stores. Benefits:

  • FADV_RANDOM on Linux and good performance on Windows.
  • Reading doesn't require ownership of the File handle. This means multiple threads can read from the same handle.

Other information and links
@ruseinov
Copy link
Contributor

ruseinov commented Aug 3, 2023

Would be interested in taking this on later to get familiar with car-backed store.

@ruseinov ruseinov self-assigned this Aug 6, 2023
@lemmih lemmih added the Priority: 2 - High Very important and should be addressed ASAP label Aug 7, 2023
@ruseinov ruseinov mentioned this issue Aug 8, 2023
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ruseinov ruseinov

Labels
Priority: 2 - High Very important and should be addressed ASAP
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Feature] Non-exclusive file access for car-backed stores ChainSafe/forest
2 participants
@ruseinov @lemmih