Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

db: consider splitting ingested sstables #2181

Closed
jbowens opened this issue Dec 12, 2022 · 1 comment
Closed

db: consider splitting ingested sstables #2181

jbowens opened this issue Dec 12, 2022 · 1 comment

Comments

@jbowens
Copy link
Collaborator

jbowens commented Dec 12, 2022

While skimming #517, I saw @sumeerbhola's comment:

Should we provide split points to the ingestion logic to ensure it does not produce wide sstables?

Once we have virtual SSTs, we could ingest sstables as virtual SSTs, split according to existing heuristics including L0 flush splits.

Do we ever see imports where broad ingested sstables restrict compaction concurrency out of L0? I would guess not, since Cockroach only ingests sstables as broad as a single KV range.

Copy link

github-actions bot commented Jun 5, 2024

We have marked this issue as stale because it has been inactive for
18 months. If this issue is still relevant, removing the stale label
or adding a comment will keep it active. Otherwise, we'll close it
in 10 days to keep the issue queue tidy. Thank you for your
contribution to Pebble!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

No branches or pull requests

1 participant