Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grpc s2 compression #9292

Closed
wants to merge 2 commits into from
Closed

Conversation

deniszh
Copy link
Contributor

@deniszh deniszh commented Sep 13, 2024

What this PR does

Adding GRPC S2 compression for better cross AZ traffic compression, with same CPU and better memory than Snappy.

Which issue(s) this PR fixes or relates to

Fixes #8522

Checklist

  • Tests updated.
  • Documentation added.
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX].
  • about-versioning.md updated with experimental features.

@aknuds1
Copy link
Contributor

aknuds1 commented Sep 13, 2024

I'll review this when I have some time :)

@aknuds1
Copy link
Contributor

aknuds1 commented Sep 17, 2024

Taking a look.

@aknuds1
Copy link
Contributor

aknuds1 commented Sep 17, 2024

I've prototyped dskit support for custom gRPC compressors, and I also have a Mimir PoC adding support for S2 and Snappy compatible S2. Waiting on @pstibrany feedback.

@aknuds1 aknuds1 mentioned this pull request Sep 18, 2024
4 tasks
@aknuds1
Copy link
Contributor

aknuds1 commented Sep 18, 2024

@deniszh I've drafted an alternative PR that uses the custom gRPC compressor support in dskit (approved, but not yet merged). WDYT about this approach?

@deniszh
Copy link
Contributor Author

deniszh commented Sep 19, 2024

@aknuds1 : Looks good, thanks!

@deniszh
Copy link
Contributor Author

deniszh commented Sep 19, 2024

Closed in the favour of #9322

@deniszh deniszh closed this Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

zstd compression support between distributors and ingesters
2 participants