Support zstd Content-Encoding

[manandre]

Is there an existing issue for this?

• I have searched the existing issues

Is your feature request related to a problem? Please describe the problem.

No response

Describe the solution you'd like

Zstandard, or zstd, is a data compression mechanism described in RFC8878. It is a fast lossless compression algorithm, targeting real-time compression scenarios at zlib-level and better compression ratios. The "zstd" token was added as an IANA-registered Content-Encoding token as per https://datatracker.ietf.org/doc/html/rfc8878#name-content-encoding.

The Facebook/Zstd team has published some of their research on compression level vs. CPU vs. compression ratio.

Current support

• Chrome: Planned in version 118
• Safari: Not planned but with positive position
• Mozilla: Not planned with defer position
• Curl: Released since version 7.72.0

Features request

Request compression

• Support zstd as the token from the Content-Encoding header in the request.
• Decompress with Zstandard the request content.

Response compression

• Support zstd as a token from the Accept-Encoding header in the request.
• Compress with Zstandard when the zstd token is elected as response compression, and so stored in the Content-Encoding header in the response.

Zstandard implementation

• Native: https://github.com/facebook/zstd
• .NET Runtime: Add support for Zstandard to System.IO.Compression runtime#59591

Additional context

No response

[ghost]

We've moved this issue to the Backlog milestone. This means that it is not going to be worked on for the coming release. We will reassess the backlog following the current release and consider this item at that time. To learn more about our issue management process and to have better expectation regarding different types of issues you can read our Triage Process.

[iamcarbon]

Chrome has committed to shipping Zstd Content-Encoding in v123, and Safari and Firefox have both indicated a positive position toward the proposal.

[YohanSciubukgian]

Chrome 123 release support zstd

• https://developer.chrome.com/blog/new-in-chrome-123#more
• https://github.com/facebook/zstd/releases/tag/v1.5.6

Could you consider it for .NET 9 ?

[rgueldenpfennig]

Chrome 123 release support zstd

* https://developer.chrome.com/blog/new-in-chrome-123#more

* https://github.com/facebook/zstd/releases/tag/v1.5.6

Could you consider it for .NET 9 ?

Since the 126 release Mozilla Firefox also supports zstd compression: https://www.mozilla.org/en-US/firefox/126.0/releasenotes/

[rgueldenpfennig]

In case anyone wants to implement zstd compression support in your ASP.NET Core pipeline, I just merged a pull request in my side project by utilizing the OSS ZstdSharp library. It's a suitable way until the .NET team releases an own implementation.

Works splendid on major browsers.

[QuinnDamerell]

@rgueldenpfennig very nice work!