Add support for zstd websocker compression

[dpatekar]

Brief Description

• Add Zstandard (zstd) compression for WebSocket communication between microservices and the gateway, reducing bandwidth usage for large payloads
• Compression is negotiated during authentication via a codecs field and applied automatically to outbound messages exceeding 200 bytes (auth messages are never compressed)
• Add WS_DISABLE_OUTBOUND_COMPRESSION environment variable to opt out of outbound compression

Checklist

• Have you added appropriate text to the CHANGELOG.md files?

Add those to list or remove the list below altogether:

• Have you documented all your public methods and interfaces? Have you identified intention and assumptions?
• Have you included a docs file as /wiki/BEAM-1234.md? You need to provide a docs file.

Notes

When you are merging a feature branch into main, please squash merge and make sure the final commit contains any relevent JIRA ticket number. If you are merging from main to staging, or staging to production, please use a regular merge commit.

Does this introduce tech-debt? If so, have you added an entry to the Tech-debt document?

[github-actions]

Lightbeam link

[github-actions]

Lightbeam link

[Leinnan]

@dpatekar just out of curiosity- do you have any benchmarks on how does it affect communication by any chance?

[dpatekar]

@dpatekar just out of curiosity- do you have any benchmarks on how does it affect communication by any chance?

Zstd has a similar compression ratio to Gzip, around 80% size reduction for JSON text, but Zstd is significantly faster (Gzip is also fast).

I wrote a benchmark comparing Zstd (ZstdSharp.Port NuGet) to .NET native Gzip with various content sizes:

[github-actions]

Lightbeam link