chore(deps): bump sglang[all] from 0.4.4.post4 to 0.4.8.post1

[dependabot]

Bumps sglang[all] from 0.4.4.post4 to 0.4.8.post1.

Release notes

Sourced from sglang[all]'s releases.

Release v0.4.8

Highlights

OpenAI-Compatible Server Refactor

Re-structured the OpenAI-compatible server to support production and enterprise environments. Key improvements include:

• Consistent metrics and logging for better observability and debugging.

• Unified error handling, request validation, and processing logic for improved reliability and maintainability.

• Improved request tracking across sessions and components.

• Fixed bugs in embedding requests and reasoning parsers.

This work was a collaborative effort involving engineers from academic and industry institutions. Special thanks to the Oracle Cloud team and the SGLang team and community — including @​slin1237, @​CatherineSue, @​key4ng, @​JustinTong0323, @​jhinpan, @​yhyang201, @​woodx9 and @​whybeyoung — for their invaluable contributions.

DeepSeek R1 FP4 on Blackwell GPU

Added support for DeepSeek R1 with FP4 and MTP on NVIDIA Blackwell GPU.

• Integrated FlashInfer NVFP4 MoE, supporting TP, EP, and DP.

• Supported 2-stream shared expert execution.

• Achieved up to 90 TPS per user at isl/osl/bs = 1k/1k/16 on B200.

Further optimization in progress. Special thanks to the FlashInfer, NVIDIA Enterprise Products, Novita AI, DataCrunch, Google Cloud, and SGLang teams — especially @​Alcanderian and @​pyc96 — for their critical contributions.

Breaking Change: OpenAI-Compatible API Module Moved

The sglang/srt/openai_api directory has been removed and replaced with sglang/srt/entrypoints/openai.

Update your imports to the new module path. For example:

- from sglang.srt.openai_api.protocol import Tool
+ from sglang.srt.entrypoints.openai.protocol import Tool

What's Changed

• Update README.md by @​merrymercy in sgl-project/sglang#7040
• [Docker] Upgrading base image from 24.04 to 24.12 by @​Swipe4057 in sgl-project/sglang#7043
• fix 24.12 docker by @​zhyncs in sgl-project/sglang#7045
• Minor cleanup of fa3 backend by @​merrymercy in sgl-project/sglang#6999
• Fix eagle on AMD by @​merrymercy in sgl-project/sglang#7051
• Clean up server_args.py by @​merrymercy in sgl-project/sglang#7037
• Minor style fix in cuda_graph_runner.py by @​merrymercy in sgl-project/sglang#7053
• [WA] fix output data is nan in CI test "test_moe_eval_accuracy_large.py" by @​kkHuang-amd in sgl-project/sglang#7021
• [fix] libmlx5.so already in base image by @​HanHan009527 in sgl-project/sglang#7060

... (truncated)

Commits

• 69183f8 chore: bump v0.4.8.post1 (#7559)
• 9b00990 chore: remove vlm unnecessary import (#7541)
• 4d67025 chore: improve ci bug reporting (#7542)
• 0e05fe8 Update seed in CPU UTs to avoid flaky failure with single test (#7544)
• 2390a2b Add Tencent HunYuanMoEV1 model support (#7549)
• 16d76b9 [CMake] Fix sgl-kernel CMakeLists for Blackwell (#7543)
• 5c21425 [PD] Raise error for incompatible mooncake version and some minor fixes (#7527)
• b8df43a Fix gathered_buffer issues in tbo (#7531)
• a1c1ebe Fix FP8 KV Cache Support in FA3 Backend (#7148)
• fe2a0f9 minor: 'role' must be system/assistant/tool, but case insensitive for now (#7...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #13.