Skip to content

Pull requests: lightseekorg/smg

New pull request New
28 Open 1,630 Closed
28 Open 1,630 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(tool_parser): keep prose <tool_call> mentions in Qwen normal text tests Test changes tool-parser Tool/function call parser changes
#1943 opened Jul 19, 2026 by santhreal Contributor Loading…
2 of 4 tasks
1
fix(tool_parser): keep literal </arg_value> inside GLM-4 arg values tests Test changes tool-parser Tool/function call parser changes
#1942 opened Jul 19, 2026 by santhreal Contributor Loading…
2 of 4 tasks
14
fix(reasoning): auto-select kimi_k25 for Kimi-K2.6/K2.7 needs-rebase PR has merge conflicts that need to be resolved reasoning-parser Reasoning parser changes
#1917 opened Jul 14, 2026 by key4ng Collaborator Loading…
2 of 4 tasks
7
feat(multimodal): wire vLLM RDMA multimodal tensor pull ci CI/CD configuration changes dependencies Dependency updates grpc gRPC client and router changes model-gateway Model gateway crate changes python-bindings Python bindings changes tests Test changes
#1916 opened Jul 13, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
40
test(e2e): TokenSpeed Qwen3-ASR audio transcription tests Test changes
#1912 opened Jul 13, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
6
[IN REVIEW] refactor(multimodal): use standalone llm-multimodal crate ci CI/CD configuration changes dependencies Dependency updates grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes needs-rebase PR has merge conflicts that need to be resolved priority:high High priority tests Test changes
#1911 opened Jul 13, 2026 by BugenZhao Loading…
4 tasks
@slin1237 @chenht2022
8
fix(grpc): preserve GLM output across stream boundaries ci CI/CD configuration changes dependencies Dependency updates docker Docker configuration changes grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes protocols Protocols crate changes reasoning-parser Reasoning parser changes tests Test changes tool-parser Tool/function call parser changes
#1906 opened Jul 13, 2026 by TongLing916 Loading…
35
feat(grpc): support batched completion prompts grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved
#1904 opened Jul 12, 2026 by lucifer1004 Loading…
1 of 4 tasks
1
@slin1237
12
fix(responses): accept reasoning effort none grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved openai OpenAI router changes protocols Protocols crate changes tests Test changes
#1902 opened Jul 11, 2026 by ankrovv Loading…
2
test: multimodal tensor-transport + EPD disaggregation coverage ci CI/CD configuration changes grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved tests Test changes
#1898 opened Jul 9, 2026 by slin1237 Collaborator Loading…
30
fix(router): route unlisted models to wildcard external workers under IGW (#1871) model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved tests Test changes
#1896 opened Jul 9, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
11
fix(grpc): router-authoritative string stop sequences for SGLang skip_tokenizer_init workers grpc gRPC client and router changes model-gateway Model gateway crate changes priority:high High priority tokenizer Tokenizer related changes
#1877 opened Jul 4, 2026 by gongwei-130 Collaborator • Draft
@slin1237
9
fix(cache-aware): use backend global backlog for load-aware fallback model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes stale PR has been inactive for 14+ days
#1863 opened Jul 1, 2026 by 2JooYeon Loading…
2 of 4 tasks
15
fix(http): enforce streaming timeouts outside reqwest anthropic Anthropic router changes documentation Improvements or additions to documentation model-gateway Model gateway crate changes multimodal Multimodal crate changes openai OpenAI router changes priority:high High priority python-bindings Python bindings changes tests Test changes
#1858 opened Jun 30, 2026 by jshanson7 Contributor Loading…
@slin1237
98
feat(multimodal): configurable tensor transport + vLLM SHM and video dependencies Dependency updates documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes python-bindings Python bindings changes stale PR has been inactive for 14+ days tests Test changes
#1818 opened Jun 22, 2026 by slin1237 Collaborator Loading…
3 tasks done
35
feat(tool_parser,reasoning_parser): add Step-3.5 tool and reasoning parsers needs-rebase PR has merge conflicts that need to be resolved reasoning-parser Reasoning parser changes tests Test changes tool-parser Tool/function call parser changes
#1817 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
8
feat(reasoning_parser): add Mistral/Magistral reasoning parser needs-rebase PR has merge conflicts that need to be resolved reasoning-parser Reasoning parser changes
#1816 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
9
feat(tool_parser,reasoning_parser): add MiniMax-M3 tool and reasoning parsers needs-rebase PR has merge conflicts that need to be resolved reasoning-parser Reasoning parser changes tests Test changes tool-parser Tool/function call parser changes
#1815 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
12
[blocked] chore(deps): bincode 1.3->3.0 (smg-mesh) — 3.0.0 is a tombstone compile_error release dependencies Dependency updates mesh Mesh crate changes
#1802 opened Jun 22, 2026 by slin1237 Collaborator • Draft
4
feat(grpc-servicer): add Prometheus /metrics sidecar dependencies Dependency updates enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability needs-rebase PR has merge conflicts that need to be resolved tests Test changes
#1782 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
32
fix(observability): include gRPC workers in GET /engine_metrics enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability model-gateway Model gateway crate changes stale PR has been inactive for 14+ days tests Test changes
#1779 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
34
[gateway] WebSocket transport for the Responses API — up to 45% lower TTFT, 22–48% lower ITL p99 tail, 17–21% less gateway CPU dependencies Dependency updates documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved tests Test changes
#1770 opened Jun 18, 2026 by Venkat2811 Loading…
5 tasks done
80
feat(smg): worker-sync observability — drops, spec fallback, refused tombstones, drift mesh Mesh crate changes model-gateway Model gateway crate changes stale PR has been inactive for 14+ days
#1716 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
27
feat(smg): cluster-wide rate limiting via epoch-windowed mesh counters mesh Mesh crate changes model-gateway Model gateway crate changes stale PR has been inactive for 14+ days
#1715 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
34
feat(mesh): causally-stable tombstone GC driven by per-peer ack watermarks mesh Mesh crate changes stale PR has been inactive for 14+ days tests Test changes
#1686 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
17
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.