Skip to content

Pull requests: ModelTC/LightLLM

New pull request New
36 Open 916 Closed
36 Open 916 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: auto-select best attention backend when not specified
#1185 opened Jan 19, 2026 by sufubao Loading…
4 tasks
4
[model] support Qwen3next
#1184 opened Jan 18, 2026 by sufubao Loading…
6
fix cpu kv cache offload async error
#1180 opened Jan 16, 2026 by hiworldwzj Loading…
3
update openai_api
#1172 opened Jan 8, 2026 by WANDY666 Loading…
3
[fix]qwen3_vl add infer_state.max_seq_len
#1164 opened Jan 5, 2026 by WANDY666 Loading…
6
Add neo chat
#1161 opened Dec 30, 2025 by SangChengC Loading…
11
add-glm4v model
#1157 opened Dec 25, 2025 by SangChengC Loading…
9
feat: replace gunicorn with hypercorn for http2 (h2c) support
#1150 opened Dec 17, 2025 by WuSiYu Loading…
3
[Feat] Add triton autotuner fallback logic
#1148 opened Dec 15, 2025 by flyinglandlord Loading…
3
add launch_server and StartArgs (#1119)
#1135 opened Dec 5, 2025 by sufubao Loading…
4
Add top_logprobs Support
#1124 opened Nov 24, 2025 by ahmadbasyouni10 Loading…
9
feat(misc): Profiler support
#1121 opened Nov 20, 2025 by WuSiYu Loading…
16
add flashinfer fused_norm_add op
#1105 opened Nov 13, 2025 by SangChengC Loading…
14
support Deepseek3.2
#1103 opened Nov 10, 2025 by sufubao Loading…
8
add flashinfer-trtllm-ragged-prefill-attn
#1099 opened Nov 6, 2025 by SangChengC Loading…
3
support interns1
#1060 opened Sep 18, 2025 by xhx1022 Loading…
12
enable fa3 and fused_shared_experts by default
#1053 opened Sep 15, 2025 by sufubao Loading…
4
fix tl.where and set the default loader worker number
#1052 opened Sep 11, 2025 by sufubao Loading…
feat: Implementing Past Future Scheduler
#1048 opened Sep 8, 2025 by WuSiYu Loading…
Optimize multimodal resource allocation with concurrency and improved batch RPC
#1017 opened Aug 21, 2025 by dyyoungg Loading…
[support] vit and llm disaggregation
#1014 opened Aug 20, 2025 by SangChengC Loading…
add fa3_mtp
#1005 opened Aug 11, 2025 by WANDY666 Loading…
8
Support Qwen models' dp>1 in PD
#999 opened Aug 5, 2025 by zhhangBian Loading…
4
add rmsnorm-add fusion kernel
#996 opened Aug 4, 2025 by theNiemand Loading…
8
Asynchicache
#977 opened Jul 21, 2025 by jinbiaoyu Loading…
13
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.