Skip to content

Issues: sgl-project/sglang

Development Roadmap (2025 H1)
#4042 opened Mar 4, 2025 by zhyncs
Open 19
[Roadmap] Prefill and Decoding Disaggregation
#4655 opened Mar 21, 2025 by ByronHsu
Open 23
[Roadmap] EP Enhancement
#4734 opened Mar 24, 2025 by ch-wan
Open 10
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

504 Open 1,518 Closed
504 Open 1,518 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Why DP EP Use Two Different MLA kernel in Prefill phase
#6301 opened May 14, 2025 by nannaer
[Bug] Start fails both in dp or tp mode
#6297 opened May 14, 2025 by u4lr451
1 of 5 tasks
[Bug] When I run it using Docker Swarm, it gets stuck.
#6294 opened May 14, 2025 by xiaoyu1095
2 of 5 tasks
[Bug] vllm0.8.5 vs sglang0.4.6 ,sglang0.4.6 slower than vllm,please check
#6291 opened May 14, 2025 by wangkeya
5 tasks
[Bug] MLA and serialization/deserialization bugs for RemoteModelLoader
#6286 opened May 14, 2025 by DellCurry
5 tasks done
1
[Bug] Cuda error: invalid argument when host init_kv_buffer with argument pin_memory=True
#6285 opened May 14, 2025 by beaulian
5 tasks done
2
[Bug] GGUF model with architecture qwen3 is not supported yet
#6281 opened May 14, 2025 by itaid
5 tasks done
1
[Bug] When using sgl-router, canceled requests keep running on workers.
#6280 opened May 14, 2025 by hjc-puro
5 tasks done
[Feature] Support the fastvlm from Apple?
#6270 opened May 13, 2025 by Jimmy-L99
2 tasks done
[Feature] Support EAGLE-3 for speculative decoding on DeepSeek model
#6268 opened May 13, 2025 by Ewan-Ding
2 tasks done
5
[Bug] min_new_tokens is not work
#6266 opened May 13, 2025 by hertz-pj
5 tasks done
[Bug] structured output Request block the serving in PD mode
#6264 opened May 13, 2025 by Zhou-sx
5 tasks done
[Feature] Add Clippy Linting for Router to CI
#6262 opened May 13, 2025 by jon-chuang
[Bug] KeyError: 'intermediate_size_full' when loading Qwen3 MoE GPTQ
#6249 opened May 12, 2025 by nooobkevin
5 tasks done
2
[Bug] Cuda failure 'invalid argument'
#6246 opened May 12, 2025 by jingwangsg
5 tasks done
[Feature] Prevent OOM Crashes in sglang with Large Batches or Image Inputs
#6239 opened May 12, 2025 by yhyang201
2 tasks done
1
[Bug] sglang-router curl get return without content-type: application/json in the header (#3307 reopened)
#6237 opened May 12, 2025 by sebnowak
5 tasks done
1
[Bug] Can't use profiler in DP+EP
#6236 opened May 12, 2025 by nannaer
5 tasks done
[Bug] AttributeError: 'AWQMarlinConfig' object has no attribute 'weight_block_size' when deploying Qwen3-235B-A22B-AWQ
#6234 opened May 12, 2025 by EvanSong77
5 tasks
[Bug] Llama4 fails to run on Python 3.9 (AssertionError)
#6232 opened May 12, 2025 by kbumsik
5 tasks done
[Bug] IndexError: list index out of range in move_ready_grammar_requests() causes sglang server crash during stress test with Qwen3-32B
#6229 opened May 12, 2025 by YingchaoX
5 tasks done
1
[QUESTION] Does sglang support fp8 kvcache in ampere such like A100
#6228 opened May 12, 2025 by WhatGhost
Efficience of quantization
#6221 opened May 12, 2025 by chesterout
1
[QUESTION]UnboundLocalError: cannot access local variable 'return_logprob' where it is not associated with a value
#6219 opened May 12, 2025 by EvilCalf
1
[Feature] Support custom allreduce in DPA
#6217 opened May 12, 2025 by KSLee7
2 tasks done
ProTip! Find all open issues with in progress development work with linked:pr.