Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q1 2025
#11862 opened Jan 8, 2025 by simon-mo
Open 5
[V1] Feedback Thread
#12568 opened Jan 30, 2025 by simon-mo
Open 46
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1,289 Open 5,374 Closed
1,289 Open 5,374 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug]: DeepSeek-R1-AWQ gets stuck with all tokens rejected when MTP is enabled. bug Something isn't working
#13704 opened Feb 22, 2025 by sgsdxzy
1 task done
[Feature]: add tool calling support for DeepSeek-R1-Distill-Qwen-32B feature request
#13700 opened Feb 22, 2025 by npuichigo
1 task done
[Bug]: load_adapter crashes server if called when generations are in progress bug Something isn't working
#13698 opened Feb 22, 2025 by Cameron7195
1 task done
1
[Installation]: sccache/ccache is not effective installation Installation problems
#13697 opened Feb 22, 2025 by barabanshek
1 task done
[Installation]: requirement packaging errors during pip install installation Installation problems
#13694 opened Feb 22, 2025 by aaroncav2
1 task done
[Installation]: vLLM wheel names are broken in recent versions installation Installation problems
#13692 opened Feb 22, 2025 by rohit-gupta
1 task done
3
[Bug]: Guided Decoding (structured json outputs) not generating proper outputs. bug Something isn't working
#13683 opened Feb 21, 2025 by venkatchel
1 task done
[Bug]: Speculative Decoding doesn't work with Ray compiled DAG and SPMD bug Something isn't working
#13682 opened Feb 21, 2025 by tczekajlo
1 task done
[Usage]: How to use a custom model with LLM without HuggingFace usage How to use vllm
#13680 opened Feb 21, 2025 by henrycharlesworth
1 task done
1
[Feature]: Support for LoRA for Pooling Models feature request
#13679 opened Feb 21, 2025 by ashwani-bhat
1 task done
[Bug]: Mamba2 models (Bamba and Codestral Mamba) fail on RoCM bug Something isn't working
#13678 opened Feb 21, 2025 by tlrmchlsmth
1 task done
@tlrmchlsmth
2
[Bug]: Errors Encountered While Running Qwen/Qwen2.5-VL-72B-AWQ Inference on 8x24G的4090 GPUs bug Something isn't working
#13677 opened Feb 21, 2025 by moshilangzi
1 task done
1
[Bug]: Error while running Deepseek-R1: vllm.engine.async_llm_engine.AsyncEngineDeadError: Task finished unexpectedly. bug Something isn't working
#13676 opened Feb 21, 2025 by Wats0ns
1 task done
[Bug]: Running ROCm support v1 vLLM Arch triggers ERROR_MEMORY_APERTURE_VIOLATION bug Something isn't working
#13674 opened Feb 21, 2025 by tjtanaa
1 task done
[Bug]: [V1][SpecDec] RuntimeError: CUDA error: an illegal memory access was encountered bug Something isn't working
#13673 opened Feb 21, 2025 by lbeisteiner
1 task done
1
[Bug]:vLLM 0.6.3 generate_sequences Randomly Hangs After 1-2 Steps When trying to Implement Tool Calling with Logits Processors bug Something isn't working
#13671 opened Feb 21, 2025 by AIBionics
1 task done
2
[Usage]: vllm: error: unrecognized arguments: --lora-path usage How to use vllm
#13669 opened Feb 21, 2025 by imrankh46
1 task done
@varun-sundar-rabindranath
11
[Feature]: deepseek gguf support feature request
#13665 opened Feb 21, 2025 by vip-china
1 task done
1
[New Model]: Google SigLip 2 good first issue Good for newcomers help wanted Extra attention is needed new model Requests to new models
#13663 opened Feb 21, 2025 by tranhoangnguyen03
1 task done
@lengrongfu
2
[Feature]: Can it support avx cpu's like xeon E5-2670v2 feature request
#13662 opened Feb 21, 2025 by asdfgh129
1 task done
[Bug]: how to use cuda graph on vllm bug Something isn't working
#13661 opened Feb 21, 2025 by ziang663
1 task done
[Installation]:Error while deploying Deepseek-R1 671B with AMD 8xMi300x installation Installation problems
#13659 opened Feb 21, 2025 by Bihan
1 task done
1
[Bug]: When deploying the Qwen2.5-VL-3B service, some image requests return errors. bug Something isn't working
#13657 opened Feb 21, 2025 by lijingcheng2021
1 task done
[Bug]: v0.7.3 can't work on wsl-ubuntu mirrored network bug Something isn't working
#13656 opened Feb 21, 2025 by engchina
1 task done
1
[Bug]: Qwen2.5 VL Internal Server Error bug Something isn't working
#13655 opened Feb 21, 2025 by heibaidaolx123
1 task done
8
ProTip! Updated in the last three days: updated:>2025-02-19.