Skip to content

No labels!

There aren’t any labels for this repository quite yet.

quantization
quantization
question
question
Further information is requested
qwen
qwen
Related to Qwen models
ray
ray
anything related with ray
ready
ready
ONLY add when PR is ready to merge/full CI is needed
ready-for-merge
ready-for-merge
Indicate this PR is ready to be merged by the maintainers, used by reviewers without merge access.
release
release
Related to new version release
release-blocker
release-blocker
This PR/issue blocks the next release, therefore deserves highest priority
rocm
rocm
Related to AMD ROCm
security
security
Security related issues and PRs
speculative-decoding
speculative-decoding
stale
stale
Over 90 days of inactivity
structured-output
structured-output
tool-calling
tool-calling
torch.compile
torch.compile
torchao
torchao
TorchAO related
tpu
tpu
Related to Google TPUs
unstale
unstale
Recieved activity after being labelled stale
usage
usage
How to use vllm
x86-cpu
x86-cpu
Related to Intel & AMD CPU