Tags: #npu
Hardware Plugin
vLLM
2.0k
vllm-project/vllm-ascend
A community-maintained hardware plugin that enables vLLM to run seamlessly and efficiently on Ascend NPUs for large language model inference.
A community-maintained hardware plugin that enables vLLM to run seamlessly and efficiently on Ascend NPUs for large language model inference.