Skip to content
This page is not translated yet — showing the original. We never ship machine translation as a placeholder.
Needs a toolchainApache-2.0 Tested
vLLM

vLLM

In one line:vLLM 是一个开源的高吞吐推理引擎,自己部署开源模型服务时的首选。

vLLM 是一个开源的高吞吐推理引擎,自己部署开源模型服务时的首选。

Official source

We host and mirror nothing — the official page is the source of truth.

Official icon for vLLM vLLM Projecthttps://github.com/vllm-project/vllmOpen official page