Skip to content

vLLM ​

Choose a model and deploy it as a vLLM serverless endpoint. There are three menus by compute type — GPU · CPU · Rebellions — with the same screens and usage.

MenuComputeNotes
GPUGPUUsed for most models.
CPUCPUServes lightweight models without a GPU. The creation screen has an extra Resources (CPU, memory) section.
RebellionsRebellions NPUServes models prepared for Rebellions. The creation screen has an extra Resources section.

The New Standard for AI Infrastructure