Skip to content

Serverless (Docker) ​

Deploy your own container image as a serverless endpoint. Specify the image, ports, environment variables, and hardware and autoscaling settings, and the number of replicas scales with demand.

To serve a model without building an image, use vLLM. After the endpoint is created, URL, testing, editing, and deletion work the same as vLLM → Manage endpoints.

The New Standard for AI Infrastructure