Supercapybara / Railway Templates

vLLM

OpenAI-Compatible LLM API, CPU, Key Login On From Boot

Category: AI · One-click template for Railway by SuperSlowSloth

vLLM is a leading open-source inference server for large language models. This template runs vLLM's CPU build as an OpenAI-compatible API (/v1/chat/completions, /v1/completions, /v1/models) behind an API key that is generated on deploy, with the model cache on a persistent volume.

Deploy vLLM on Railway

Disclosure: deploy links carry the author's Railway referral code — the author receives a usage kickback when you deploy. The template itself is free to deploy; Railway usage charges apply.