Why Provisioned Throughput
- Guaranteed throughput — the throughput you contract holds even when the fleet is busy. It’s a guarantee, not a best-effort target.
- SLA without operations — VESSL Cloud operates the serving stack against the SLA in your contract, covering throughput, reliability, and latency, measured as time per output token (TPOT).
- Lower cost per token — Provisioned Throughput costs on average about 70% less than a comparable frontier model, so you spend less to run an LLM. The Estimate total cost calculator on each model page works the number out for your own traffic.
Who it’s for
- Model providers that need to grow serving capacity in steps as customer demand grows.
- Enterprises rolling out AI agents company-wide that want to adopt open-source models and cut internal operating costs.
- AI service companies that need to serve growing traffic reliably as the business grows.
What you get
How it works
- Consultation — we profile your model, volume, traffic pattern, and target SLA with you.
- Contract — we fix the guaranteed TPM, SLA, and price, and agree on the terms.
- Proof of concept (PoC) — you benchmark your real traffic with a sample API key and confirm performance and cost.
- Endpoint and operations — your OpenAI- and Anthropic-compatible endpoint goes live, you monitor usage and performance on the dashboard, and billing settles monthly.
Provisioned Throughput vs other service types
Provisioned Throughput sits between serverless and dedicated endpoints: guaranteed capacity for a stock model, without operating hardware yourself. See Compare inference service types.Core pages
- Browse models — the models available under Provisioned Throughput and what the model page shows.
- Send your first request — base URL, authentication, and an example request.
- Monitor inference status — token usage, cost breakdown, performance, and reliability.
- Manage your contract — reserved PTUs, contract period, model changes, and contract history.
Request Provisioned Throughput
Tell us about your traffic and we’ll scope the capacity with you.