> ## Documentation Index
> Fetch the complete documentation index at: https://docs.cloud.vessl.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Monitor inference status

> Track token usage, cost breakdown, performance, and reliability for each model under contract.

Once your API key is active, two places show your numbers: the **Usage summary** card on each model page, which defaults to the current month, and the **Monitoring Dashboard**, opened from **Monitoring** under **Inference** in the sidebar, which tracks token usage, performance, and reliability over a date range you pick.

<Tip>Use the demo below to see how to open the **Monitoring Dashboard** from a model page and read the metrics under each tab.</Tip>

<div style={{ position: 'relative', paddingBottom: 'calc(54.0522% + 41px)', height: 0, width: '100%' }}>
  <iframe src="https://demo.arcade.software/PoE4VfOKMIOzy8VxWBng?embed&embed_mobile=inline&embed_desktop=inline&show_copy_link=true" title="Monitor Model Usage and Performance Metrics in VESSL Cloud" frameBorder="0" loading="lazy" webkitAllowFullScreen="" mozAllowFullScreen="" allowFullScreen allow="clipboard-write" style={{ position: 'absolute', top: 0, left: 0, width: '100%', height: '100%', colorScheme: 'light' }} />
</div>

## Usage summary

This card sits on the model page. Use the month picker at the top of the card to move between billing months, and **View details in Monitoring** to open the Monitoring Dashboard.

<div>
  <Frame>
    <img src="https://mintcdn.com/dora/3AK1OUE3yJcIiP_z/images/inference-usage-summary.png?fit=max&auto=format&n=3AK1OUE3yJcIiP_z&q=85&s=614adabde8ecccd8c474731861287023" alt="Usage summary card with the month picker, peak token usage in tokens per minute, total cost with the share of cached input, input, and output tokens, and the daily token usage trend chart" width="1322" height="896" data-path="images/inference-usage-summary.png" />
  </Frame>

  <small>Example: one month of usage on a model under contract</small>
</div>

|                       |                                                                                                                                                                                                                                                                  |
| --------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Peak token usage**  | The highest throughput reached in the month, in tokens per minute (TPM). Compare it with the capacity your contracted Provisioned Throughput Units (PTUs) guarantee to see how much headroom you have.                                                           |
| **Total cost**        | The month's usage priced at the model's per-token rates, with the share of cached input, input (uncached), and output tokens. Under a Provisioned Throughput contract you pay for the PTUs you reserve, so read this as a usage figure rather than your invoice. |
| **Token usage trend** | Daily token usage, stacked by cached input, input (uncached), and output. Hover a bar for that day's exact numbers.                                                                                                                                              |

## Monitoring Dashboard

Open **Inference** → **Monitoring** in the sidebar, or click **View details in Monitoring** on a model page. Pick a date range and one model or all of them, then read the metrics under three tabs.

<div>
  <Frame>
    <img src="https://mintcdn.com/dora/3AK1OUE3yJcIiP_z/images/inference-monitoring-dashboard.png?fit=max&auto=format&n=3AK1OUE3yJcIiP_z&q=85&s=674138c460d494bce420174ca0f843bb" alt="Monitoring Dashboard with the Token, Performance, and Reliability tabs, a date range picker, a model selector, and the Total Tokens per Minute chart" width="1421" height="840" data-path="images/inference-monitoring-dashboard.png" />
  </Frame>

  <small>Example: token usage across all models over a one-week range</small>
</div>

|                 |                                                                                                                                                    |
| --------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Token**       | Tokens per minute, split into total, input, and output.                                                                                            |
| **Performance** | Time to first token (TTFT) and time per output token (TPOT), each at p50, p90, and p99, alongside per-request generation speed and cache hit rate. |
| **Reliability** | Requests per minute, and the share of requests that failed with a 4xx or 5xx error.                                                                |

## When you need more capacity

If **Peak token usage** is approaching the capacity your contracted PTUs guarantee, add PTUs: [talk to sales](https://vessl.ai/en/talk-to-sales?utm_source=docs\&utm_medium=referral\&utm_campaign=inference_en\&utm_content=monitor_more_capacity) or click **Need more capacity?** on the model page. See [Manage your contract](/inference/contracts).
