Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
기존에 쓰던 SDK에서 base URL, API Key, 모델 ID만 바꿔 Provisioned Throughput 엔드포인트를 호출하는 방법을 안내해요.
model 필드에 모델 ID를 넣으면 돼요.
| Base URL | https://inference.cloud.vessl.ai/v1 |
| 인증 | bearer 토큰으로 보내는 API Key(Authorization: Bearer <api-key>) |
| 모델 | 모델 페이지에서 모델 이름 옆에 표시되는 모델 ID |
VESSL_API_KEY 환경 변수로 설정하세요.
export VESSL_API_KEY="<api-key>"
curl https://inference.cloud.vessl.ai/v1/chat/completions \
-H "Authorization: Bearer $VESSL_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "<model-id>",
"messages": [
{"role": "user", "content": "Hello! Who are you?"}
]
}'
import json
import os
import urllib.request
request = urllib.request.Request(
"https://inference.cloud.vessl.ai/v1/chat/completions",
method="POST",
headers={
"Authorization": f"Bearer {os.environ['VESSL_API_KEY']}",
"Content-Type": "application/json",
},
data=json.dumps({
"model": "<model-id>",
"messages": [
{"role": "user", "content": "Hello! Who are you?"},
],
}).encode(),
)
with urllib.request.urlopen(request, timeout=120) as response:
body = json.load(response)
print(body["choices"][0]["message"]["content"])
const response = await fetch("https://inference.cloud.vessl.ai/v1/chat/completions", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.VESSL_API_KEY}`,
"Content-Type": "application/json",
},
body: JSON.stringify({
model: "<model-id>",
messages: [
{ role: "user", content: "Hello! Who are you?" },
],
}),
});
if (!response.ok) {
throw new Error(`Request failed: ${response.status} ${await response.text()}`);
}
const body = await response.json();
console.log(body.choices[0].message.content);