API 文档

OpenAVID 提供完全兼容 OpenAI 规范的接口,替换为我们的 Base URL 即可调度全域 GPU 算力。

基础信息

Base URLhttps://api.openavid.com/v1
鉴权方式Bearer Token(Authorization: Bearer sk-avid-xxx)
请求格式application/json
计费维度输入 / 输出 Token + GPU 秒
速率限制默认 600 RPM / 账号,可申请提升

获取模型列表

GET /v1/models
Authorization: Bearer sk-avid-xxx
{
  "object": "list",
  "data": [
    { "id": "qwen-max", "owned_by": "aliyun-pai" },
    { "id": "pangu-large", "owned_by": "huawei-ascend" },
    { "id": "jiutian-70b", "owned_by": "cmcc" },
    { "id": "starsky-v1", "owned_by": "telecom" },
    { "id": "yuanjing-70b", "owned_by": "unicom" }
  ]
}

Chat 对话补全

POST /v1/chat/completions

请求参数

参数类型必填说明
modelstring是模型 ID,自动路由到对应算力池
messagesarray是对话消息数组,兼容 OpenAI 格式
gpu_preferencestring否cost(默认)/ latency / domestic,调度策略
poolstring否指定算力池:aliyun / huawei / cmcc / telecom / unicom
temperaturenumber否0 ~ 2,默认 0.7
streamboolean否是否流式返回,默认 false

请求示例

curl https://api.openavid.com/v1/chat/completions \
  -H "Authorization: Bearer sk-avid-xxx" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen-max",
    "gpu_preference": "cost",
    "messages": [
      {"role": "user", "content": "介绍一下算力调度"}
    ]
  }'

响应示例

{
  "id": "chatcmpl-avid-8f21",
  "object": "chat.completion",
  "model": "qwen-max",
  "choices": [
    { "index": 0, "message": { "role": "assistant", "content": "算力调度是…" } }
  ],
  "usage": {
    "prompt_tokens": 12,
    "completion_tokens": 286,
    "total_tokens": 298,
    "gpu_seconds": 1.42,
    "pool": "aliyun-pai",
    "cost_cny": 0.00125
  }
}

Python SDK 示例

from openai import OpenAI

client = OpenAI(
    base_url="https://api.openavid.com/v1",
    api_key="sk-avid-xxx",
)

resp = client.chat.completions.create(
    model="qwen-max",
    messages=[{"role": "user", "content": "你好"}],
    extra_body={"gpu_preference": "cost"},
)
print(resp.choices[0].message.content)
print(resp.usage)

可用模型列表

模型 ID算力池最大上下文单价 / 千 Token
qwen-max阿里云 PAI1M¥0.0042
qwen-plus阿里云 PAI256K¥0.0021
pangu-large华为云昇腾256K¥0.0036
jiutian-70b中国移动128K¥0.0038
starsky-v1中国电信128K¥0.0024
yuanjing-70b中国联通64K¥0.0018

错误码

状态码含义处理建议
400请求参数错误检查 model 与 messages 格式
401API Key 无效或过期在仪表板重新生成密钥
402余额不足充值或调整预算预警阈值
429触发速率限制退避重试,或申请提额
503算力池全部不可用稍后重试,系统会自动故障转移