OpenAI SDK

ai& Inference API は OpenAI とワイヤ互換です。ベース URL を上書きすれば公式 openai SDK をそのまま利用できます。

セットアップ

Python
Node.js

pip install openai

from openai import OpenAI

client = OpenAI(
    base_url="https://api.aiand.com/v1",
    api_key="sk-your-aiand-api-key",
)

npm install openai

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.aiand.com/v1",
  apiKey: "sk-your-aiand-api-key",
});

Chat completion

response = client.chat.completions.create(
    model="...",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

ストリーミング

stream = client.chat.completions.create(
    model="...",
    messages=[{"role": "user", "content": "Hello"}],
    stream=True,
    stream_options={"include_usage": True},
)
for chunk in stream:
    print(chunk.choices[0].delta.content or "", end="")

その他のエンドポイント

client.files.create(...) — Files
client.models.list() — Models