Official OpenAI SDKs
Python, TypeScript and .NET clients work unchanged with a base URL and an API key.
An OpenAI-compatible AI server on your own hardware.
Keep the SDKs, frameworks and tools you already use, and change one setting: the base URL. AI Server answers the familiar endpoints from models running on your machine, your network or your cluster.
Endpoints
The API surface your code already speaks.
| Endpoint | What it does |
|---|---|
POST /v1/chat/completions | Chat with streaming, tool calling for agents and image inputs for vision |
POST /v1/embeddings | Embeddings for search, retrieval and classification |
POST /v1/images/generations | Text-to-image, image-to-image and inpainting |
POST /v1/audio/speech | Text-to-speech with streamed audio |
POST /v1/audio/transcriptions | Speech-to-text from an uploaded file |
/v1/audio/transcriptions/stream | Live speech-to-text over WebSocket |
GET /v1/models | The models available to serve |
from openai import OpenAI
client = OpenAI(base_url="http://your-server:8080/v1", api_key="<api-key>")
reply = client.chat.completions.create(
model="<model-id>",
messages=[{"role": "user", "content": "Summarise our leave policy."}],
)
print(reply.choices[0].message.content)Works with the tools you already use
Agent frameworks
LangChain, Semantic Kernel, Microsoft Agent Framework and LlamaIndex.
Chat UIs and IDE plugins
Any tool with an “OpenAI-compatible” or custom base URL setting.
The AI Suite apps
They find the server automatically and need no configuration.
Safe by default on a network
Keys before serving
The server will not serve a network until at least one API key exists.
Loopback stays simple
Calls from the server’s own computer need no key.
Free edition limits
On Free, AI Suite apps are unlimited and other OpenAI-compatible clients are rate-limited; any Pro edition removes the limit.
Questions
Answers before you choose.
Is there a separate SDK? +
No. The OpenAI-compatible API is the SDK surface; use the official or community OpenAI client libraries.
Does tool calling work? +
Yes. /v1/chat/completions accepts tools and tool_choice ("auto", "none", "required") and returns tool_calls, streamed when stream is on.
Which endpoints are not available? +
AI Server does not offer the stateful Responses API (/v1/responses). Use /v1/chat/completions instead.
Is it free? +
Free on one computer: unlimited for the AI Suite apps and rate-limited for other clients. Pro Personal and Pro Commercial serve your network without the limit.
Start free