Skip to main content
This is in development. Details may change before it is available.
The AI Gateway speaks the request formats your clients already use. Change the base URL and the key; the request and the answer keep their usual shape. Any format can reach any supported provider. An OpenAI-format request can be answered by an Anthropic model, and Altrum converts the request and the answer.

​
Name a model

Name the provider and the model: openai/gpt-4o-mini, anthropic/claude-sonnet-4-5, gemini/gemini-2.5-flash, bedrock/..., vertex/..., azure/.... A model name without a provider is matched to a provider your organization has credentials for. GET /v1/models lists the models your key may use.

​
Streaming

Every format streams as it does with the provider directly. Guardrails on answers can delay the first words: see Guardrails at runtime.

​
Not available

The AI Gateway does not handle embeddings, images, audio, video, batch, files, containers or realtime requests yet, and a stored response cannot be fetched, listed or deleted through it. Requests to those paths are answered as an unknown path.