Skip to main content
This is in development. Details may change before it is available.
Altrum can send a trace of every AI Gateway request to your own OpenTelemetry collector, so model traffic appears next to the rest of your systems in the tools you already use. Nothing is sent unless you switch it on and give a collector address.

​
Set it up

An owner or admin opens AI Gateway, then OpenTelemetry: Headers are stored encrypted, sent exactly as you wrote them, and never shown again after you save: only their names are. Rotate a key by saving the headers again. Send test span sends one span to the saved collector and says whether it took it. Use it after any change. Altrum refuses a collector address that is on a private network, a loopback address or a cloud metadata address, when you save it and again every time it connects. A name that later points somewhere private is refused too.

​
What is sent

  • Only your organization’s requests go to your collector, and only to yours.
  • Spans follow the OpenTelemetry conventions for generative AI: the provider, the model, tokens, cost, finish reason and time taken, with altrum.* attributes for the key, the AI system and the organization.
  • Request content (messages, tool definitions, tool arguments and results) is included only for a request whose content may be kept: the AI system’s content logging setting if it has one, otherwise the organization’s. Otherwise only metadata is sent.
  • No span carries details of the machine that served the request.
  • Metrics are not sent, only traces.