> ## Documentation Index
> Fetch the complete documentation index at: https://arize-ax.mintlify.site/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# TrueFoundry

> Integrate with the TrueFoundry AI Gateway as a custom OpenAI-compatible AI Provider

Add your [TrueFoundry AI Gateway](https://www.truefoundry.com/ai-gateway) endpoint to access 1000+ models from 40+ providers in Arize AX's prompt playground and LLM-as-a-judge evaluations. The gateway exposes a single OpenAI-compatible endpoint, so it is added as a **Custom Model Endpoint** — Arize AX makes use of the OpenAI Client to make calls to it.

<Note>
  By adding this integration, your data may be sent through your TrueFoundry AI Gateway to the underlying model provider for certain actions within Arize AX (e.g., prompt playground) and your account may be billed for usage.
</Note>

## Add the Integration Using the Arize Skills

Add a TrueFoundry integration from your coding agent using the [Arize Skills](/ax/agents/arize-skills):

<Prompt description="Create a custom model integration named 'my-truefoundry' with my base URL https://gateway.truefoundry.ai and API key tfy-...">
  Create a custom model integration named 'my-truefoundry' with my base URL [https://gateway.truefoundry.ai](https://gateway.truefoundry.ai) and API key tfy-...
</Prompt>

## Add the Integration from Arize AX

### Select Custom Model Endpoints from the Providers List

<Frame caption="The AI Provider integrations tab">
  ![The AI Provider integrations tab](https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/ai-integration-providers-custom.png)
</Frame>

### Fill Out Your Integration Details

<Frame caption="The TrueFoundry custom model integration configuration pane">
  ![The TrueFoundry integration details pane](https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/ai-integration-providers-truefoundry-integration-details.png)
</Frame>

Give your integration a name (e.g. `TrueFoundry`). Then set your base URL and a [TrueFoundry API token](https://www.truefoundry.com/docs/ai-gateway/authentication) (a Personal Access Token or Virtual Account Token, created in the **Access** section of TrueFoundry).

> Enter the base URL: `https://gateway.truefoundry.ai`. **Do not** include endpoint paths like `/chat/completions` as these are appended automatically.

If you need to send any extra headers to every request, set these.

You then need to define the available model deployments. Leave OpenAI default models off and add your TrueFoundry model identifiers as custom model names. Models use a `provider-account/model-name` format (e.g. `openai/gpt-4.1-mini`), where the prefix is the name of the provider account configured in your TrueFoundry workspace. You can find the exact model ID, base URL, and a ready-to-use snippet in the **Code Snippets** tab of the TrueFoundry Playground.

### Advanced Settings

<Frame caption="The Advanced Settings configuration pane">
  ![The AI integration details tab](https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/ai-integration-providers-advanced-settings.png)
</Frame>

Expand the **Advanced Settings** section to configure the following:

* **Supports Function Calling** - Turn this on to allow the integration to use function calling features. This is on by default.
* **Authorized Orgs** - Configure which organizations have access to this integration.
* **Authorized Spaces** - Configure which spaces have access to this integration.

## Add the Integration

Finally check the box to agree to the terms and conditions, then select the **Add Integration** button to create the integration.