> ## Documentation Index
> Fetch the complete documentation index at: https://docs.abbyy.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Configure LLM connections

> Set up LLM connections in ABBYY Vantage to integrate Anthropic, Google AI Studio (Gemini), Microsoft Foundry, Mistral AI, and OpenAI ChatGPT models for AI-powered document extraction.

An **LLM connection** stores the tenant-level credentials that link ABBYY Vantage to an external LLM provider. Once configured, a connection is shared across your tenant, and any Document Skill can use it for prompt-based extraction and classification.

<Note>
  LLM connections can currently be used in Document Skills through ABBYY Advanced Designer only. Connections are managed at the tenant level and are available to all skill designers in your organization.
</Note>

For a conceptual overview and the full list of supported providers, see [LLMs in ABBYY Vantage](/vantage/documentation/llms/llms) and [Supported LLM providers and models](/vantage/documentation/llms/supported-providers-models).

## Prerequisites

Before you begin, make sure you have the following.

* **Administrator access** to ABBYY Vantage Configuration.
* **An active subscription** with your chosen LLM provider.
* **API credentials** from that provider:
  * **Anthropic** - API key from your Anthropic account.
  * **Google AI Studio** - API key from your Google AI Studio account.
  * **Microsoft Foundry** - API key, the complete endpoint URL (including the `/chat/completions` path and API version), and the deployed model name from Azure.
  * **Mistral AI** - API key from your Mistral AI account.
  * **OpenAI** - API key from your OpenAI account.

## Add an LLM connection

<Steps>
  <Step title="Open the Connections page">
    In the left sidebar, under **ADMIN**, click **Configuration** (gear icon), and then click **Connections**.

    <Frame>
      <img src="https://mintcdn.com/abbyy/-OvZCOLG9-NO5n6J/images/vantage/how-to/connections/how_to_select_connections.png?fit=max&auto=format&n=-OvZCOLG9-NO5n6J&q=85&s=a8976300747ce2ba1a4f4a84bd4c40e7" alt="Connections page in Vantage Configuration" style={{ width: "80%" }} width="2850" height="1260" data-path="images/vantage/how-to/connections/how_to_select_connections.png" />
    </Frame>

    The **Connections** page lists any existing connections with their **Name**, **Description**, **Used in Skills**, and **Last Updated** values, along with **Add Connection**, **Test**, **Edit**, and **Delete** buttons.
  </Step>

  <Step title="Select a provider">
    Click **+ Add Connection**. The **Add Connection** dialog lists the available providers: **Anthropic**, **Microsoft Foundry**, **Google AI Studio**, **Mistral AI**, and **OpenAI**.

    <Frame>
      <img src="https://mintcdn.com/abbyy/TfgS7rVjlImLRKq9/images/vantage/how-to/connections/how_to_add_connection_providers.png?fit=max&auto=format&n=TfgS7rVjlImLRKq9&q=85&s=c2391ce2ca8bd3fa3d7c3e3a2718e7ec" alt="Add Connection dialog listing Anthropic, Microsoft Foundry, Google AI Studio, Mistral AI, and OpenAI providers" style={{ width: "80%" }} width="1202" height="1364" data-path="images/vantage/how-to/connections/how_to_add_connection_providers.png" />
    </Frame>

    Select the provider that matches your subscription, and then click **Next**.
  </Step>

  <Step title="Enter the general settings">
    Give the connection a name and an optional description.

    * **Name** - A unique name for the connection. This name appears when skill designers select a connection in a Document Skill, so choose something descriptive, such as `Production Claude` or `Mistral AI`.
    * **Description** - Optional context about the connection's purpose or environment. Don't include API keys or other credentials.
  </Step>

  <Step title="Enter the connection settings">
    Enter the credentials for your provider. The required fields depend on the provider you selected. For the fields per provider, see [Connection settings by provider](#connection-settings-by-provider).

    <Frame>
      <img src="https://mintcdn.com/abbyy/-OvZCOLG9-NO5n6J/images/vantage/how-to/connections/how_to_add_connection_detail.png?fit=max&auto=format&n=-OvZCOLG9-NO5n6J&q=85&s=83e104ac9d625279d8c2c678e5007cf3" alt="Connection configuration form with General and Connection Settings sections" style={{ width: "80%" }} width="2866" height="1290" data-path="images/vantage/how-to/connections/how_to_add_connection_detail.png" />
    </Frame>
  </Step>

  <Step title="Test the connection">
    Click **Test**. Vantage attempts to reach the provider with the credentials you entered.

    <Frame>
      <img src="https://mintcdn.com/abbyy/-OvZCOLG9-NO5n6J/images/vantage/how-to/connections/how_to_test_connection.png?fit=max&auto=format&n=-OvZCOLG9-NO5n6J&q=85&s=8bd4e55f9f290635ed5202f54b34caac" alt="Testing an LLM connection" style={{ width: "80%" }} width="2820" height="1262" data-path="images/vantage/how-to/connections/how_to_test_connection.png" />
    </Frame>

    A green checkmark confirms the connection works. A red error means the credentials or settings need attention. For help, see [Troubleshooting](#troubleshooting).
  </Step>

  <Step title="Save the connection">
    Once the test succeeds, click **Add**. The connection appears in the **Connections** list and is immediately available to all skill designers in your tenant.

    <Note>
      Once a skill that references this connection is published, the connection becomes the **default** in the Vantage Web Portal, under **Skill Catalog → \[skill] → Parameters**. A tenant administrator can override the default per environment without republishing the skill. For more information, see [Document skill parameters](/vantage/documentation/skill-designer/skill-parameters/document-skill-params).
    </Note>
  </Step>
</Steps>

## Connection settings by provider

The **Connection Settings** fields differ by provider. Enter the exact model name your account supports. For example models, see [Supported LLM providers and models](/vantage/documentation/llms/supported-providers-models).

<Warning>
  Never share API keys or include them in a connection's description. These credentials grant access to your LLM services and the associated costs.
</Warning>

### Anthropic

* **Model Name** - The Anthropic model to use. Select the model your account supports.
* **API Key** - Your Anthropic API key (starts with `sk-`).

### Google AI Studio (Gemini)

* **Model Name** - The Gemini model to use, for example `gemini-2.0-flash`.
* **API Key** - Your Google AI Studio API key, from **Google AI Studio → Get API key**.

### Microsoft Foundry

* **Model Name** - The name of your deployed model in Microsoft Foundry, from **Azure Portal → your Microsoft Foundry resource → Deployments**. This must match the deployment exactly.
* **URL** - Your Microsoft Foundry endpoint, from **Azure Portal → your Microsoft Foundry resource → Keys and Endpoint**. Include the deployment path and API version, for example `https://<resource>.cognitiveservices.azure.com/openai/deployments/<model-name>/chat/completions?api-version=2025-01-01-preview`.
* **API Key** - Your Microsoft Foundry API key, from the same **Keys and Endpoint** page.

### Mistral AI

* **Model Name** - The Mistral AI model to use. Select the model your account supports.
* **API Key** - Your Mistral AI API key.

### OpenAI ChatGPT

* **Model Name** - The OpenAI model to use, for example `gpt-4`.
* **API Key** - Your OpenAI API key (starts with `sk-`), from **OpenAI Platform → API Keys**.

## Manage connections

Connections are shared, so a change affects every skill that uses them. Test after any change.

### Edit a connection

<Steps>
  <Step title="Select the connection">
    On the **Connections** page, select the connection, and then click **Edit** (pencil icon).
  </Step>

  <Step title="Update and test">
    Update the fields, click **Test** to confirm the connection still works, and then click **Save**.
  </Step>
</Steps>

<Warning>
  Editing a connection affects all skills that use it. Test thoroughly after making changes.
</Warning>

### Test a connection

On the **Connections** page, select the connection, and then click **Test** (refresh icon) to verify the credentials still work. This is useful for routine checks and troubleshooting.

### Delete a connection

On the **Connections** page, select the connection, click **Delete** (trash icon), and then confirm.

<Warning>
  You can't delete a connection that is used in an active skill. Remove the connection from all skills first.
</Warning>

## Troubleshooting

### The connection test fails

Check the credentials and settings for the provider.

* **Invalid API key** - Confirm you copied the entire key, with no extra spaces. Regenerate the key in the provider's portal if needed.
* **Invalid endpoint URL (Microsoft Foundry)** - Confirm the URL is complete, matches your Azure resource, and has no typos in the deployment path.
* **Wrong model name** - Confirm the model or deployment exists and is active, and check spelling and capitalization (case-sensitive).
* **Network issues** - Confirm outbound HTTPS is allowed and your Vantage instance can reach the provider.
* **Quota or permissions** - Confirm your subscription is active, you're within rate limits, and the key has the necessary permissions.

### The connection works in the test but fails in a skill

* Refresh the Skill Designer page, and re-select the connection in the skill.
* Confirm the skill is published, not in draft.
* Check the skill's error logs for specific messages.

### API costs are higher than expected

* Review which skills use the connection, and their processing volume.
* Use smaller, faster models for simple tasks.
* Monitor usage and set budget alerts in your provider's dashboard.

## Best practices

* **Secure your credentials.** Never share API keys or put them in a description. Rotate keys regularly, grant each key the least privilege it needs, and use separate connections for development and production.
* **Name connections clearly.** Use names that indicate purpose or environment, such as `Production GPT-4` or `Development Foundry`, rather than `Connection 1`. Record the environment, use case, and owner in the description.
* **Review connections regularly.** Test connections on a schedule and after any credential change, and use the **Used in Skills** column to find and remove connections no longer in use.
* **Manage cost.** Use smaller, faster models for simple tasks, keep prompts efficient, and set budget alerts in your provider's dashboard.

## Additional resources

* [Anthropic API documentation](https://docs.anthropic.com)
* [Google AI Studio](https://aistudio.google.com)
* [Microsoft Foundry](https://azure.microsoft.com/products/ai-foundry)
* [Mistral AI documentation](https://docs.mistral.ai)
* [OpenAI API documentation](https://platform.openai.com/docs)

## Related topics

* [LLMs in ABBYY Vantage](/vantage/documentation/llms/llms)
* [Supported LLM providers and models](/vantage/documentation/llms/supported-providers-models)
* [Extract data with prompt-based activities](/vantage/documentation/skills/prompt-extraction)
* [Document skill parameters](/vantage/documentation/skill-designer/skill-parameters/document-skill-params)