> ## Documentation Index
> Fetch the complete documentation index at: https://docs.abbyy.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LLMs in ABBYY Vantage

> How ABBYY Vantage uses large language models (LLMs) for AI-powered document extraction, including LLM connections, prompt-based extraction, supported providers, data handling, and cost.

ABBYY Vantage uses external **large language models (LLMs)** to extract, classify, and understand document data from natural-language instructions. Vantage connects to LLM providers such as **OpenAI ChatGPT**, **Microsoft Foundry**, and **Google AI Studio (Gemini)**, rather than hosting models itself.

<Note>
  LLM features are currently available in Document Skills through ABBYY Advanced Designer only. LLM connections are configured at the tenant level, under **ADMIN → Configuration → Connections**.
</Note>

## How LLMs work in Vantage

Vantage uses LLMs through two building blocks:

* **LLM connection** - Tenant-level credentials that link Vantage to an LLM provider. A connection is shared across your tenant and can be reused by any skill.
* **Prompt-based extraction** - An Advanced Designer activity that sends a document, plus your natural-language prompt, to the connected LLM and maps the response to your output fields.

A typical setup runs end to end as follows.

<Steps>
  <Step title="Configure an LLM connection">
    A tenant administrator adds a connection to a provider under **ADMIN → Configuration → Connections**. For the steps, see [Configure LLM connections](/vantage/documentation/skills/connections).
  </Step>

  <Step title="Add a prompt-based activity">
    In Advanced Designer, add a **Prompt-based** activity to a Document Skill and select the LLM connection it should use. For the steps, see [Extract data with prompt-based activities](/vantage/documentation/skills/prompt-extraction).
  </Step>

  <Step title="Publish and run">
    When you publish the skill, the selected connection becomes the skill's default in the Vantage Web Portal, under **Skill Catalog → \[skill] → Parameters**. A tenant administrator can override it per environment without republishing. For more information, see [Document skill parameters](/vantage/documentation/skill-designer/skill-parameters/document-skill-params).
  </Step>
</Steps>

## When to use LLMs

Prompt-based LLM extraction needs no training data and adapts quickly to new fields and layouts. Each extraction calls an external API, so it costs more and runs slower than a trained model, and results can vary slightly between runs.

| Use prompt-based LLM extraction when               | Prefer traditional extraction when                             |
| :------------------------------------------------- | :------------------------------------------------------------- |
| Documents have variable or semi-structured layouts | Documents are highly structured or template-based              |
| You have little or no training data                | You process high volumes and need the lowest cost per document |
| You need to prototype or add fields quickly        | You need fast, deterministic, repeatable results               |
| Documents span multiple languages                  | Processing must run offline                                    |

## Data handling and security

When a skill uses an LLM connection, the document content is sent to the external provider you connect to and is processed on that provider's infrastructure, subject to the provider's terms and data policies. Choose a provider that meets your data-residency and compliance needs. **Microsoft Foundry** supports Azure-based data residency and compliance controls.

Protect the credentials stored in each connection:

* Never share API keys or include them in a connection's description.
* Rotate credentials regularly.
* Use separate connections for development and production.
* Grant each key the least privilege it needs.

## Cost and token usage

LLM usage is billed by the provider, based on the number of tokens processed. Cost scales with document length, prompt complexity, the document format sent to the model, and the number of fields you extract. Monitor usage in your provider's dashboard, and use smaller, faster models for simple tasks.

## Supported providers and models

Vantage supports several LLM providers, each with its own connection fields and models. For the current list, see [Supported LLM providers and models](/vantage/documentation/llms/supported-providers-models).

## What's next

<CardGroup cols={3}>
  <Card title="Configure LLM connections" icon="plug" href="/vantage/documentation/skills/connections">
    Set up a tenant-level connection to an LLM provider.
  </Card>

  <Card title="Extract data with prompt-based activities" icon="wand-magic-sparkles" href="/vantage/documentation/skills/prompt-extraction">
    Build a prompt-based extraction activity in Advanced Designer.
  </Card>

  <Card title="Supported LLM providers and models" icon="table" href="/vantage/documentation/llms/supported-providers-models">
    Compare providers, connection fields, and example models.
  </Card>
</CardGroup>

## Related topics

* [Skill Designer overview](/vantage/documentation/skill-designer/skill-designer)
* [Document skill parameters](/vantage/documentation/skill-designer/skill-parameters/document-skill-params)