Connecting custom LLMs through AI Trust Layer

The AI Trust Layer LLM Configurations tab lets you connect external LLMs to UiPath products using custom Integration Service connectors. This approach routes LLM calls through the AI Trust Layer, giving you the same governance, auditing, and policy controls as with natively supported models.

Custom connectors are required when the LLM provider is not already available as a built-in connector in Integration Service. You build the connector from a template in Connector Builder, configure gateway credentials, and register the model under a custom alias.

The following guides cover specific integration scenarios:

• How-to guide: Connecting Mistral through AI Trust Layer — Connects a Mistral model using the Azure OpenAI template, with adjustments for model-specific requirements.
• How-to guide: Connecting OSS models through AI Trust Layer — Connects an open-source model hosted on an OpenAI-compatible gateway such as Fireworks, using the OpenAI V1 Compliant LLM template.