API Reference

The LLMAI plugin provides AI integration for Unreal Engine 5, featuring real-time voice communication, text processing, and function calling capabilities.

info

Supports OpenAI (cloud), Grok (xAI) (cloud with web search), and LocalAI (local/offline). Future releases will add additional providers such as Claude and Gemini.

note

Version 2.1 changes: Grok (xAI) provider support added with web search capability. Voice parameter now available in connection functions (required for Grok). Enhanced error handling for rate limits.

Provider functions

Discovery, models, voices, and provider comparison.

• Provider discovery
• Model management
• Voice management
• Provider comparison

Core components

Client, audio, connection, voice, text, and function calling.

• ULLMAIClientComponent
• Connection management
• Voice communication
• Text communication
• Function calling

Events

Connection, AI, voice, reasoning, and function-calling delegates.

• Connection events
• AI communication events
• Voice events
• Function calling events

Data structures

Function definitions, parameters, and related types.

• Function data structures

Audio utilities

Processing, conversion, and LiveLink audio integration.

• Audio processing
• LiveLink audio

Settings and blueprint library

Project settings access and blueprint helpers.

• Settings access
• Blueprint library