Skip to main content

Live Link demo

Live Link demo

info

The LLMAI_LiveLink demo showcases AI-driven character animation with a MetaHuman (Cooper). The AI's voice output drives real-time lip-sync, and function calling enables expressive gestures and movement. It uses the same Terminal demo chat interface as the Arcade demo, with LiveLink integration functions enabled in the connection dialog.

Getting Started​

The LLMAI LiveLink demo is available as a separate download on the Fab store LLMAI page. Download and extract the zip to your preferred Unreal projects folder, then open the .uproject file. After opening the demo for the first time, follow Configuration quick-start to set up your preferred provider (OpenAI, Grok, or LocalAI).

Prerequisites​

Before trying this demo, install and enable the LLMAI plugin and configure your provider (OpenAI, Grok, or LocalAI). See Getting started, Configuration, and the Demo guide.

Launch the Demo​

  1. Open the Level: Navigate to Content/LLMAITerminal/Levels/LVL_LLMAITerminal.umap
  2. Play the Level: Click Play in Editor or use Alt+P
  3. Connect to AI: Use the connection dialog and enable LiveLink Integration Functions
  4. Enable voice mode: Required for lip-sync on the MetaHuman character

MetaHuman Character Control​

The LiveLink demo showcases AI-driven character animation with a MetaHuman (Cooper). The AI's voice output drives real-time lip-sync, and function calling enables expressive gestures and movement.

Lip-Sync Feature​

When voice mode is enabled, the AI's TTS (Text-to-Speech) output automatically drives the MetaHuman's lip-sync animations through LiveLink, creating natural-looking speech animation.

What to Try​

  • "Wave hello" — Trigger wave gesture
  • "Give me a thumbs up" — Positive gesture
  • "Shake your head no" — NodNo gesture
  • "Move to the left" — Character walks to left waypoint
  • "Go to the middle" — Character returns to center
  • "Jump!" — Character performs jump animation
  • "Do a little dance" — Dance gesture
  • "Show me you're not sure" — Uncertain shrug gesture

Available Gestures​

The AI can trigger 16 different character gestures through natural language. Try commands like "Wave hello", "Give me a thumbs up", or "Show me you're not sure".

Movement Functions​

The character can move between three waypoints using natural navigation:

AIF_Move — Waypoint Movement​

  • Left: Character walks to the left position
  • Middle: Character walks to the center position
  • Right: Character walks to the right position

Uses the built-in navigation system with Third Person character movement animations, then faces the camera upon arrival.

AIF_Jump — Jump Action​

Triggers the character's jump animation using the Third Person character's built-in functionality with Animation Blueprint state machine for proper jump physics and animation blending.

Technical Implementation​

The LiveLink demo uses these AI Function Definition assets:

  • AIF_Gesture — Gesture triggering function
  • AIF_Move — Waypoint movement function
  • AIF_Jump — Jump action function
  • AIFP_Character — Character function profile combining all functions

Location: Content/LLMAITerminal/Character/Blueprints/AIFunctions/

Troubleshooting​

  • No Lip-Sync: Ensure voice mode is enabled for TTS output
  • Character Not Moving: Verify NavMesh is properly configured in the level

Need More Help? See the FAQ or Debug & Logging Documentation.

Additional Documentation​