Learnable, configurable, and pluggable Omni-Avatar Assistant for everyone

ROADMAP | Demo | HomePage | Documents

---

AlphaAvatar Plugins

🧠 Memory Self-improving memory module for Omni-Avatar. README↗	🧬 Persona Automatic extraction and real-time matching of user full modality persona. README↗
💡 Reflection An Optimizer for Omni-Avatar that can automatically build an internal knowledge base for avatars. README↗	📅 Planning Agents need to plan over a longer time frame to ensure that their actions are sequential and reliable. README↗
🤖 Behavior Controls AlphaAvatar’s behavior logic and process flow. README↗	😊 Virtual Character The real-time generated virtual character that visually represents the Avatar during interactions. README↗

---

Tools Plugins

🔍 DeepResearch Allow AlphaAvatar to access the network and perform single-step/multi-step inference through a separate Agent service to search for more accurate content. README↗	📖 RAG Allow AlphaAvatar to access Documents/Skills (user-uploaded/generated by the Reflection module/URL access) to obtain document-related information. README↗
🧰 MCP Allows AlphaAvatar to access real-world external tools, such as databases, email, social media, etc. README↗	🌍 SANDBOX Provide AlphaAvatar with a sandbox environment to interact with the external world or with other agents, thereby enabling multi-agent interaction and exploration. README↗

---

Docs and guides

Latest News 🔥

• [2026/03] We have released AlphaAvatar version 0.5.0 to support the MCP plugin, which enables retrieval and concurrent invocation of the MCP tools.
• [2026/02] We have released AlphaAvatar version 0.4.0 to support RAG by RAG-Anything library and optimized the Memory and DeepResearch modules.
  • Released AlphaAvatar version 0.4.1: Fix the Persona plugin bugs and Add new MCP plugin.
• [2026/01] We have released AlphaAvatar version 0.3.0 to support DeepResearch by tavily API.
  • Released AlphaAvatar version 0.3.1: ADD tool calls during user-Assistant interactions to the Memory module.
• [2025/12] We have released AlphaAvatar version 0.2.0 to support AIRI live2d-based virtual character display.
• [2025/11] We have released AlphaAvatar version 0.1.0 to support automatic memory extraction, automatic user persona extraction and matching.

Installation ⚙️

Install stable AlphaAvatar version from PyPI:

uv venv .my-env --python 3.11
source .my-env/bin/activate
pip install alpha-avatar-agents

Install latest AlphaAvatar version from GitHub:

git clone --recurse-submodules https://github.com/AlphaAvatar/AlphaAvatar.git
cd AlphaAvatar

uv venv .venv --python 3.11
source .venv/bin/activate
uv sync --all-packages

Quick Start ⚡️

Start your agent in dev mode to connect it to LiveKit and make it available from anywhere on the internet:

export LIVEKIT_API_KEY=<your API Key>
export LIVEKIT_API_SECRET=<your API Secret>
export LIVEKIT_URL=<your LiveKit server URL>

export OPENAI_API_KEY=<your OpenAI API Key>

export QDRANT_URL='https://xxxxxx-xxxxx-xxxxx-xxxx-xxxxxxxxx.us-east.aws.cloud.qdrant.io:6333'
export QDRANT_API_KEY=<your QDRANT API Key>

# Optional
export TAVILY_API_KEY=<your TAVILY API Key>

# MCP Header Key
export GITHUB_PAT=<your Github PAT>

alphaavatar download-files
alphaavatar dev examples/pipline_openai_airi.yaml
# or
alphaavatar dev examples/pipline_openai_tools.yaml

To see more supported modes, please refer to the LiveKit doc.

To see more examples, please refer to the Examples README

Usage 🚀

AlphaAvatar supports multiple Access Channels, allowing different types of users — from end users to developers — to interact with the system.

---

🌐 Web Access

🖥️ Browser-based interface for real-time interaction. This will become the official AlphaAvatar user interface.

• 🎙️ Real-time voice & multimodal communication
• 🧠 Full plugin support (Memory / RAG / MCP / etc.)
• 😊 Virtual character display

---

💬 Social & Messaging Platforms

Interact with AlphaAvatar directly inside messaging platforms.

Capabilities:

• 💬 Text-based conversation
• 🎤 Voice message interaction
• 🧰 Tool invocation via chat interface

WhatsApp

WeChat

Slack

---

📲 Native Mobile App

A dedicated AlphaAvatar mobile application providing:

• 🎙️ Real-time voice communication
• 😊 Live2D / Virtual character visualization
• 🧠 Persistent memory & persona

---

🧪 Developer Playground (Available Now)

This is the primary access channel for AlphaAvatar today.

Developers can immediately access AlphaAvatar via the LiveKit Playground.

👉 https://agents-playground.livekit.io/

After starting your AlphaAvatar server:

1. Connect to your LiveKit instance
2. Join the agent room
3. Start testing real-time interaction

Supported capabilities:

• 🎙️ Voice interaction
• 🧠 Memory extraction
• 🔍 RAG retrieval
• 🧰 MCP tool invocation
• 😊 Virtual character display

---

💡 AlphaAvatar is currently developer-first. Web and mobile experiences are actively under development.