Comprehensive AI Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
[NeurIPS 2025] AGI-Elo: How Far Are We From Mastering A Task?
Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
VerifyAI is a simple UI application to test GenAI outputs
Multi-dimensional evaluation of AI responses using semantic alignment, conversational flow, and engagement metrics.
Public Driftmap harness: public-safe CSV suites + rubrics + run logs for drift detection, refusal integrity, injection resistance, and uncertainty tracking.
Pondera is a lightweight, YAML-first framework to evaluate AI models and agents with pluggable runners and an LLM-as-a-judge.
Clinical trial application for mental health benchmark evaluation of AI responses in multi-turn conversations. Guides users to understand AI interaction patterns and resolve personal mental health issues through therapeutic AI assistance.
Add a description, image, and links to the ai-evaluation-framework topic page so that developers can more easily learn about it.
To associate your repository with the ai-evaluation-framework topic, visit your repo's landing page and select "manage topics."