#ai-evaluation

Live, open-source benchmark for comparing AI coding agents on real GitHub issues

Policy-mapped evaluation lab for AI assistant behavior: approval gates, refusal boundaries, uncertainty handling, tool-use grounding, traces, and quality gates.

Evidence router & policy engine for coding agents — enforces source choice and proof-of-use through Claude Code hooks, including routes to MCP tools. Local-first; no LLM in the hook loop.

Self-healing RAG on n8n with LLM-as-judge eval, drift detection, investigator agent, and canary A/B deploys.

AI Evaluation project analysing chatbot response quality in e-commerce using rubric scoring, error taxonomy, and semi-automated evaluation workflows.

Luminos.AI is an AI governance and evaluation platform that tests AI systems — classical machine learning, generative AI, and autonomous agents — for legal, regulatory, and reputational risk.

MCP server exposing multivon-eval + pdfhell as agent-callable tools. Drop into Claude Desktop, Cursor, Cline.

Offline regression tests and explainable release gates for RAG systems and AI agents.

A latency-fair LLM-vs-LLM fighting game benchmark. The engine blocks until an agent responds, so inference speed can't win a match — what's scarce is a per-match token bank that drains as a model thinks.