#testing

AI Agent Toolkit 2026: Smart Device Control for iOS & Android

Deterministic fake of the claude and codex CLIs. Test hooks and orchestrator integrations locally and in CI without an API key.

Black-box LiveKit voice agent testing: real WebRTC/SIP calls with an AI caller. Catch barge-in, noise, quiet-mic, and latency failures that text pytest misses. Forensic reports + MCP + lks CLI — no agent code changes.

AI-powered codebase assertions. Write natural-language requirements in tests and let an AI agent inspect your project.

Audits what your Claude Code agent did against what it said — reads session logs and git, cites evidence, calls no model

Free local proof reports for AI-built apps and public PRs; $149 async outside proof audit.

AI Testing Agent

AI agent skill for TestRail REST API - zero dependencies, security-friendly alternative to MCP servers

AI Quality Engineering framework for evaluating LLM and RAG applications using automated prompt testing, hallucination detection, and AI evaluation metrics.

Turn failing pytest runs into structured repair reports: failure parsing, root-cause diagnosis, flaky detection, dry-run fix diffs, and an optional LLM layer. 把失败的 pytest 运行转化为结构化修复报告。

Claude Code skills for genuine property-based testing: discovery workflow, anti-patterns, Hypothesis & beyond.

Evidence-first verification for AI coding agents — prove what changed, what was tested, and what passed.

Verification-first discipline for coding agents (Claude Code + Codex CLI): 9-rule doctrine, six skills, adversarial reviewer agent, fail-open enforcement hooks. Done is proven by a command, not by opinion.

Behavioral fuzz-testing engine for AI agents — policy violations, tool-call verification, regression tests. Adapter #1: OpenAI Agents SDK.

Pytest fixtures for the fakellm mock OpenAI/Anthropic server

QA testing performed for the AI-powered Biz Card Scanner mobile application covering functional testing, UI validation, navigation flow, and bug reporting.

Static Mutation Exposure Analysis

Practice project migrating prose-based AI enforcement rules into real, blocking Claude Code hooks — covers PreToolUse guards, Stop-hook content verification, LibreOffice hang prevention, and robust pass/fail parsing, each with a working test suite.

Shared engineering rules, agent instructions, API standards, Laravel/Next.js patterns, testing rules, and reusable project checklists for all AI-powered portfolio systems.

A test & eval harness that makes an AI agent deterministic, testable, and observable — record/replay, trajectory evals, guardrails, traces

Expert Ruby Rails RSpec Skill Files 2026 for AI Coding Agents - Best GitHub About

AI-powered QA Automation platform for log analysis, AI test case generation, and professional bug report creation using FastAPI, React, and Google Gemini AI.

Make web UIs controllable by browser agents without brittle selectors.

Independent browser acceptance testing for agent deliverables. Agents self-test and pass; real browsers tell the truth.

Behavioral cross-agent testing for agent skills — run a skill on Claude Code and Codex and assert deterministic outcomes.

Skill de Claude Code que audita si tus pruebas sabrían ponerse rojas. Instalable como plugin desde el marketplace. La misma herramienta que el repositorio hermano, empaquetada para que la use tu asistente.

Do your agent pipeline's own checks catch planted faults? Measured on LangGraph, CrewAI and AutoGen: median 16.7%. One prompt-level change takes it to 55.0%. Pre-registered spec, Apache-2.0 harness, every raw trace published.

A thin, CI-gated evaluation gate for RAG & LLM systems — golden set, band-based pass/warn/fail gates, LLM-judge or heuristic scorers. pip install raggate

Debug any product by USING it (living the full user cycle, all features, like a picky user) instead of green tests. Start interview (Goal+Benchmark), two modes: Solo and Agentic+ (delegate fixes to agents). Claude Code skill.

AI-powered Quality Engineering Platform built with FastAPI, React, PostgreSQL, and Docker for requirement analysis, API test generation, and automation failure analysis.

Agent-drivable, cross-platform harness that tests PowerShell & Python scripts in throwaway VMs over SSH and asserts deterministic pass/fail. Validated live on Hyper-V + WSL. CI included.