#litellm

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

Windows 一键脚本：把 Claude Code 路由到任意 AI 提供商。默认 DeepSeek 直连，支持 Anthropic/OpenAI 两种协议（MiMo/Gemini/通义/Kimi 等），自动装依赖、小白友好。

Run-scoped LLM observability control plane backed by LiteLLM

Flagship free FastAPI starter for LLM routing/cost visibility; $29 Gumroad kit adds deployment, hardening, routing, and verification guides.

🌱 Self-growing task tree for LLM agents — every agent decides its own split. Recursive, not predefined.

Monk LLM Gateway: one API in front of every model. An LLM gateway and router built from scratch (proxy, routing, retry/fallback, caching, budgets), with an interactive course.

Self-hosted routing proxy for Claude Code and any Anthropic-format client: nine modes across Anthropic, MiniMax, GLM/z.ai, Qwen and local models. One endpoint, per-chat isolation, no IDE restarts.

Unified LLM client — one interface for OpenAI, Anthropic, Gemini, Groq, DeepSeek. Parallel calls, vision support, cost tracking. Powers RawEval's multi-model evaluation pipeline.

Self-hosted, OpenAI-compatible AI gateway that splits your control plane (auth, guardrails, budgets, encrypted key vault, cost & observability) from the translation engine - swap Bifrost / LiteLLM / Portkey / Direct per provider at runtime. Own your keys; contain a compromised engine to one in-flight request.

🤷🏾‍♀️ LiteLLM Router Chat is a FastAPI and LiteLLM-based chatbot automatically retries failures and switches between Groq and Gemini models based on availability. I am also hoping to separate model registry, tool registry, and app code, making it model provider-agnostic (maybe).