#llama-cpp

Lightweight agent that pulls and runs LLM benchmarks from Protorikis Bench

Local AI model manager

CLI coding agent สไตล์ Claude Code — Claude API / Cloud / Ollama / llama.cpp, 42 skills, single-file

🏭 Coding agent CLI engineered to make any LLM — local or cloud, frontier or 7B — actually useful. 16 providers, multi-tab sessions, automatic key+model failover, plan-mode review, MCP, and recovery loops for models that misbehave.

Native Windows meeting overlay with real-time transcription and local-or-cloud AI answers. Pure Rust + Slint.

Reproducible token-throughput benchmark for OpenAI-compatible LLM servers, tuned for NVIDIA Spark and GB10 inference.

One-Click Private Agentic Coding Launch Tool with Local llama.cpp for Developer AI in 2026

Boost LLM reliability with dynamic sampling, retry logic, and a lightweight Go‑based proxy.

A free, local, open-source alternative to Wispr Flow. Hold a hotkey, talk, and your words are typed into any Windows app — on-device Whisper/Nemotron speech-to-text with optional local LLM cleanup. No cloud, no account.

Windows-first local MCP search for Codex and Claude Code, with local embedding, reranking, and context compression.

Chiron Rising — an Alpha Centauri (SMACX) mod pack: LLM-written faction diplomacy with leader memory, generated base names, Planetnet dispatches, probe protests, three new factions, and optional Future Society repricing. Built on Thinker.

The 48GB VRAM Local LLM Guide: real benchmarks, model configs, and gotchas from 135+ community reports. Includes runnable benchmark scripts.

Self-hosted routing proxy for Claude Code and any Anthropic-format client: nine modes across Anthropic, MiniMax, GLM/z.ai, Qwen and local models. One endpoint, per-chat isolation, no IDE restarts.

Self-hosted AI log analyzer for World of Warcraft raid + Mythic+ logs from warcraftlogs.com — actionable improvement reports via Anthropic Claude, OpenAI, or your own llama.cpp GPU.

Provider-neutral access & supply layer for open AI: run open models locally (SIN) and route paid, private, verifiable inference across decentralized providers (SIP-AI). DecentralizeAI hackathon entry.

Local-first agentic coding harness — Go + Svelte + llama.cpp, engineered for small local MoE models on consumer hardware. cerveau.sh