#inference-optimization
GitHub repositories that have self-applied the topic "inference-optimization" β a creator-tagged metadata that surfaces how AI projects describe themselves.
REPOS Repos for #inference-optimization (top 5 by stars)
GenAI Career Roadmap 2026 π | AI Job Paths & Skills Guide
gittensor-ai-lab/sparkinfer-k3Kimi K3 (2.8T/A50B) inference on 8x H200 β evaluation baseline via the unsloth llama.cpp fork. Forked from gittensor-ai-lab/sparkinfer.
kalyvask/self-improving-agentic-systemsA controller that learns how a tool-using agent should spend compute at each step (WIDER, DEEPER, DECOMPOSE, STOP, or ESCALATE to a stronger model) and improves its own policy from logged traces. Judged on cost per solved task with paired statistics; ships trained policies and an offline embed API (pip install, no key needed).
vtavakkoli/DFlash-Mini-LabEducational implementation and visualization of autoregressive, DFlash-inspired, and DFlash2-inspired LLM decoding with a tiny Transformer benchmark.
dhaniselo/paddockRun AI inference on NVIDIA GPUs with a native Rust engine, OpenAI/Anthropic-compatible APIs, and a Studio for exploring and comparing models.
RELATED Other topics Β· full topics ranking β
#claude-code
2,838#ai-agents
2,208#llm
1,699#claude
1,484#mcp
1,376#python
1,357#developer-tools
1,237#ai
1,038#codex
1,005Aggregated by case-insensitive match against topics_json of each repo's latest content snapshot. methodology