#inference-optimization

GitHub Topic「inference-optimization」がついているAI関連リポジトリの集計。Topicはリポジトリ作者が自己申告するメタタグで、AI関連の文脈で何が「inference-optimization」と分類されているかを可視化します。

タグ付Repo

TOP5合計★

AIツール痕跡あり

TOP表示数

REPOS #inference-optimization のRepo (TOP 5 / Stars降順)

ngu-gif/genai-role-playbook

GenAI Career Roadmap 2026 🚀 | AI Job Paths & Skills Guide

HTML ★ 1 AI 100

gittensor-ai-lab/sparkinfer-k3

Kimi K3 (2.8T/A50B) inference on 8x H200 — evaluation baseline via the unsloth llama.cpp fork. Forked from gittensor-ai-lab/sparkinfer.

C++ ★ 1 AI 45 公開済 ↗

kalyvask/self-improving-agentic-systems

A controller that learns how a tool-using agent should spend compute at each step (WIDER, DEEPER, DECOMPOSE, STOP, or ESCALATE to a stronger model) and improves its own policy from logged traces. Judged on cost per solved task with paired statistics; ships trained policies and an offline embed API (pip install, no key needed).

Python ★ 0 AI 70

vtavakkoli/DFlash-Mini-Lab

Educational implementation and visualization of autoregressive, DFlash-inspired, and DFlash2-inspired LLM decoding with a tiny Transformer benchmark.

Python ★ 0 AI 70 個人公開済 ↗

dhaniselo/paddock

Run AI inference on NVIDIA GPUs with a native Rust engine, OpenAI/Anthropic-compatible APIs, and a Studio for exploring and comparing models.

★ 0 AI 40