#inference-engine

GitHub Topic「inference-engine」がついているAI関連リポジトリの集計。Topicはリポジトリ作者が自己申告するメタタグで、AI関連の文脈で何が「inference-engine」と分類されているかを可視化します。

タグ付Repo

TOP5合計★

AIツール痕跡あり

TOP表示数

REPOS #inference-engine のRepo (TOP 5 / Stars降順)

louisevandan/kvasir-net

Kvasir — control plane for large GGUF models across GPUs/machines; expert-sharded MoE swarm, non-custodial KVR wallet + mobile nodes, OpenAI/Anthropic gateways.

TypeScript ★ 5 AI 50 個人 2 sig 公開済 ↗

avifenesh/memra

Rust + CUDA LLM inference engine for Blackwell (Tuned specifically on RTX PRO 6000, RTX 5090, B200): OpenAI-compatible (+converse and ant) serving, per-model X hardware exactness gates. NVFP4/mixed (fp8 hybrid, 4o6, etc - correctness, performance, hardware specific adapted) main quant support.

OpenEdge ABL ★ 2 AI 60 2 sig 公開済 ↗

mehbul/strata

Run 35B mixture-of-experts LLMs on a 16 GB AMD Radeon GPU. A Rust inference engine for ROCm on Windows: reads the GGUF, solves weight placement across VRAM and system RAM, tunes by measurement, compacts context, and serves an OpenAI-compatible API with a web console. No Ollama, no daemon.

Rust ★ 1 AI 60

muyouming/exl3-server

Native EXL3 (exllamav3) inference engine for Apple Silicon: MLX-backed C++ engine, CLI and OpenAI-compatible HTTP server

C++ ★ 0 AI 50

dhaniselo/paddock

Run AI inference on NVIDIA GPUs with a native Rust engine, OpenAI/Anthropic-compatible APIs, and a Studio for exploring and comparing models.

★ 0 AI 40