#inference-server
GitHub repositories that have self-applied the topic "inference-server" — a creator-tagged metadata that surfaces how AI projects describe themselves.
REPOS Repos for #inference-server (top 4 by stars)
OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.
RedHillsMediaFL/caixcaix — native Apple Core AI inference server for Apple silicon (beta): OpenAI/Anthropic API, dashboard, streaming chat with tools/skills/MCP, MTP speculative decoding.
epsilonagentx/intel_arc_gpu_llmDocker Compose stack for serving a local, OpenAI-compatible LLM (vLLM on Intel XPU) on an Intel Arc Pro B60 GPU — reproducible config with operator and developer docs.
tamnd/mollaLocal inference server in pure Mojo. Speaks OpenAI, Anthropic, and MCP. Models are OCI artifacts. Same source runs on CPU, NVIDIA, AMD, and Apple GPUs. Apache-2.0 all the way down.
RELATED Other topics · full topics ranking →
#claude-code
2,815#ai-agents
2,183#llm
1,690#claude
1,475#mcp
1,359#python
1,349#developer-tools
1,231#ai
1,028#codex
996Aggregated by case-insensitive match against topics_json of each repo's latest content snapshot. methodology