#amd-gpu

A privacy-first, self-hosted AI assistant with smart model routing and local LLM support (Ollama).

Run 35B mixture-of-experts LLMs on a 16 GB AMD Radeon GPU. A Rust inference engine for ROCm on Windows: reads the GGUF, solves weight placement across VRAM and system RAM, tunes by measurement, compacts context, and serves an OpenAI-compatible API with a web console. No Ollama, no daemon.

An interactive AI-driven sports analytics simulation platform. It functions as a hybrid between an instant search interface and a sports management game.

One command runs the best local LLM your GPU can handle: model picked from measured multilingual benchmarks, llama.cpp tuned for AMD, NVIDIA, Intel and Apple GPUs.