SUMMARY AI summary by gpt-5-mini
Local AI Backend is a Django REST API wrapper that exposes OpenAI-compatible endpoints for running local GGUF models via llama-cpp-python. It provides /v1/chat/completions and /v1/embeddings for chat and embedding workflows, plus model management endpoints to list and inspect local models. Who uses it: developers and teams who need self-hosted, privacy-preserving or offline LLM inference and want an API compatible with OpenAI client tooling. Key features: - OpenAI-compatible chat completions and embeddings endpoints - Run quantized GGUF models locally (no cloud inference) - Download and manage models from HuggingFace Hub (HF token support) - Async-ready Django views for non-blocking inference - Model storage configurable via AI_MODELS_DIR; uses Django 5, llama-cpp-python, huggingface-hub, Pydantic, and django-environ. Requires Python 3.12+ and Poetry.
DETECTED Detected AI stack
AI-related keywords found in this repo's description, topics, or README summary — grouped by category. Each badge links to the corresponding ranking detail page.
Language breakdown (by bytes)
Owner
Dates
| Created on GitHub | 2026-05-09 |
| Last push | 2026-05-09 |
| First seen here | 2026-05-09 |
| Last fetched | 2026-05-09 18:12 |
Similar repos (same language)
Reverse proxy for your ai quota from the SW platform.
dea6cat/2b-agentThis llm Agent was created based on necessity for one that could simply use local models without making them hallucinate and keep them focus
Zuboy/Carbon-Cost-Optimizer-Agentic-AIAn AI agent that decides where and when to run ML training jobs to minimize cost and carbon emissions, then launches them autonomously — exposed entirely through MCP tools.
FuchaZ/lm-studio-vision-bridge给纯文本 AI agent 装上眼睛——通过 LM Studio 本地视觉模型提供 MCP 图片识别服务
Shrutirowlo/AI-Video-AgentAI-powered video generation agent that automates script analysis, scene planning, and video creation.
Shivang0/social-visionPaste an Instagram/TikTok/YouTube/X link and Claude watches it for you — transcribes audio, reads on-screen text & visuals, explains what it's about. Local, cross-platform Claude Code plugin.
markusbegerow/claude-fuer-oeffentliche-verwaltung⚠️ Experimentelle Skill-Sammlung für Digitalisierung, Fachverfahren und Organisation der deutschen öffentlichen Verwaltung (OZG, FIM, FIT-Connect, KI-Einsatz, eIDAS, BSI-IT-Grundschutz, DSGVO) – bitte testen, Issues/PRs willkommen! Keine Rechts-/Datenschutzberatung, keine verbindliche Behördenentscheidung. Keine Bürger-/Mitarbeiterdaten im Repo.
knowledgegut/course-distiller把有權使用的工作坊/課程回放消化成套品牌色的步驟式學習 PDF；最後的重組交還人腦。A Claude Code skill by 知識包小腸.