SUMMARY AI summary by gpt-5-mini
local-ai-server is a stateful API gateway for a locally running Ollama instance, built with FastAPI, LangChain and async Python. It’s aimed at developers who want a secure, session-aware HTTP interface to local LLMs (Ollama), suitable for local or Docker deployments (CPU, NVIDIA, AMD). Key features: - Per-request or session model selection with configurable allowed models - Stateful chat sessions persisted to PostgreSQL (or in-memory fallback) - JWT auth with email/password registration, admin-controlled allowlist - "thinking"/"nothinking" modes, context truncation (sliding window) - Concurrency control (semaphore + queue), request timeouts - SSE streaming for token-by-token replies - Structured logging and admin APIs for user/allowlist management Includes Docker compose files, example .env, and API routes (/chat, /chat/stream, auth, admin, health).
DETECTED Detected AI stack
AI-related keywords found in this repo's description, topics, or README summary — grouped by category. Each badge links to the corresponding ranking detail page.
Language breakdown (by bytes)
Owner
Fullstack developer with lots of discord bots projects. @Timmy1236 my programming bestie!! hi bestie!!
Dates
| Created on GitHub | 2026-05-09 |
| Last push | 2026-05-09 |
| First seen here | 2026-05-09 |
| Last fetched | 2026-05-09 18:12 |
Similar repos (same language)
Reverse proxy for your ai quota from the SW platform.
dea6cat/2b-agentThis llm Agent was created based on necessity for one that could simply use local models without making them hallucinate and keep them focus
Zuboy/Carbon-Cost-Optimizer-Agentic-AIAn AI agent that decides where and when to run ML training jobs to minimize cost and carbon emissions, then launches them autonomously — exposed entirely through MCP tools.
FuchaZ/lm-studio-vision-bridge给纯文本 AI agent 装上眼睛——通过 LM Studio 本地视觉模型提供 MCP 图片识别服务
Shrutirowlo/AI-Video-AgentAI-powered video generation agent that automates script analysis, scene planning, and video creation.
Shivang0/social-visionPaste an Instagram/TikTok/YouTube/X link and Claude watches it for you — transcribes audio, reads on-screen text & visuals, explains what it's about. Local, cross-platform Claude Code plugin.
markusbegerow/claude-fuer-oeffentliche-verwaltung⚠️ Experimentelle Skill-Sammlung für Digitalisierung, Fachverfahren und Organisation der deutschen öffentlichen Verwaltung (OZG, FIM, FIT-Connect, KI-Einsatz, eIDAS, BSI-IT-Grundschutz, DSGVO) – bitte testen, Issues/PRs willkommen! Keine Rechts-/Datenschutzberatung, keine verbindliche Behördenentscheidung. Keine Bürger-/Mitarbeiterdaten im Repo.
knowledgegut/course-distiller把有權使用的工作坊/課程回放消化成套品牌色的步驟式學習 PDF；最後的重組交還人腦。A Claude Code skill by 知識包小腸.