#data-engineering
GitHub repositories that have self-applied the topic "data-engineering" — a creator-tagged metadata that surfaces how AI projects describe themselves.
REPOS Repos for #data-engineering (top 17 by stars)
Operational database for AI agents , causal lineage (why()), semantic memory, live dashboards, MCP + Python/TypeScript SDK. Self-host or use db.zizka.ai.
kavyasruthi58/healthcare-claims-analytics-platformAI-powered healthcare claims analytics using Python, SQL, and Tableau
VamsiReddy17/multi-agent-etl-consoleA production-grade multi-agent ETL system orchestrated by Apache Airflow. Features real-time Kafka streaming, Dead Letter Queue routing, BigQuery integration, a FastAPI control layer, and a React-based "Cosmos" UI for live pipeline topology and quarantine management.
Azeem8541/zomato-realtime-ai-data-pipelineEnd-to-End Real-time Zomato Data Engineering Pipeline built using Apache Kafka, PySpark, AWS S3, Delta Lake, and OpenAI API for review sentiment analysis.
yhay81/sqrailA bounded SQL-on-files CLI for coding agents. SQL in, files out.
princesingh-ai/dronerfDroneRF is an open-source PyTorch-based 1D CNN system that detects and classifies UAV RF transmissions directly from raw IQ signal samples.
sunnnn2005/data-quality-agentLocal-first data reliability agent with dataset profiling, typed findings, quality scoring, and report traces.
auceanev/airflow-meteoPipeline ETL météo orchestré avec Apache Airflow et Docker
gaurav-bhadane/Enterprise_Agentic_AI_Operations_PlatformEnterprise Agentic AI Platform for autonomous pipeline monitoring, root cause analysis, incident retrieval, data quality validation, and self-healing workflow orchestration using LangGraph, FAISS, Vector Search, and Python.
aayushi-jha2018/airflow-etl-demoAn Airflow-orchestrated ETL demo: extract, transform, and load daily sales data through a simple, testable task pipeline.
Rennam-Dev/rennam-dev-platformPersonal AI Data Engineering lab, portfolio and publishing platform built with FastAPI, PostgreSQL and modern engineering practices.
Mossab28/nightshiftThe on-call data team that gets smarter every night. Claude agents on DataHub: incidents resolved, postmortems remembered in the graph itself.
nishantsingodia/cricket-auction-helperLive fantasy-cricket auction room with a data-driven player valuation engine and an AI bid advisor
Query-farm/vgi-lint-checkLint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
VnhNg/job-market-radar“Job Market Radar: a data pipeline for job post collection + governed analytics API + Agent to analyze job postings.”
kaiodt/databricks-grid-intelligenceÁrea de atendimento de uma distribuidora de energia no Databricks: medalhão, dashboard e copiloto conversacional, construídos com Claude Code e as skills do AI Dev Kit.
JarvisLee511/multi-cloud-ai-infrastructure-analysisMulti-cloud market intelligence on AWS / Azure / GCP - live GPU pricing tracker, 2016-2026 market history from SEC filings, SQL star schema, interactive dashboards
RELATED Other topics · full topics ranking →
#claude-code
1,564#ai-agents
1,160#llm
1,071#claude
943#python
806#ai
741#developer-tools
728#mcp
727#codex
521Aggregated by case-insensitive match against topics_json of each repo's latest content snapshot. methodology