wesamsabry/Airflow-ETL-Retail-Project

Retail Data Pipeline — Astro Airflow Pipelines is a production-ready ETL framework that uses Apache Airflow (Astro CLI) to orchestrate end-to-end ingestion, transformation, validation and incremental loading of retail data into a PostgreSQL data warehouse. Intended for data engineers and platform teams, it demonstrates a modular, testable architecture combining CSV batch and REST API sources. Key features include idempotent upserts with a high‑watermark incremental engine, fault‑tolerant API handling (retries/backoff), schema and row‑level validation, dimensional modeling (fact/dim), structured logging and observability, Dockerized local runtime, and Airflow DAG-based orchestration.

このRepoのdescription / GitHub topics / READMEのAI要約に出現したAI関連キーワードをカテゴリ別に表示。各バッジは該当カテゴリの詳細ランキングへリンクします。