#airflow

End-to-End Real-time Zomato Data Engineering Pipeline built using Apache Kafka, PySpark, AWS S3, Delta Lake, and OpenAI API for review sentiment analysis.

Pipeline ETL météo orchestré avec Apache Airflow et Docker

An Airflow-orchestrated ETL demo: extract, transform, and load daily sales data through a simple, testable task pipeline.

Daily air quality pipeline for Cairo: Open-Meteo API -> Postgres -> dbt star schema, orchestrated with Airflow, all in Docker Compose.

AI for move

An end-to-end data pipeline for a fictional SaaS company, "GTech." Data is generated in Python, loaded into PostgreSQL, transformed with dbt, analyzed by an OpenAI API-powered agent, and displayed in Streamlit - all automated with Airflow.