Data Engineering
ETL Orchestration Framework
Custom ETL framework built on Prefect for orchestrating complex data workflows. Features include automatic retry logic, data quality checks, and monitoring dashboards.
Docker
PostgreSQL
Prefect
Python
Redis
December 2025
89 stars
21 forks
Repository Statistics
89
GitHub Stars
21
Forks
Python
Primary Language
More from Data Engineering
Explore other projects in this category
Real-time Data Pipeline with Kafka & Spark
High-throughput streaming data pipeline processing millions of events per day using Apache Kafka and PySpark. Implements real-time aggregations and anomaly detection.
Apache Kafka
Docker
PostgreSQL
PySpark
Python
127
34
View Details