Apache Airflow DAG Builder
Generate production-ready Airflow DAGs with task dependencies, error handling, SLA monitoring, and dynamic tas...
Prompts for data pipelines, ETL workflows, data warehouse design, Apache Airflow DAGs, dbt models, and data quality frameworks.
10 prompts found
Generate production-ready Airflow DAGs with task dependencies, error handling, SLA monitoring, and dynamic tas...
Design a layered dbt project structure with staging, intermediate, and mart models following best practices fo...
Design a data warehouse schema with fact and dimension tables, slowly changing dimensions, and query-optimized...
Design a robust error handling framework for ETL pipelines with dead letter queues, retry strategies, data qua...
Build a data quality framework with schema validation, statistical anomaly detection, referential integrity ch...
Implement SCD Type 1, 2, and 3 patterns for dimension tables with merge logic, effective dating, and historica...
Design a real-time streaming data pipeline using Apache Kafka with schema registry, consumer groups, and exact...
Design a data lineage tracking system that maps data flow from source to dashboard with column-level lineage a...
Design a data lake structure with medallion architecture, partitioning strategies, file format selection, and...
Evaluate whether a data pipeline should use batch or stream processing based on latency, cost, complexity, and...