Data Lake Organization Strategy
Design a data lake structure with medallion architecture, partitioning strategies, file format selection, and access control policies.
More in Data Engineering & ETL Prompts
Data Engineering: Design an ETL Pipeline with Airflow
Airflow DAG for a daily ETL with data quality checks.
dbt: Modeling Standards for a New Project
dbt project layout and naming conventions for a new data team.
Streaming: Design a Kafka Topic + Schema Strategy
Kafka topic design, partitioning, and schema evolution plan.
Data Engineering: CDC Pipeline from Postgres to Warehouse
Change data capture from Postgres to a warehouse via Debezium.