Introduction
Modern data engineering
()
1. Modern Data Lakes
A brief history of big data
()
The modern data landscape
()
Data warehouses and lakehouses in the context of AI
()
2. Fundamentals of Database Engineering
Relational versus nonrelational data models
()
Row versus columnar data stores
()
Hands-on demo: Load data into DuckDB
()
Design for performance
()
3. Data Transformation
Extract, transform, load versus extract, load, and transform
()
SQL or Python
()
Hands-on demo: dbt core setup
()
4. Workflow Orchestration
Putting it all together: Dagster and dbt
()
Hands-on demo: Dagster assets
()
Conclusion: The Future of Data Engineering
Degree or decree
()
Range: Why generalists will triumph over specialists
()
Design for performance
()