Data Processing Techniques-ETL and ELT Processes
Course Intro video
()
Course Introduction
ETL Fundamentals
()
ELT Basics
()
Comparing ETL to ELT
()
Data Extraction Techniques
()
Introduction to Data Transformation Techniques
()
Data Loading Techniques
()
Summary & Highlights
ETL & Data Pipelines: Tools and Techniques-ETL using Shell Scripts
Linux Commands and Shell Scripting
ETL Techniques
ETL using Shell Scripting
()
Summary & Highlights
ETL & Data Pipelines: Tools and Techniques-An Introduction to Data Pipelines
Introduction to Data Pipelines
()
Key Data Pipeline Processes
()
Batch Versus Streaming Data Pipeline Use Cases
()
Data Pipeline Tools and Technologies
()
Summary & Highlights
Building Data Pipelines using Airflow-Using Apache Airflow to build Data Pipelines
Apache Airflow Overview
()
Advantages of Using Data Pipelines as DAGs in Apache Airflow
()
Apache Airflow UI
()
A Note on Airflow Lab Exercises
Build DAG Using Airflow
()
Airflow Monitoring and Logging
()
Summary & Highlights
Building Streaming Pipelines using Kafka-Using Apache Kafka to build Pipelines for Streaming Data
Distributed Event Streaming Platform Components
()
Apache Kafka Overview
()
Building Event Streaming Pipelines using Kafka
()
Kafka Streaming Process
()
Summary & Highlights
Final Assignment-Final Assignment
Project Overview
Assignment Instructions for Peer Graded Assignment with Airflow
Final Assignment-Course Wrap-up
Congrats & Next Steps
Team & Acknowledgements