What is Data Engineering?-Modern Data Ecosystem and role of Data Engineering
Welcome to Introduction to Data Engineering
()
Modern Data Ecosystem
()
Key Players in the Data Ecosystem
()
What is Data Engineering?
()
Viewpoints: Defining Data Engineering
()
Viewpoints: Evolution of Data Engineering
()
Summary and Highlights
What is Data Engineering?-Responsibilities and Skillsets of a Data Engineer
Responsibilities and Skillsets of a Data Engineer
()
Viewpoints: Skills and Qualities to be a Data Engineer
()
A Day in the Life of a Data Engineer
()
Summary and Highlights
The Data Engineering Ecosystem-The Data Ecosystem and Languages for Data Professionals
Overview of the Data Engineering Ecosystem
()
Types of Data
()
Understanding Different Types of File Formats
()
Sources of Data
()
Languages for Data Professionals
()
Viewpoints: Working with Varied Data Sources and Types
()
Summary and Highlights
The Data Engineering Ecosystem-Data Repositories, Data Pipelines, and Data Integration Platforms
Overview of Data Repositories
()
RDBMS
()
NoSQL
()
Data Warehouses, Data Marts, and Data Lakes
()
(Optional): Data Lakehouses Explained
()
Viewpoints: Considerations for Choice of Data Repository
()
ETL, ELT, and Data Pipelines
()
Data Integration Platforms
()
Viewpoints: Tools, Databases, and Data Repositories of Choice
()
Summary and Highlights
The Data Engineering Ecosystem-[Optional] Create an instance of IBM Db2 database
Optional Labs for IBM Cloud and Db2
The Data Engineering Ecosystem-Big Data Platforms
Foundations of Big Data
()
Big Data Processing Tools: Hadoop, HDFS, Hive, and Spark
()
Viewpoints: Impact of Big Data on Data Engineering
()
Summary and Highlights
Data Engineering Lifecycle-Data Platforms, Data Stores, and Security
Architecting the Data Platform
()
Factors for Selecting and Designing Data Stores
()
Security
()
Viewpoints: Importance of Data Security
()
Summary and Highlights
Data Engineering Lifecycle- Data Collection and Data Wrangling
How to Gather and Import Data
()
Data Wrangling
()
Tools for Data Wrangling
()
Summary and Highlights
Data Engineering Lifecycle-Querying Data, Performance Tuning, and Troubleshooting
Querying and Analyzing Data
()
Performance Tuning and Troubleshooting
()
Summary and Highlights
Data Engineering Lifecycle-Governance and Compliance
Governance and Compliance
()
Summary and Highlights
Optional: Overview of the DataOps Methodology
Career Opportunities and Data Engineering in Action-Career Opportunities and Learning Paths
Career Opportunities in Data Engineering
()
Viewpoints: Get into Data Engineering
()
Data Engineering Learning Path
()
Viewpoints: What Do Employers Look for in a Data Engineer
()
Viewpoints: The Many Paths to Data Engineering
()
Viewpoints: Advice to Aspiring Data Engineers
()
Summary and Highlights
Career Opportunities and Data Engineering in Action- Course Wrap-Up
Congratulations and Next Steps