Working with Data in Python-About the Course
Welcome to Scripting with Python and SQL for Data Engineering
()
Meet your Course Instructor: Alfredo Deza
()
Meet your Supporting Instructors: Kennedy Behrman and Noah Gift
Course Structure and Discussion Etiquette
Overview of Key Concepts
()
Working with Data in Python-Exploring Data Structures in Python
Introduction to Working with Data in Python
()
Introduction to Python Data Structures
()
Using Lists to Save and Retrieve Data in Python
()
Using Dictionaries to Save and Retrieve Data in Python
()
Overview of Lesson Common Data Structures in Python
()
Python Lists and Dictionaries
Recap of Data Structures in Python
()
Working with Data in Python-Mapping Data Structures in Python
Introduction to Choosing Data Structures in Python
()
Iterating Over Lists and Dictionaries in Python
()
Iterating Over Other Data Structures in Python
()
Storing Data Between Data Structures in Python
()
Recap of Mapping Data Structures in Python
()
Working with Data in Python-Persisting and Loading Data in Python
Introduction to Data Sources and Formats in Python
()
Loading Data from Files and File Paths in Python
()
Working with JSON in Python
()
Saving Data from Python to Disk
()
Recap of Persisting and Loading Data in Python
()
Working with Data in Python-Putting it all Together: JSON Formatting Jupyter Notebook
Build a notebook that reformats data into JSON
Python Scripting and SQL-Python Scripting Basics
Introduction to Python Scripting and SQL
()
Introduction to Scripting in Python
()
Creating a Script as a Module in Python
()
Traversing the File System with a Script in Python
()
Minimal Python, Chapter 2: Learn to Store Data
Recap of Python Scripting Basics
()
Python Scripting and SQL-SQLite and Python
Introduction to Embedded Databases
()
What is SQLite?
()
Creating and Connecting to a SQLite Database in Python
()
Saving and Querying from a SQLite Database in Python
()
Recap of SQLite and Python
()
Python Scripting and SQL-Querying Databases with SQL
Introduction to Querying with SQL in Python
()
Basic SQL Commands in Python
()
Extracting Distinct Data using SQL in Python
()
Searching with SQL in Python
()
Recap of Querying with SQL in Python
()
Python Scripting and SQL-Putting it all Together: Create a Reporting Script for File Sizes
Create a Reporting Script for File Sizes
Web Scraping using Python-Introduction to Web Scraping
Introduction to Web Scraping using Python
()
Introduction to Extracting Data from Unstructured HTML
()
Challenges with Web Data
()
Parsing Techniques with HTMLParser
Parsing HTML with HTMLParser in Python
()
Recap of Web Scraping Techniques in Python
()
Web Scraping using Python-Using Scrapy and XPath
Introduction to Scrapy and XPath in Python
()
Creating a Web Scraping Project with Scrapy in Python
()
Parsing Data with XPath and Scrapy Shell
()
Using Scrapy Spider for Web Scraping
()
Codespaces Lab: Parse HTML with Scrapy and XPath
Recap of Scrapy and XPath in Python
()
Web Scraping using Python-Persistence and Efficiency with Scraping
Overview of Challenges with Web Scraping
()
Scraping Locally
()
Persisting Data in CSV and JSON Formats
()
Persisting Data to a SQLite Database
()
Efficient Scraping Techniques
Recap of Persistence and Efficacy with Web Scraping
()
Web Scraping using Python-Putting it all Together: Build a Web Scraping Tool
Build a Web Scraping Tool
Working with MySQL-Using VSCode and MySQL
Introduction to Working with MySQL
()
Introduction to VSCode with MySQL
()
Connecting to a MySQL Server
()
Recap of VSCode with MySQL
()
Working with MySQL-Running SQL Queries from VSCode
Challenges of Running MySQL Queries
()
Using VSCode to Execute MySQL Queries
()
Working with VSCode and MySQL
Recap of Running MySQL Queries
()
Working with MySQL-Importing and Exporting Data in MySQL
Challenges with Importing to Databases
()
Importing CSV Data into MySQL
()
Exporting Data from MySQL
()
Recap of Importing and Exporting Data in MySQL
()
Working with MySQL-Putting it all Together: Loading and Exporting Data using MySQL
Loading and Exporting Data using MySQL