Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Fundamentals
Course Introduction
Welcome to the Course (2:43)
Setting up Databricks Community Edition (2:52)
Preparing the Demos & Labs (3:20)
Big Data & The Lakehouse
Module Introduction (1:29)
The Need for Change (11:13)
Cloud Primer (10:39)
Big Data (12:43)
The History of Spark (15:21)
Data Lakes (11:20)
Evolution of the Lakehouse (11:42)
Module Summary (2:58)
Big Data & the Lakehouse Quiz
Intro to Spark
Module Introduction (1:55)
Notebooks (14:36)
Key Components of Spark (11:43)
Choosing a Language (10:22)
Distributed Computation (9:04)
Module Summary (2:35)
Intro to Spark Quiz
Reading Data with Spark
Module Introduction (1:38)
DataFrames (13:01)
Working with CSVs (22:08)
Files and Formats (18:15)
Schema Inference (14:34)
Data Validation (22:03)
Reading Partitioned Data (8:31)
Module Summary (7:34)
Reading Data with Spark Quiz
Transforming Data
Module Introduction (1:07)
Pyspark (6:50)
Spark Constructs (14:15)
Row Subset Functions (24:04)
Column Functions (31:18)
Aggregate Functions (26:55)
Window Functions (30:21)
Actions (14:34)
Module Summary (1:44)
Transforming Data Quiz
Additional Pyspark Transformations
Module Intro (1:44)
Conditional Logic (20:07)
String Transformations (33:48)
Complex Structures (25:18)
DataFrame Joins (13:17)
Datetime Functions (17:08)
UDFs (8:23)
Module Summary (1:26)
Additional Transformations Quiz
Writing Data
Module Introduction (1:05)
Designing a Lake Structure (21:03)
Writing to a Data Lake (26:58)
Controlling Physical Writes (12:04)
Module Summary (2:09)
Writing Data Quiz
Testing Your Skills
The Final Lab (26:15)
Course Complete (1:32)
Transforming Data Quiz
Lesson content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock