PySpark tutorial with 40+ hands-on examples of analyzing large data sets on your desktop or on Hadoop with Python!

Taming Big Data with Apache Spark 4 and Python - Hands On!

Name: Trade deep technical specialization for a broad, practical introduction to the Spark ecosystem
Rating: 6.8

InstructorSundog Education by Frank Kane

Duration8h 49m

Students114K

Rating4.5 (18K)

Trade deep technical specialization for a broad, practical introduction to the Spark ecosystem

Strengths

Practical Example-Led Learning

The curriculum includes over 40 examples, ranging from local data analysis to complex tasks like implementing Breadth-First Search using accumulators and broadcast variables.

Best suited to

Software developers transitioning into big data roles
Learners seeking practical, example-driven Spark introductions
Users interested in running jobs on AWS clusters

Less suited to

Those requiring deep technical specialization in modern DataFrame APIs
Beginners without any prior programming or scripting experience

Editorial course preview

What the public course preview actually shows

These 4 complementary views highlight concrete, legible examples from the course presentation.

A presentation slide titled DATA SOURCE API'S IN PYTHON with a bulleted list on the left and a Python code block defining a FakeDataSource class on the right. — Preview 1 of 4
This slide outlines custom Python data sources in PySpark, listing key capabilities alongside a code example that subclasses DataSource to generate synthetic data.

A diagram titled BFS IN ACTION showing a graph with nodes labeled r through y containing numbers or infinity symbols connected by lines on a blue background. — Preview 2 of 4
This slide illustrates the Breadth-First Search algorithm in action using a graph structure where nodes are assigned distance values from a starting point.

A screenshot of a web interface displaying Star Trek: Deep Space Nine details, including a poster, rating, and an Add to Watchlist button. — Preview 3 of 4
This screenshot displays the IMDb-style interface for Star Trek: Deep Space Nine, showing the movie poster, plot summary, and user interaction buttons.

Preview 4 of 4

A clear exterior shot of a modern office building displaying the prominent Amazon brand signage, visually representing the cloud infrastructure context for big data processing.