Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Introduction to PySpark | Spark Basics
Introduction to Big Data with Apache Spark in Python
course content

Course Content

Introduction to Big Data with Apache Spark in Python

Introduction to Big Data with Apache Spark in Python

1. Big Data Basics
Course Overview SparkWhy Big Data?Big Data ProcessingCommon Big Data SoftwareApache Hadoop Basics
2. Spark Basics
Why Apache Spark?Structure of SparkRDDIntroduction to PySpark
3. Spark SQL
SparkContext and SparkSession Spark DataFrame and ColumnsQueries in PySparkConnection with PandasUploading Data from Files

bookIntroduction to PySpark

What is PySpark?

It provides Python APIs for Spark’s core functionalities, including Spark SQL, DataFrames, RDDs (Resilient Distributed Datasets), and MLlib (machine learning library).

It also allows integration with other Python libraries and tools, making it easier to build data pipelines, perform analysis, and apply machine learning models.

Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 2. Chapter 4
some-alt