Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Introduction to PySpark | Spark Basics
Introduction to Big Data with Apache Spark in Python
course content

Course Content

Introduction to Big Data with Apache Spark in Python

Introduction to Big Data with Apache Spark in Python

1. Big Data Basics
Why Big Data?Big Data ProcessingMapReduceCommon Big Data Software
2. Spark Basics
Why Apache Spark?Structure of SparkRDDIntroduction to PySpark
3. Spark SQL
SparkContext and SparkSession Spark DataFrame and ColumnsQueries in PySparkConnection with PandasUploading Data from Files

Introduction to PySpark

What is PySpark?

It provides Python APIs for Spark’s core functionalities, including Spark SQL, DataFrames, RDDs (Resilient Distributed Datasets), and MLlib (machine learning library).

It also allows integration with other Python libraries and tools, making it easier to build data pipelines, perform analysis, and apply machine learning models.

Everything was clear?

Section 2. Chapter 4
We're sorry to hear that something went wrong. What happened?
some-alt