Course Content
Preprocessing Data
Preprocessing Data
Data Extracting
Welcome to the course! Data cleaning and preprocessing is the very first step in analyzing data or model-building processes. Just after you got some raw data stored into the database (table, file, etc.), you are not able to work with it as it is. Usually, Data Analysts and Data Scientists work with huge masses of data, big tables with thousands of records. Of course, data collecting, storing, and keeping in databases requires a lot of resources, and the more data is in, the more chance that there are mismatches, wrong records, unexpected values, etc among this data. Also, some values may require to be converted, for example, '890.0' has to be converted from string to numeric data type. Origin data should be cleaned, converted, and scaled, and the whole process is called Data Preprocessing.
Before you start, let's load the data to understand what will you work with.
Data Uploading
You can upload data from different sources using pandas:
- From .csv file
- By direct link
- From existing dataframe, list or other data structure
- from built-in Python datasets
We'll use open-source dataset 'Titanic' which can be downloaded by the link as .csv file. To upload the data, use such a statement:
import pandas as pd data = pd.read_csv('path_to_file')
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Switch to desktop for real-world practiceContinue from where you are using one of the options belowEverything was clear?
Data Extracting
Welcome to the course! Data cleaning and preprocessing is the very first step in analyzing data or model-building processes. Just after you got some raw data stored into the database (table, file, etc.), you are not able to work with it as it is. Usually, Data Analysts and Data Scientists work with huge masses of data, big tables with thousands of records. Of course, data collecting, storing, and keeping in databases requires a lot of resources, and the more data is in, the more chance that there are mismatches, wrong records, unexpected values, etc among this data. Also, some values may require to be converted, for example, '890.0' has to be converted from string to numeric data type. Origin data should be cleaned, converted, and scaled, and the whole process is called Data Preprocessing.
Before you start, let's load the data to understand what will you work with.
Data Uploading
You can upload data from different sources using pandas:
- From .csv file
- By direct link
- From existing dataframe, list or other data structure
- from built-in Python datasets
We'll use open-source dataset 'Titanic' which can be downloaded by the link as .csv file. To upload the data, use such a statement:
import pandas as pd data = pd.read_csv('path_to_file')
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Switch to desktop for real-world practiceContinue from where you are using one of the options belowEverything was clear?
Data Extracting
Welcome to the course! Data cleaning and preprocessing is the very first step in analyzing data or model-building processes. Just after you got some raw data stored into the database (table, file, etc.), you are not able to work with it as it is. Usually, Data Analysts and Data Scientists work with huge masses of data, big tables with thousands of records. Of course, data collecting, storing, and keeping in databases requires a lot of resources, and the more data is in, the more chance that there are mismatches, wrong records, unexpected values, etc among this data. Also, some values may require to be converted, for example, '890.0' has to be converted from string to numeric data type. Origin data should be cleaned, converted, and scaled, and the whole process is called Data Preprocessing.
Before you start, let's load the data to understand what will you work with.
Data Uploading
You can upload data from different sources using pandas:
- From .csv file
- By direct link
- From existing dataframe, list or other data structure
- from built-in Python datasets
We'll use open-source dataset 'Titanic' which can be downloaded by the link as .csv file. To upload the data, use such a statement:
import pandas as pd data = pd.read_csv('path_to_file')
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Switch to desktop for real-world practiceContinue from where you are using one of the options belowEverything was clear?
Welcome to the course! Data cleaning and preprocessing is the very first step in analyzing data or model-building processes. Just after you got some raw data stored into the database (table, file, etc.), you are not able to work with it as it is. Usually, Data Analysts and Data Scientists work with huge masses of data, big tables with thousands of records. Of course, data collecting, storing, and keeping in databases requires a lot of resources, and the more data is in, the more chance that there are mismatches, wrong records, unexpected values, etc among this data. Also, some values may require to be converted, for example, '890.0' has to be converted from string to numeric data type. Origin data should be cleaned, converted, and scaled, and the whole process is called Data Preprocessing.
Before you start, let's load the data to understand what will you work with.
Data Uploading
You can upload data from different sources using pandas:
- From .csv file
- By direct link
- From existing dataframe, list or other data structure
- from built-in Python datasets
We'll use open-source dataset 'Titanic' which can be downloaded by the link as .csv file. To upload the data, use such a statement:
import pandas as pd data = pd.read_csv('path_to_file')
Task
Read the dataset as .csv file using the link:
Store the dataset into variable 'data'.
Switch to desktop for real-world practiceContinue from where you are using one of the options belowSwitch to desktop for real-world practiceContinue from where you are using one of the options below