Kurssisisältö

ML Introduction with scikit-learn

1. Machine Learning Concepts

What is ML Types of Machine Learning Training Set Types of Data Machine Learning Workflow

2. Preprocessing Data with Scikit-learn

Scikit-learn Concepts Getting Familiar with Dataset Dealing with Missing Values Challenge: Imputing Missing Values OrdinalEncoder One-Hot Encoder LabelEncoder Challenge: Encoding Categorical Variables Why Scale the Data?StandardScaler, MinMaxScaler, MaxAbsScaler Challenge: Scaling the Features

3. Pipelines

What is Pipeline ColumnTransformer Efficient Data Preprocessing with Pipelines Challenge: Creating a Pipeline Final Estimator Challenge: Creating a Complete ML Pipeline

4. Modeling

Models KNeighborsClassifier Evaluating the Model Cross-Validation Challenge: Evaluating the Model with Cross-Validation GridSearchCV The Flaw of GridSearchCV Challenge: Tuning Hyperparameters with RandomizedSearchCV Modeling Summary Challenge: Putting It All Together

Challenge: Imputing Missing Values

The SimpleImputer class is designed to handle missing data by automatically replacing missing values.

python

When initialized, it can also be customized by setting its parameters:

missing_value: specifies the placeholder for the missing values. By default, this is np.nan;
strategy: the strategy used to impute missing values. 'mean' is the default value;
fill_value: Specifies the value to use for filling missing values when the strategy is 'constant'. By default, this is None.

Being a transformer, it has the following methods:

However, we also need to choose the value to impute.

The popular approach is to impute missing numerical values with the mean and missing categorical values with the mode (the most frequent value), as such imputation minimally impacts the distribution of the values.

The approach can be controlled using the strategy parameter:

strategy='mean': impute with mean along each column;
strategy='median': impute with median along each column;
strategy='most_frequent': impute with mode along each column;
strategy='constant': impute with constant number specified in fill_value parameter.

The missing_values parameter controls what values are considered missing. By default, it is NaN, but in different datasets, it can be an empty string '' or anything else.

When you use the .fit_transform() method of the SimpleImputer, it produces a 2D array as output. However, when updating a single column in a pandas DataFrame, you need a 1D array (or a Series).

python

To convert the 2D array into a 1D array suitable for assignment to a DataFrame column, you can apply the .ravel() method. This method flattens the array. Here's how you can update a column after imputation:

python

This approach ensures that the imputed values are correctly formatted and assigned back to the DataFrame.

Tehtävä

Swipe to start coding

Your task is to impute the NaN values of the 'sex' column using SimpleImputer. Since you are dealing with a categorical column, you will replace null values with the most frequent value (the most common approach).

Import the SimpleImputer.
Create a SimpleImputer object with the desired strategy.
Impute the missing of the 'sex' column using the imputer object.

Ratkaisu

Great! We dealt with the missing values problem in our dataset. We removed the rows with more than one null and imputed the 'sex' column with the most frequent value – MALE.

Vaihda työpöytään todellista harjoitusta vartenJatka siitä, missä olet käyttämällä jotakin alla olevista vaihtoehdoista

Oliko kaikki selvää?

Kiitos palautteestasi!

Osio 2. Luku 4

Challenge: Imputing Missing Values

The SimpleImputer class is designed to handle missing data by automatically replacing missing values.

python

When initialized, it can also be customized by setting its parameters:

missing_value: specifies the placeholder for the missing values. By default, this is np.nan;
strategy: the strategy used to impute missing values. 'mean' is the default value;
fill_value: Specifies the value to use for filling missing values when the strategy is 'constant'. By default, this is None.

Being a transformer, it has the following methods:

However, we also need to choose the value to impute.

The approach can be controlled using the strategy parameter:

strategy='mean': impute with mean along each column;
strategy='median': impute with median along each column;
strategy='most_frequent': impute with mode along each column;
strategy='constant': impute with constant number specified in fill_value parameter.

The missing_values parameter controls what values are considered missing. By default, it is NaN, but in different datasets, it can be an empty string '' or anything else.

python

python

This approach ensures that the imputed values are correctly formatted and assigned back to the DataFrame.

Tehtävä

Swipe to start coding

Import the SimpleImputer.
Create a SimpleImputer object with the desired strategy.
Impute the missing of the 'sex' column using the imputer object.

Ratkaisu

Great! We dealt with the missing values problem in our dataset. We removed the rows with more than one null and imputed the 'sex' column with the most frequent value – MALE.

Vaihda työpöytään todellista harjoitusta vartenJatka siitä, missä olet käyttämällä jotakin alla olevista vaihtoehdoista

Oliko kaikki selvää?

Kiitos palautteestasi!

Osio 2. Luku 4

Vaihda työpöytään todellista harjoitusta vartenJatka siitä, missä olet käyttämällä jotakin alla olevista vaihtoehdoista