ML Introduction with scikit-learn

ML Introduction with scikit-learn

0%

1. Machine Learning Concepts

Learn the Machine Learning concepts and the ML project workflow.

Types of Machine Learning

Machine Learning Workflow

2. Preprocessing Data with Scikit-learn

Preprocessing is probably the most important stage of an ML project. This chapter covers the preprocessing steps needed for almost any dataset.

Scikit-learn Concepts

Getting Familiar with Dataset

Dealing with Missing Values

Challenge: Imputing Missing Values

One-Hot Encoder

Challenge: Encoding Categorical Variables

Why Scale the Data?

StandardScaler, MinMaxScaler, MaxAbsScaler

Challenge: Scaling the Features

Preprocessing Summary

3. Pipelines

A pipeline is a neat way to combine all the preprocessing steps as well as a model. Pipelines make it much easier to train and use a model.

What is Pipeline

ColumnTransformer

Efficient Data Preprocessing with Pipelines

Challenge: Creating a Pipeline

Final Estimator

Challenge: Creating a Complete ML Pipeline

4. Modeling

Modeling is the most fun stage of an ML project. Let's learn to build, fine-tune and evaluate the model!

KNeighborsClassifier

Evaluating the Model

Cross-Validation

Challenge: Evaluating the Model with Cross-Validation

The Flaw of GridSearchCV

Challenge: Tuning Hyperparameters with RandomizedSearchCV

Modeling Summary

Challenge: Putting It All Together

Course Content

ML Introduction with scikit-learn

ML Introduction with scikit-learn

1. Machine Learning Concepts

What is ML Types of Machine Learning Training Set Types of Data Machine Learning Workflow

2. Preprocessing Data with Scikit-learn

Scikit-learn Concepts Getting Familiar with Dataset Dealing with Missing Values Challenge: Imputing Missing Values OrdinalEncoder One-Hot Encoder LabelEncoder Challenge: Encoding Categorical Variables Why Scale the Data?StandardScaler, MinMaxScaler, MaxAbsScaler Challenge: Scaling the Features Preprocessing Summary

3. Pipelines

What is Pipeline ColumnTransformer Efficient Data Preprocessing with Pipelines Challenge: Creating a Pipeline Final Estimator Challenge: Creating a Complete ML Pipeline

4. Modeling

Models KNeighborsClassifier Evaluating the Model Cross-Validation Challenge: Evaluating the Model with Cross-Validation GridSearchCV The Flaw of GridSearchCV Challenge: Tuning Hyperparameters with RandomizedSearchCV Modeling Summary Challenge: Putting It All Together

Why Scale the Data?

Now that we have handled missing values and encoded categorical features, we have dealt with all the problems that would raise an error when fed to the model. However, there is another problem we mentioned, different scales.

This problem will not cause errors if you feed the current-state data to the model, but it can substantially worsen some ML models.

Consider an example where one feature is 'age', ranging from 18 to 50, and the second feature is 'income', ranging from $25,000 to $500,000. It's clear that a ten-year difference in age is more significant than a ten-dollar difference in income.

However, some models, such as k-NN (which we will use in this course), may treat these differences as equally important. Consequently, the 'income' column will have a much more significant impact on the model. Therefore, it's crucial for features to have roughly the same range for k-NN to function effectively.

While other models may be less affected by different scales, scaling data can significantly enhance processing speed. Thus, data scaling is commonly included as a final step in preprocessing.

The next chapter will cover the three most used transformers for data scaling. Those are StandardScaler, MinMaxScaler, and MaxAbsScaler.

Everything was clear?

Thanks for your feedback!

Section 2. Chapter 9

some-alt