Introduction to NLP

Introduction to NLP

0%

1. Text Preprocessing Fundamentals

We will start our journey with learning and implementing the most common text preprocessing techniques used in NLP to convert the initial raw text into a clean, standardized form.

NLP and Its Applications

Understanding Text Preprocessing

Challenge: Tokenizing a Sentence

Tokenization Using Regular Expressions

Challenge: Tokenizing Using Regex

Removing Stop Words

Applying Text Preprocessing in Practice

2. Stemming and Lemmatization

Without further ado, let's explore stemming and lemmatization. These techniques may enhance efficiency and effectiveness of some NLP tasks, especially when working with large text corpora and treating different words forms as the same word.

Challenge: Stemming the Tokens

Part of Speech Tagging

Lemmatization with POS Tagging

3. Basic Text Models

Preprocessed text should then be transformed into a numerical representation to be used in machine learning or deep learning models for various tasks such as prediction, classification, or clustering. Here, we will learn to implement the most basic yet popular text models that transform text data into numbers.

Overview of Vector Space Models

Key Types of Vector Space Models

Customizing Bag of Words

Challenge: Creating a Bag of Words

Implementing TF-IDF

4. Word Embeddings

Time to unlock the power of word embeddings and delve into advanced techniques for capturing semantic relationships between words. We will explore various embedding models such as Word2Vec, GloVe, and FastText, with a particular focus on the Word2Vec model and its implementation.

Word Embeddings Basics

CBoW and Skip-gram Models (Optional)

Implementing Word2Vec

Challenge: Creating Word Embeddings

Зміст курсу

Introduction to NLP

Challenge: Creating a Bag of Words

Завдання

Swipe to show code editor

Your task is to display the vector for the 'graphic design' bigram in a BoW model:

Import the CountVectorizer class to create a BoW model.
Instantiate the CountVectorizer class as count_vectorizer, configuring it for a frequency-based model that includes both unigrams and bigrams.
Utilize the appropriate method of count_vectorizer to generate a BoW matrix from the 'Document' column in the corpus.
Convert bow_matrix to a dense array and create a DataFrame from it, setting the unique features (unigrams and bigrams) as its columns. Assign this to the variable bow_df.
Display the vector for 'graphic design' as an array, rather than as a pandas Series.

Перейдіть на комп'ютер для реальної практикиПродовжуйте з того місця, де ви зупинились, використовуючи один з наведених нижче варіантів

Все було зрозуміло?

Дякуємо за ваш відгук!

Секція 3. Розділ 5

toggle bottom row

Challenge: Creating a Bag of Words

Завдання

Swipe to show code editor

Your task is to display the vector for the 'graphic design' bigram in a BoW model:

Import the CountVectorizer class to create a BoW model.
Instantiate the CountVectorizer class as count_vectorizer, configuring it for a frequency-based model that includes both unigrams and bigrams.
Utilize the appropriate method of count_vectorizer to generate a BoW matrix from the 'Document' column in the corpus.
Convert bow_matrix to a dense array and create a DataFrame from it, setting the unique features (unigrams and bigrams) as its columns. Assign this to the variable bow_df.
Display the vector for 'graphic design' as an array, rather than as a pandas Series.

Перейдіть на комп'ютер для реальної практикиПродовжуйте з того місця, де ви зупинились, використовуючи один з наведених нижче варіантів

Все було зрозуміло?

Дякуємо за ваш відгук!

Секція 3. Розділ 5

Перейдіть на комп'ютер для реальної практикиПродовжуйте з того місця, де ви зупинились, використовуючи один з наведених нижче варіантів

some-alt