Preparation for Data Science

In this section we will get acquainted with what the NumPy library is, as well as learn how to create an array.

In this section we will get acquainted with arrays of different dimensions, and understand the difference between them.

In this section we should recall what slices are and learn how to make them for arrays of different dimensions. We shall also learn to refer to elements in an array using their indexes.

In this section we will learn how to reshape arrays and also how to concatenate an array. Moreover we will learn how to sort an array. Also we will learn about such an interesting method that is often used for arrays, namely: copy().

In this project, we will delve into the fundamentals of NumPy, exploring its core features and uncovering the reasons behind its significant impact on scientific computing.

Verdiep je in de basisprincipes van de pandas-bibliotheek. Leer het aanmaken en manipuleren van Series en DataFrames, onderzoek hun structuur en ontwikkel vertrouwen in het uitvoeren van essentiële data-operaties.

Beheers het laden en beheren van gegevens uit CSV- en TXT-bestanden. Praktische ervaring opdoen met het importeren van datasets en het voorbereiden ervan voor verdere analyse met behulp van pandas-tools.

Leer gegevens effectief te verkennen, opschonen en samenvatten. Begrijp hoe ontbrekende waarden te behandelen, inzichten te verkrijgen en basisstatistische bewerkingen uit te voeren met pandas.

In deze sectie leert u hoe u specifieke kolommen kunt weergeven op basis van hun titels of indexen. Ook maakt u kennis met de methoden om rijen te selecteren op basis van indexen.

Hier leert u hoe u gegevens extraheert die aan specifieke voorwaarden voldoen. Daarnaast leert u hoe u deze voorwaarden kunt combineren en zelfs uw eigen voorwaarden kunt creëren.

In deze sectie breidt u uw kennis uit over het instellen van verschillende gegevenscondities. U leert controleren of uw gegevens zich in een gedefinieerde lijst met waarden bevinden of tussen twee waarden liggen. U leert ook hoe u de grootste en kleinste waarden kunt vinden.

Deze sectie behoort tot de meest boeiende van de cursus. Hier leert u hoe u gegevens op verschillende manieren kunt groeperen. Dit helpt u als data-analist om informatie over specifieke gegevensgroepen te achterhalen.

Deze sectie is een van de belangrijkste voor een data-analist, omdat het onmogelijk is om met gegevens te werken als deze ontbrekende waarden of een onjuist formaat bevatten. Hier leert u hoe u met dergelijke ongeschikte waarden omgaat.

In this project, we are going to understand what Pandas is and why it is so powerful.

Let's start with some basic definitions and concepts we'll use later. Consider the idea of a function, a numerical sequence, and its sum, and also understand what a coordinate system's basis is.

The simplest and most commonly used type of relationship is the linear relationship. Linear algebra is a branch of higher mathematics entirely devoted to linear functions and linear spaces. Let's look at some of the most important topics in linear algebra: vectors, matrices, solving linear equations, and solving the spectral problem for matrices.

Mathematical analysis is a discipline that allows you to analyze functions according to various criteria. Consider how to check numerical sequences for convergence, find the maximum/minimum values of functions, solve nonlinear equations, and use integrals to solve applied problems.

We will start our way of learning probability theory by considering some basic definitions and rules: what is a stochastic experiment and random event, what is independence and incompatibility of events in the context of probability theory, what is the probability and how can we calculate probabilities of different elementary events.

In real-life tasks, we often have to deal with complex relationships and, as a result, calculate probabilities of several events or events that depend on each other. Let's consider how we can do this using probability theory.

To solve many real problems in probability theory, special models have been created that describe a particular situation. Let's consider some of the most used models that can be used to describe some discrete results of stochastic experiments.

What if the result of a stochastic experiment cannot be described by a discrete value? For this, models that work with continuous values are used. Consider the most popular of these models.

Often we are faced with the task of checking the dependence of the results of different stochastic experiments on each other. Moreover, it is necessary not only to assess the presence of dependencies but also to somehow quantify the degree of dependencies. To solve these problems, we can use covariance and correlation.

Ontdek de kernprincipes van statistiek, waaronder datatypes, maten van centrale tendentie en belangrijke verschillen tussen steekproeven en populaties.

Leer het berekenen en interpreteren van gemiddelde, mediaan en modus met Python. Oefen deze bewerkingen met pandas om echte datasets te analyseren.

Inzicht in hoe variantie en standaarddeviatie de spreiding van gegevens meten. Leren om beide handmatig en met Python-tools te berekenen.

Onderzoek hoe covariantie en correlatie relaties tussen variabelen beschrijven. Oefen met het berekenen en vergelijken van beide statistieken in Python.

Beheers betrouwbaarheidsintervallen om populatieparameters te schatten. Gebruik NumPy, pandas en visualisatiebibliotheken om intervallen te berekenen en te interpreteren met echte gegevens.

Leer de basisprincipes van hypothesetoetsing en de t-toets. Begrijp hoe u toetsen ontwerpt, uitvoert en interpreteert met Python ter ondersteuning van datagedreven besluitvorming.

Now we will understand some fundamental theoretical concepts which are used in solving real live tasks: absolutely continuous and discrete random variables, probability density function, cumulative distribution function, the characteristics of a random variable, etc.

The limit theorems of probability theory are fundamental laws of probability theory that are often used in practice in a wide variety of areas, such as: building confidence intervals, estimating distribution parameters, providing A/B testings, creating ensembles of ML models, etc. Now we will consider two of the most commonly used: the Law of Large Numbers and the Central Limit Theorem.

When we work with real data we usually do not know from which distribution this data was obtained. In order to determine this, we must be able to correctly estimate the parameters of this distribution and the type of distribution, which we will learn to do in this section.

We have already learned how to estimate the parameters of the population. But to estimate the parameter, we make an assumption about the population distribution. Can we say that our assumption is correct? How do we prove that the estimated parameters are the real parameters of the population? Can we show that two sets of samples are independent? To answer these questions, it is necessary to consider the concept of hypothesis testing.