Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Learn The Requests Library | Automating Data Collection from Web Sources
Automating Data Collection from Web Sources
course content

Course Content

Automating Data Collection from Web Sources

Automating Data Collection from Web Sources

IntroductionThe Requests LibraryParse the HTML Content Using BeautifulSoupExtract the Desired AttributeStore Scraped Data Into a Pandas DataFrameInclude Other Informations in the Scraping ProcessRegular Expressions
test

Swipe to show menu

book
The Requests Library

The requests library is a popular Python library for making HTTP requests. It allows you to send HTTP requests to a website's server and retrieve the server's response.

In the context of web scraping, the requests library can be used to send an HTTP request to a website's server to retrieve the HTML content of a webpage. This is often the first step in the web scraping process, as the HTML content contains all the data that you want to extract.

Task
test

Swipe to begin your solution

  1. Import the requests library.
  2. Use the requests library to retrieve the content of the website (url).
  3. Save the text (the .text attribute) in an html variable.

Once you've completed this task, click the button above the code to check your solution.

Solution

Mark tasks as Completed
Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 1. Chapter 2
AVAILABLE TO ULTIMATE ONLY
We're sorry to hear that something went wrong. What happened?
some-alt