LernerPytyhon

Scraping with BeautifulSoup and Scrapy

Web scraping is something we want and need to do all of the time, but it can be tedious and annoying, especially from within our Python programs. In this 2.5-hour webinar recorded in August 2024, I explain how to use these tools within Python to retrieve and parse HTML content.

What you should know

Course Content

Course length

2.5 hours

Number of lessons

1

Training materials

1 Jupyter notebook

Coding exercises

3

LEARN MORE

Want to grab data from a Web site? You’re talking about “scraping,” and in this 2.5-hour class, you’ll learn about how to do it in Python using two of the best-known tools, BeautifulSoup and Scrapy.

  • What are BeautifulSoup and Scrapy?
  • How to parse HTML
  • How to extract just the data you want
  • How to use Scrapy, and how it’s different from BeautifulSoup

This course, like all others on LernerPython.com, is taught by Reuven Lerner.