The Best Tools to Scrape Data in 2024

Python has a great ecosystem for webscraping and in this video I run through the packages I use everyday to scrape data.

Join the Discord to discuss all things Python and Web with our growing community!   / discord  

If you are new, welcome! I am John, a self taught Python developer working in the web and data space. I specialize in data extraction and JSON web API's both server and client. If you like programming and web content as much as I do, you can subscribe for weekly content.

:: Links ::
My Patrons Really keep the channel alive, and get extra content   / johnwatsonrooney   (NEW free tier)

Recommender Scraper API https://www.scrapingbee.com/?fpr=jhnwr
I Host almost all my stuff on Digital Ocean https://m.do.co/c/c7c90f161ff6
Proxies I use https://proxyscrape.com/?ref=jhnwr

:: Disclaimer ::
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.

Timestamps

00:00 Best?
01:13 Http Clients
04:26 HTML Parsing
05:55 Saving Data
06:18 Frameworks
08:00 Scrapy
09:20 Paid Options
10:38 My Go To