Scrape LIVE scores - No BeautifulSoup or Selenium NEEDED!

By far the easiest and best way to scrape any website is to find the API endpoint, the place where the server puts up the information for the site to render into what we see. It's JSON data - we can mimick the request made with Python using Insomnia API client and extract the data directly, without having to render any pages or parse any HTML. This is the fastest and easy way to scrape data in 2021.


Support Me:

Proxies I use: https://proxyscrape.com/?ref=jhnwr
Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6
Gear Used: https://jhnwr.com/gear/ (NEW)
Patreon:   / johnwatsonrooney   (NEW)
-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
-------------------------------------


Timestamps
00:00 Intro
00:25 Finding the Data
03:10 Copy cURL
05:15 Generate Code
06:50 Save the Response
08:15 Extract from JSON
13:58 Combine requests and parse
14:45 Outro and Synopsis