Скачать или смотреть Scraping and forwarding data from multiple levels of a website and from API simultaneously | Scrapy

Hey what's going on guys, it happens quite often that you need to scrape items from multiple levels of the website, e.g. get title from the index level and then crawls cards recursively and extract descriptions from that level and also make some API calls at the same time to get some extra data as well. And what if you need to bring the data all together after? That's the exact case we'll walk through in this tutorial - we gonna be scraping data from different levels, forwarding it between levels using scrapy request "meta" argument for that purpose to eventually gather the items all in one place and write them to file. I tried to keep things simple and beginners friendly.

Source code
https://github.com/maksimKorzh/scrapy...

Request format for web scraping tutorial on demand
url: https://pharmeasy.in/health-care/pers...
data: title, brand, price, quantity, image url
pages: all | pages 1-3 | infinite scroll all or 1-2 pages
output: CSV | JSON | MySQL | etc.
toolchain: Requests + BeautifulSoup | Scrapy
deliverable:    • Indian pharmacy WEB SCRAPING tutorial | Sc...  

💖 Become a Patron 💖
  / code_monkey_king