Скачать или смотреть Scraping Woolworthless with AI, Playwright & curl — Building MeanMan’s Product Data Layer

We’re taking on Woolworthless and building the product scraping backbone for the MeanMan price compare app. This stream is all about AI-assisted debugging, Playwright navigation, and raw curl tests to break through bot walls and capture full product data.

What you’ll see:
• Using curl with browser-like headers & cookies to probe Woolworthless APIs
• Capturing network calls with Playwright to extract real JSON endpoints
• AI-guided tweaks to bypass Akamai/Dynatrace blocks
• Printing the first 10 products per category to the terminal for verification
• Persisting clean product data into MongoDB (rs0) for MeanMan

Stack: Node.js + TypeScript + Next.js + MongoDB + Playwright + curl

Project rules: no alcohol or tobacco data displayed. Focus stays on groceries & essentials.

Tags: web scraping, Playwright, curl, Node.js, TypeScript, MongoDB, AI debugging, Woolworths, Woolworthless, MeanMan, product data