Custom software development for businessPay for results
Python product catalogue export with pagination
Project brief
Need a reusable Python scraper for a public product catalogue. The CSV needs product names, SKUs, prices, descriptions, categories and image links. Use Scrapy or BeautifulSoup, handle pagination, and make the code straightforward to run again.
We will agree the permitted website and page range before starting. No login bypass or scraping restricted data. Send an example of a similar extraction tool and your proposed approach.
Deliverables & acceptance
What you'll deliver
- Python source, dependencies, run instructions and a sample CSV.
What the result must meet
- All six requested fields are exported for the agreed page range; missing source values are flagged, not invented.
- A rerun processes pagination without duplicate SKUs; a sample of 20 records matches the source.