Web scraping products from retailer site using Python - Upwork
Provide a self-contained Python script to scrape all products from dischem.co.za using Scrapy and/or Selenium. The starting point could be here - https://www.dischem.co.za/shop-by-department Output all product information into a JSON file that is saved into a "/data" subfolder in the root directory with file format "dischem_[YYYY-MM-DD].json". All output fields are to be formatted, cleaned and normalised for further processing. The scraper must be throttled to avoid being blocked by the site. Required product information must include the items highlighted in the attached images. Provide script in a github repo, with necessary modules in the requirements.txt file Provide full Readme with instructions on run the scraperBudget: $50 Posted On: April 22, 2023 14:28 UTCCategory: Data ExtractionSkills:Python, Data Scraping, Scrapy, Selenium, API Country: South Africa click to apply
Daftar Isi
Provide a self-contained Python script to scrape all products from dischem.co.za using Scrapy and/or Selenium.
The starting point could be here - https://www.dischem.co.za/shop-by-department
Output all product information into a JSON file that is saved into a "/data" subfolder in the root directory with file format "dischem_[YYYY-MM-DD].json".
All output fields are to be formatted, cleaned and normalised for further processing.
The scraper must be throttled to avoid being blocked by the site.
Required product information must include the items highlighted in the attached images.
Provide script in a github repo, with necessary modules in the requirements.txt file
Provide full Readme with instructions on run the scraper
Budget: $50
Posted On: April 22, 2023 14:28 UTC
Category: Data Extraction
Skills:Python, Data Scraping, Scrapy, Selenium, API
Country: South Africa
click to apply