Looking to build a scraping tool to scrape data from niche dot com

The tool will input from an excel source file. This input is zip code
E.g. 90210

The tool will go to following URL:
https://www.niche.com/places-to-live/z/XXXXX/

where XXXXX is the 5 digit zip code.
In example above, URL will be https://www.niche.com/places-to-live/z/90210/

Get the following information from the URL:
- city
- state
- overall Niche Grade
- population
- income_household_median
- home_value
- rent_median
- Rent%
- Public Schools
- Nightlife
- Diversity
- Weather
- Health and Fitness
- Commute
- Housing
- Good for Families
- Jobs
- Cost of Living
- Outdoor Activities


Put these values that in the column next to the zip code in the source file.
Example file is attached. The first two grey columns are input and the yellow columns are data to be scraped from the Niche URL (second column). I have populated first three rows as sample data


Selection Criteria:
There should be ability to enter Selection Criteria prior to executing the tool:
1. Record range to scrape  (ability to select range of records to scrape)
2. Fields to scrape (ability to select some or all fields to scrape)


Proxy setting:
The tool should have ability to enter proxy in case the website blocks IP.


Deliverable:
Please provide the source code, tool file along with video tutorial on how to use, update it.
Prefer to have this a web based application but open to tool as well.

In your proposal, please provide quote for Web based application and for tool. Also, please provide what application/language will be used and what is the pre-requisite required to run the application

Budget: $20
Posted On: April 26, 2023 04:27 UTC
Category: Data Extraction
Skills:Data Extraction, API Integration, Data Scraping, Scrapy
Country: Canada
click to apply