Author
My current system was built using Python/Django/AWS and has been running pretty reliably for over a year. The main data source got shut down, so I got someone to make some changes, mostly to pull data from a new source (mostly done). That dev is no longer available, so I need someone to finish up where they left off.
The system pulls data (daily) from the coinmarketcap (CMC) API, saves the data, then has different output pages and CSV files available. I also use the site to see what cryptocurrencies trade-pairs are available on several exchanges (separate scrape/data-pull) . Another part of the site lets me create custom groups of coins using CSV uploads then data pulled from the db. I don’t want this part of the system changed right now. The focus of this project is below:
*Deliverable 1*
I recently had someone switch the data source to CMC, but some of the output pages need small fixes. Some data may be missing from the past couple of months too. Details:
a. Pull missing days of data via CMC API (https://coinmarketcap.com/api/documentation/v1/). DB missing a few weeks data during Jun-Aug. Need to review and fill in gaps
b. Daily/weekly data pages need to show 60 days and 26 weeks, respectively (instead of 45days and 8weeks)
c. Check/change layout so that coins are listed in reverse size order based on the latest/current ranking from CMC (driven by market-cap, so largest market cap coins are first)
d. Check/change update process so that system is pulling data quickly and at the right time (12AM GMT/UTC). I also need a full explanation of how/when the update process works
e. Ensure weekly outputs are showing data for day-end Sunday (UTC), so effectively 23:59:59 UTC on Sunday to 0:30:00 Monday
f. Ensure that the CSV downloads page (separate) is working reliably (note: has been having regular websocket errors)
*Deliverable 2*
The page that shows trade-pairs across several exchanges needs to be rebuilt, pull data from another API source (coingecko), and show info on more exchanges added.
a. Format: See the attached excel file. This was downloaded as CSV from the old version of the page a few months ago. The new/revised page needs similar format, but it will have more/different exchanges and markets/pairs. Specific requirements are listed in the Gdoc (link below).
b. Similar to the old page, I should be able to download a CSV of the table showing on the page, and I don’t need to record the page details in the db. I only need the current/latest info showing on this page and be available for csv download.
c. Data requirements of the new page
https://docs.google.com/document/d/19T2DNw9GvC3DmOHw9dTPK0sMTlWT-qVJiRgQNFcpSXo/edit?usp=sharing
^^This was based on review of the coin-pairs available for each exchange on the Coin Gecko website (front-end, not their API). I’m not sure how their API lists the coins or determines if the coin-pair is part of the spot, perpetual futures or futures markets. Coingecko API documentation: https://www.coingecko.com/en/api/documentation (note: CMC API not an option. Scraping from CMC potentially an option but is less reliable)
*Deliverable 3*
I need to add a login process (simple) for the entire site. I just need something very simple where a single super-admin can log in then a) modify their own un/pw and b) create the username & password for several other accounts.
Budget: $350
Posted On: August 24, 2023 07:38 UTC
Category: Full Stack Development
Skills:Web Application, API Integration, Database Development, SQL, Django, Amazon Web Services, MySQL, API, Python
Country: United States
click to apply
The system pulls data (daily) from the coinmarketcap (CMC) API, saves the data, then has different output pages and CSV files available. I also use the site to see what cryptocurrencies trade-pairs are available on several exchanges (separate scrape/data-pull) . Another part of the site lets me create custom groups of coins using CSV uploads then data pulled from the db. I don’t want this part of the system changed right now. The focus of this project is below:
*Deliverable 1*
I recently had someone switch the data source to CMC, but some of the output pages need small fixes. Some data may be missing from the past couple of months too. Details:
a. Pull missing days of data via CMC API (https://coinmarketcap.com/api/documentation/v1/). DB missing a few weeks data during Jun-Aug. Need to review and fill in gaps
b. Daily/weekly data pages need to show 60 days and 26 weeks, respectively (instead of 45days and 8weeks)
c. Check/change layout so that coins are listed in reverse size order based on the latest/current ranking from CMC (driven by market-cap, so largest market cap coins are first)
d. Check/change update process so that system is pulling data quickly and at the right time (12AM GMT/UTC). I also need a full explanation of how/when the update process works
e. Ensure weekly outputs are showing data for day-end Sunday (UTC), so effectively 23:59:59 UTC on Sunday to 0:30:00 Monday
f. Ensure that the CSV downloads page (separate) is working reliably (note: has been having regular websocket errors)
*Deliverable 2*
The page that shows trade-pairs across several exchanges needs to be rebuilt, pull data from another API source (coingecko), and show info on more exchanges added.
a. Format: See the attached excel file. This was downloaded as CSV from the old version of the page a few months ago. The new/revised page needs similar format, but it will have more/different exchanges and markets/pairs. Specific requirements are listed in the Gdoc (link below).
b. Similar to the old page, I should be able to download a CSV of the table showing on the page, and I don’t need to record the page details in the db. I only need the current/latest info showing on this page and be available for csv download.
c. Data requirements of the new page
https://docs.google.com/document/d/19T2DNw9GvC3DmOHw9dTPK0sMTlWT-qVJiRgQNFcpSXo/edit?usp=sharing
^^This was based on review of the coin-pairs available for each exchange on the Coin Gecko website (front-end, not their API). I’m not sure how their API lists the coins or determines if the coin-pair is part of the spot, perpetual futures or futures markets. Coingecko API documentation: https://www.coingecko.com/en/api/documentation (note: CMC API not an option. Scraping from CMC potentially an option but is less reliable)
*Deliverable 3*
I need to add a login process (simple) for the entire site. I just need something very simple where a single super-admin can log in then a) modify their own un/pw and b) create the username & password for several other accounts.
Budget: $350
Posted On: August 24, 2023 07:38 UTC
Category: Full Stack Development
Skills:Web Application, API Integration, Database Development, SQL, Django, Amazon Web Services, MySQL, API, Python
Country: United States
click to apply
