The API for the source data will primarily be from sticky.io:
https://developer-prod.sticky.io/#48796c15-8a22-4f7a-8274-64b09fb5dab2
The requirements are to load all of the most important models into our data warehouse (Bigquery).
The challenge will be to overcome api limitations like request limits or constraints when it comes to bulk operations.
We will need the ability to reload all data from scratch if needed.
The job needs to be set up with incremental loads to not overload the api.
We will define a narrow scope of work at the beginning and then assess how well our fit is for a long term collaboration.
Hourly Range: $30.00-$60.00
Posted On: February 10, 2024 13:18 UTC
Category: Scripting & Automation
Skills:Data Extraction, API Integration, Automation, API, Python, Data Engineering
Country: Latvia
click to apply
Powered by WPeMatico
