High-output single-site web scraper with a long run-time:
      500,000+ lines
      6-10 columns
      Scraper will probably run for multiple weeks.
      Scraper will need to input various search criteria into lookup bar while scraping.

Ideally looking for someone with Zyte API knowledge as well as skilled in Python.

We want the output of the scraper to get uploaded into an AWS S3 Bucket, so familiarity with AWS integration is needed.

Would like to have this whole project finished within a month.
We have one more project like this too that we would commission out if this job was done well.

Budget: $1,500

Posted On: May 02, 2024 16:21 UTC
Category: Scripting & Automation
Skills:Python, Data Scraping, Data Extraction, Scrapy, Amazon S3, Web Crawling, Automation, Database

Country: United States

click to apply