adminHi there, I would like to create a crawler for the search engines Google, Edge, Yandex, Duck Duck Go and Baidu. The crawler should work as an API, in which I will pass in the request the terms to be searched and it would return me the results grouped by each and every search engine aforementioned, you can see SERPAPI as a reference that’s precisely what I need except that the sources I need are only those here mentioned (https://serpapi.com/)
I have very high concern about the maintenance of the solution to be developed as Google and the others may at some point break the service but updating their platform, so you need to think about counter counter measures
I have very high concern about the maintenance of the solution to be developed as Google and the others may at some point break the service but updating their platform, so you need to think about counter counter measures
Posted On: August 15, 2024 12:08 UTC
Category: Scripting & Automation
Skills:Node.js, Scrapy, StormCrawler, Beautiful Soup, Selenium, Automation Anywhere, Kofax RPA, Web Crawling, DeepCrawl
Country: Brazil
click to apply
Powered by WPeMatico
