Q: This scraper is Single Threaded Only !
info in local scrape app
In description is "Super fast multi-threading -No data/scraping limits"
Why?
Grant_LocalScraper
May 15, 2024A: The scraper has multiple scrapers in it, they all work differently. The only one that is single threaded is the Google Scrapers. This is because they have to be single threaded. Google makes you load the site in a browser, it then only loads the data dynamically to visit each listing. There is no way to load the data then use multiple threads to visit each business one by one. There are no separate single listing pages it's just loaded into the browser as part of the results page.
The only way to multithread this is if we have multiple browsers open all doing separate searches. We can't even have multiple browsers doing the one search. While this is possible is it out of the scope of the program and how it saves data. If you want to do this just open another copy of the program and have it do another search.
We have no results limits as stated. The program does not limit the amount you can scrape at all. There are no APIs, no 'credits' you buy. If your search returns less results than expected it's because the site themselves has a search result limit and we can't change that. Google Maps is currently 120, Google Places is around 300, some sites are 1,000, some sites are thousands per search. You need to work within these limits and if you need more data just do more searches. Break down your target area into smaller areas until you get the data that you are after. The smallest I recommend is by zip/postal code in a city, but there are lots of options like districts and neighbourhoods that the sites will also recognize.
The description might be outdated and hasn't been updated to reflect the current capabilities of the scraper. Perhaps, in the past, it supported multi-threading, but due to technical reasons or changes in the software, that functionality has been removed or temporarily disabled.
Google Maps Full and Google Places Full are the only two scrapers in the program that don't support multi-threading. This is because of the way google shows results and that they must be loaded in a single browser. The program includes 11 different scrapers and only 2 don't have multi-threading. So the description isn't really a problem. If you want faster results and it seems you are scraping Google Maps then I recommend you try out the new beta version and use its google quick scraper.