Q: Hello Grant, This is awesome I really like the fact you've got, what a decade of lead scraping experience?
That goes a long way.
I need something heavy duty like this for mainly scraping Google Maps but I saw your Yahoo demo sheet/example and the data you pull from there looks even better.
Just wondering three things:
1. Is there a way to combine data from both Google Maps and Yahoo? I know it would be easy to do manually or to create a simple bot to verify when there's a duplicate listing and merge data into one, but just seeing if this is some doable. No biggie though.
2. I'm in very specific niches where ultimately I would want to scrape bi-nationally (Canada/US). I know this will take proxies but is there a way to pre-program Lead Scraper with proxies of course and on a dedicated machine that will run 24/7. But can we upload entire list of all major cites?
And run the scraper to go via each major city with the niche keyword?
3. Lastly to do what I'm intending can you recommend good proxies? Later, I mean no need to drop any recommendations here, but would you be ok with recommending the right proxies?
Ok thanks!
Eddie
Grant_LocalScraper
May 15, 2024A: Hi Eddie,
1) The program is not capable of combining data from different sources because the CSV files have different headers and each scraper has a different number of columns. I do have a free program that I provide to customers to combine files but it only works from files from the same source.
2) I like to say that the scraper is a 'consumer grade' program so it's not recommended to try to scrape in entire country with it in one go. It has automation through the list feature but I call it semi automation because it can only run so many scrapes before the program needs to be restarted. It would be possible to scrape as much data but you would have to do it in much smaller segments rather than one giant list.
3) The read me page for the program which you can access after purchasing it has recommendations for proxies and how to you set them up with the program. If you were to scrape yahoo local at scale I would recommend back connect rotating proxies. That would be much faster than scraping google because the Yahoo scraper supports multithreading.
Thanks,
Grant @ Local Scraper
naikmanishPLUS
Verified purchaser
Greetings,
I have purchased on copy and am in the process of buying a couple more.
1. Could you help with the program that would merge/combine files from the same source ?
2. Could you help by recommending some good rotating proxies ?
These details are on the ReadMe page, there is a combine files program free to download and a few proxy providers are mentioned that i have personally used.