Q: Website + keyword
Hi. Is there a way with your tool to automate checking websites (10.000 domains) one time if they have certain keywords (4 different keywords) on their site? The goal is to find some websites. My list is continuously growing and I need a tool to find certain websites. Thank you. Peter
Faik_Robomotion
Apr 22, 2025A: Hi,
Sure, that’s absolutely possible. We do even more for our Fintech clients. They often need to check thousands of their merchant websites for things like DNS records, SSL validity, and the presence of whitelist or blacklist keywords. All of that is doable.
Robomotion is built in Golang, which makes it extremely fast. We can run your automation sequences in parallel, while typical RPA tools process tasks one by one, Robomotion can execute in tens or even hundreds of branches simultaneously, completing your tasks much faster.
Best,
SPMarkPLUSThank you for the asnwer! What else I need apart from your tool to be able to check 10K domains (proxy?)? Is the smallest package can handle this?
Depending on the domains you want to check, you likely won’t need a proxy. Since this is a one-time visit,not 10,000 or 100,000 requests to a single domain,you'll be sending one request to each of 10K sites. We don't use a proxy for this task. But of course, it may vary depending on your sites. The LTD plan doesn’t include proxy credits, but you can bring your own proxy if needed. Tier 1 is enough