Q: Can this scrape fb posts, ads, comments with matching selected keywords provided and scrape from multipage comments, or posts with load more ?
I assume you use session token to login and scrape but what if session expires in 10 min or so. Linkedin sessions expires preety fast. I use browser AI, it does the above work but if comments section has many load more comments then sessions expires and fails the job. Can this provide solutions to scrape comments or redits posts with up to 1000 interactions.
Zekeriya_U-xer
May 15, 2024A: No, It is not a like you can do smart scraping based on the given keywords. You need to define each step with 100% precision. And also, since it works and interacts only with the visible part of the screen, same as human does, I find web based scaping tools fit your case much better with browser AI or like Rtilla, Taskmagic or also Robomotion. Or even open source automation tools like Selenium, Playwright and Cypress.
Altough we are not planning to be a web scraping tool, we might consider "smart web scraping" as a great feature to impelement using our AI capabilities and user-friendly approach.
I am not an expert on browser AI, but I assume that you give the session ID manually so that the web page doesn't ask for login.
Here is little more technical but you may want to read if interested.
Session IDs or tokens are usually designed to expire after a certain time for security reasons. Let's say that 10 min. There is usually a mechanism called something like "refresh token". Which means that when you are on the website and actively doing something, token is automatically refreshed even after 10 minutes. This is why you are not kicked from the website even if you are on the website for much longer periods.
So you need to create a logic to refresh the token when using browser AI :)
But in U-xer, we user real browser. So as long as you are active on the website, it will automatically refresh the token and you will not be kicked out. And do good thing is, you don't need to do anything for that to happen :)
Zekeriya_U-xerPLUS
Verified purchaser
Wow, that's an amazing use case Mango!
And we can do it very easily. You don't need additional agents! 1 agent is more than enough. Agents can be switched between PCs.
Also, you can see what happens on your dad's PC just by using the "take a screenshot" function, or check the results from the reporting tab.
We also have AnyDesk or Team Viewer type of remote controlling capabilities on our roadmap already!! No clear date but we can do that depending on the requests coming from users.
If it's not a private use case, could you please share the details with me via email? I'm very curious. zekeriya.demir@u-xer.com
Also, want to vote for the features you want the most?
https://link.u-xer.com/communityAppSumo
mango-manPLUSThank you for your detailed response.
So basically at the moment, load more comments, next page button can't be put into the flows right? Eg If i have copy and paste orders from multipage.