Q: Hi, I would like to scrape the classified ads on pages of the French website leboncoin.
fr.
I downloaded the free RTILA app, but it is stuck at the very beginning : leboncoin detects something and thus puts forward a visual captcha (puzzle to be completed), and the rightly visual completion by myself yields an error message stating the puzzle piece is not at its right place. I can try on and on without it working.
How to get RTILA to parse leboncoin without being detected as a bot and thus blocked before even reaching the homepage ?
On another hand, I tried with firefox add-on webscraper (free version). The scraping (and the browser) is almost immediately blocked, for leboncoin detects something wrong in the browser behaviour, even when setting the interval time at the maximum, that is 30000 ms.
Since scraping leboncoin is the use for which I would buy a code, this is a deal-breaker for me if not possible to scrape this site...
RTILA
May 15, 2024A: Dear Xavier
Thank you for raising this issue
We tested and indeed the puzzle solving is not working when you are inside the Panels, but it works when you Run the Automation in full screen/width. So this has to do with our Panel alignment and we are working on it.
That said you could build the Automation inside de panels even if you cannot see the website, by catching the CSS locators using Chrome browser extensions and then finalize the Automation inside RTILA. See here for how to use free Chrome extensions to find the locators: https://youtu.be/PwXhJ3XYkiU
If you reach out to us on our FB Group we can help you kick start this:
https://www.facebook.com/groups/rtila
But we have logged this issue and we believe we can solve it soon
NB: This kind of website have advanced and pro-active Bot detection so it will always be a challenge and you would have to frequently adapt/correct your automations.
Dear xavier.rabilloud
We have updated a new build of our V6 and it is now working with leboncoin.fr
C'est bon ca marche bien maintenant :-)
rabvaxI am impressed by your reactivity and efficiency ! Many thanks for your prompt action on the matter !
Merci à vous tant pour les réponses que pour la résolution ultra-rapide. C’est super appréciable !
xavier.rabilloud
Thank you and Merci
Please join our FaceBook Community so we can learn from each other: https://www.facebook.com/groups/rtila