Q: Hi!
Can we crawl several webpages ? Will it be the last updates version of the pages ? I am thinking that to potentially crawl real estate websites to find new properties that match my search by giving a url search like those ones below.
Besides can I crawl google sheets as well ? The objectives would be to log new properties only. Thanks!
- https://www.idealista.com/en/venta-viviendas/chiclana-de-la-frontera-cadiz/con-precio-hasta_180000,publicado_ultima-semana/mapa-google
https://www.fotocasa.es/es/comprar/viviendas/chiclana-de-la-frontera/todas-las-zonas/l?combinedLocationIds=724%2C1%2C11%2C282%2C507%2C11015%2C0%2C1425%2C0%3B724%2C1%2C11%2C282%2C507%2C11015%2C0%2C1427%2C0&maxPrice=175000
- https://www.kyero.com/en/chiclana-de-la-frontera-property-for-sale-0l6290?f%5B%5D=near_beach&g%5B%5D=4&g%5B%5D=1&g%5B%5D=3&g%5B%5D=2&max_price=175000"
Yasser_Chatbase
May 15, 2024A: Yes it can crawl several web pages and it uses the latest version. It only crawls html pages though so it might not work with google sheets.
What is this i didn't understand can you elaborate?
Answer from Chatbase website:
Yes, you can crawl several webpages by adding multiple links to your chatbot. Chatbase will extract the content from the links you provide and use it to train your chatbot. However, Chatbase will only extract the content that is currently available on the webpage at the time of extraction. If the webpage is updated after the extraction, Chatbase will not automatically update the content in your chatbot. As for crawling real estate websites to find new properties that match your search, this is possible as long as the website allows web scraping. However, please note that web scraping may be against the website's terms of service, so it's important to check before proceeding.
No, currently you cannot crawl Google Sheets directly. However, you can copy and paste the content from your Google Sheets into a text document and upload it to Chatbase. Alternatively, you can export your Google Sheets as a CSV file and upload it to Chatbase.
Hi Yasser,
Apparently, everyone wants the ability to crawl data from Google Sheets, including myself. Is support for Google Sheets on the roadmap? That was primarily my reason for purchasing Chatbase in the first place. Otherwise, I'll probably refund my purchase.
J
Verified purchaser
Yes, the support for adding Google sheets and Google drive as data sources is planned and is indeed on our roadmap.