EvenEven
EvenPLUS
May 22, 2023

Q: Hi!

Can we crawl several webpages ? Will it be the last updates version of the pages ? I am thinking that to potentially crawl real estate websites to find new properties that match my search by giving a url search like those ones below.
Besides can I crawl google sheets as well ? The objectives would be to log new properties only. Thanks!
- https://www.idealista.com/en/venta-viviendas/chiclana-de-la-frontera-cadiz/con-precio-hasta_180000,publicado_ultima-semana/mapa-google
https://www.fotocasa.es/es/comprar/viviendas/chiclana-de-la-frontera/todas-las-zonas/l?combinedLocationIds=724%2C1%2C11%2C282%2C507%2C11015%2C0%2C1425%2C0%3B724%2C1%2C11%2C282%2C507%2C11015%2C0%2C1427%2C0&maxPrice=175000
- https://www.kyero.com/en/chiclana-de-la-frontera-property-for-sale-0l6290?f%5B%5D=near_beach&g%5B%5D=4&g%5B%5D=1&g%5B%5D=3&g%5B%5D=2&max_price=175000"

Founder Team
Yasser_Chatbase

Yasser_Chatbase

May 15, 2024

A: Yes it can crawl several web pages and it uses the latest version. It only crawls html pages though so it might not work with google sheets.

Share
Helpful?
Log in to join the conversation

What is this i didn't understand can you elaborate?

Answer from Chatbase website:

Yes, you can crawl several webpages by adding multiple links to your chatbot. Chatbase will extract the content from the links you provide and use it to train your chatbot. However, Chatbase will only extract the content that is currently available on the webpage at the time of extraction. If the webpage is updated after the extraction, Chatbase will not automatically update the content in your chatbot. As for crawling real estate websites to find new properties that match your search, this is possible as long as the website allows web scraping. However, please note that web scraping may be against the website's terms of service, so it's important to check before proceeding.

No, currently you cannot crawl Google Sheets directly. However, you can copy and paste the content from your Google Sheets into a text document and upload it to Chatbase. Alternatively, you can export your Google Sheets as a CSV file and upload it to Chatbase.

Hi Yasser,

Apparently, everyone wants the ability to crawl data from Google Sheets, including myself. Is support for Google Sheets on the roadmap? That was primarily my reason for purchasing Chatbase in the first place. Otherwise, I'll probably refund my purchase.

J

Founder

Verified purchaser

Yes, the support for adding Google sheets and Google drive as data sources is planned and is indeed on our roadmap.