Q: Can you submit a sitemap URL and it scrapes all the pages in the sitemap + follow all the links on each page of the sitemap?

We have about 1500 web pages of support articles we need to "train" it on. Currently using Chatbase, evaluating you guys. Thanks for your guidance.

Jason_BrilliantDirectoriesSep 19, 2023
Founder Team
dhananjoy_

dhananjoy_

May 15, 2024

A: Currently, re:tune supports scraping HTML sitemaps and in addition to HTML sitemap, it can scrape up to 200 URLs at once by pasting them in the dashboard. XML sitemap extraction is planned and will be supported soon!

Share
Helpful?
Log in to join the conversation