Q: Website auditor collects too many pages based on dymamic pages, especially on eshops.
So, will you add support for Regular Expressions in filtering which pages we can collect?
SEO_PowerSuite_Support
May 15, 2024A: Hi,
unfortunately, regular expressions are not available for filtering pages.
But you can use another method to indicate what pages to skip: add specific pages/categories to robots.txt file and disallow them for SEO-PowerSuite-bot. Website Auditor will follow the rules and will ignore those pages.
Dear Sumo-ling,
You can already ignore chosen dynamic URL parameters upon building up your project within Website Auditor, you can also tell the software to not collect pages with specific text/symbols in the URL.
Please take a look at the available Crawler Settings in this guide:
https://www.link-assistant.com/help/website-auditor/crawler-settings.html
- Elena
Verified purchaser
So, will you add support for Regular Expressions in filtering which pages we can collect? Yes or No? Sorry, I am confused