Our e-commerce site has 25k+ pages (products, categories, blog, etc.), and a tool like WebDiff would be very valuable. I’d like to clarify:
- Can WebDiff handle large-scale sites, or is there a hard limit (e.g., 200 pages)? - If full crawling isn’t possible, can we monitor only a subset (e.g., /products/) while keeping useful coverage? - Does WebDiff recognize changes from plugin/theme/code updates, or only on-page content? - Are there plans to expand limits for enterprise-sized sites in future updates?
Understanding this will help us see if WebDiff can realistically support larger e-commerce operations.
- Currently, there's a limit of 200 pages that can be imported from a sitemap, but we're already considering increasing it. However, I don't think we'll ever be able to handle 25,000 pages per website 😔 WebDiff's analysis takes some time for each page because it simulates user navigation; 25,000 pages would take a very long time to process. - You can...
I purchased a Tier 1 license and attempted to crawl my WooCommerce site. When importing the sitemap.xml, I encountered an error message stating that the maximum number of pages is limited to 199. For an ecommerce site, this is a very very low threshold, and I don’t recall seeing this limit mentioned on the AppSumo product page.
Could you clarify whether this limit can be adjusted, or if it is hard-coded? If it’s the latter, unfortunately the product won’t be suitable for my needs, and I will have to request a refund.
A: Hi! Thanks for your feedback. There's currently a 200-page limit on sitemap imports. This limit was added to avoid performance issues that occurred when importing large numbers of pages. Also, comparing several hundred pages is time-consuming; typically, in e-commerce, what we've seen our customers do is compare "sample" products instead of comparing them all. How many pages/products would you...
Hi, thanks for the quick reply. Our e-commerce site has ~800 SKUs plus blog pages, so around 900 URLs in total. Monitoring only a subset isn’t sufficient. for example, we once had a case where one of the shop managers deleted images from the media library, which resulted in ~30 products displaying without pictures. That type of issue would only be caught if the full site is crawled.
Hi, I understand, thanks so much for your reply! We'll run some tests to see if we can increase the limit to 1000 while maintaining adequate performance. I'll keep you updated!
Q: Functions
Hi,
1) is there a plan to include an automated crawler in future versions? (To avoid searching/finding sitemaps) 2) Can you recommend a good small sitemap plugin for wordpress in the meatime. 3) Can the scan-jobs be saved, for a later re-run?
1) Thanks for the suggestion! We'll definitely keep it in mind for future developments 💪 2) We typically use Yoast, which is very comprehensive 3) Yes, you can create comparisons by defining all the pages to analyze and then run the analysis later, or duplicate the comparison, or re-run the comparison.
If you need any further information, I'm here to...
A: Hi! Thanks for your feedback! Yes, we're planning to make a "cloud" version of WebDiff that works entirely via web. We're also considering making a version that can be installed on Linux systems. These developments aren't on our roadmap yet and are still under evaluation. I'll keep you updated when either of these developments is added to the roadmap! 😁
A: Hi! WebDiff works with any type of website, including websites built with Shopify or WooCommerce. Simply enter the URLs of the pages you want to compare, or you can directly enter the sitemap URL and WebDiff will import all the webpages to compare from there. If the e-commerce has many products you can also compare just a few sample product pages.
Q: Seems to be useful BUT...
Our e-commerce site has 25k+ pages (products, categories, blog, etc.), and a tool like WebDiff would be very valuable. I’d like to clarify:
- Can WebDiff handle large-scale sites, or is there a hard limit (e.g., 200 pages)?
- If full crawling isn’t possible, can we monitor only a subset (e.g., /products/) while keeping useful coverage?
- Does WebDiff recognize changes from plugin/theme/code updates, or only on-page content?
- Are there plans to expand limits for enterprise-sized sites in future updates?
Understanding this will help us see if WebDiff can realistically support larger e-commerce operations.
WebDiff
Sep 12, 2025A: Hi, thanks for your interest in WebDiff 😁
- Currently, there's a limit of 200 pages that can be imported from a sitemap, but we're already considering increasing it. However, I don't think we'll ever be able to handle 25,000 pages per website 😔 WebDiff's analysis takes some time for each page because it simulates user navigation; 25,000 pages would take a very long time to process.
- You can...
Share WebDiff
Q: Maximum number of pages
I purchased a Tier 1 license and attempted to crawl my WooCommerce site. When importing the sitemap.xml, I encountered an error message stating that the maximum number of pages is limited to 199. For an ecommerce site, this is a very very low threshold, and I don’t recall seeing this limit mentioned on the AppSumo product page.
Could you clarify whether this limit can be adjusted, or if it is hard-coded? If it’s the latter, unfortunately the product won’t be suitable for my needs, and I will have to request a refund.
WebDiff
Sep 11, 2025A: Hi! Thanks for your feedback. There's currently a 200-page limit on sitemap imports. This limit was added to avoid performance issues that occurred when importing large numbers of pages. Also, comparing several hundred pages is time-consuming; typically, in e-commerce, what we've seen our customers do is compare "sample" products instead of comparing them all. How many pages/products would you...
Share WebDiff
Verified purchaser
Hi, thanks for the quick reply.
Our e-commerce site has ~800 SKUs plus blog pages, so around 900 URLs in total. Monitoring only a subset isn’t sufficient. for example, we once had a case where one of the shop managers deleted images from the media library, which resulted in ~30 products displaying without pictures. That type of issue would only be caught if the full site is crawled.
Verified purchaser
Hi, I understand, thanks so much for your reply! We'll run some tests to see if we can increase the limit to 1000 while maintaining adequate performance. I'll keep you updated!
Q: Functions
Hi,
1) is there a plan to include an automated crawler in future versions? (To avoid searching/finding sitemaps)
2) Can you recommend a good small sitemap plugin for wordpress in the meatime.
3) Can the scan-jobs be saved, for a later re-run?
Thank you
WebDiff
Aug 18, 2025A: Hi! Thanks for your interest in WebDiff!
1) Thanks for the suggestion! We'll definitely keep it in mind for future developments 💪
2) We typically use Yoast, which is very comprehensive
3) Yes, you can create comparisons by defining all the pages to analyze and then run the analysis later, or duplicate the comparison, or re-run the comparison.
If you need any further information, I'm here to...
Share WebDiff
Q: Browser based?
Will this tool ever be available in browser? Some developers use Linux (like myself) and cannot use this.
WebDiff
Aug 15, 2025A: Hi! Thanks for your feedback! Yes, we're planning to make a "cloud" version of WebDiff that works entirely via web. We're also considering making a version that can be installed on Linux systems. These developments aren't on our roadmap yet and are still under evaluation. I'll keep you updated when either of these developments is added to the roadmap! 😁
Share WebDiff
Q: Can WebDiff compare the webpages in Shopify, WooCommerce and WordPress Blog Site ?
If I input the link for e-Commerce site such as Shopify and WooCommerce, can WebDiff do the comparison ?
Guess WebDiff can compare the difference of the WordPress Blog Site ?
WebDiff
Aug 14, 2025A: Hi! WebDiff works with any type of website, including websites built with Shopify or WooCommerce. Simply enter the URLs of the pages you want to compare, or you can directly enter the sitemap URL and WebDiff will import all the webpages to compare from there. If the e-commerce has many products you can also compare just a few sample product pages.
Share WebDiff