yydevelopment1Q: I have few questions
1) Does the plugin know to recpect pages on yoast seo set as not index and not indexing them again?
2) I have times were on search console some pages who were indexed before are not index now, does the plugin detect that change index them automaticity?
w3guy
Apr 20, 2025A: 1. Not at this time but you can however mark certain pages as excluded so they don't get sent for indexing to search engines.
2. Yes.
Thanks, but the main idea was to have something doing things automatically. So having it collides with yoast be a pain in the ass so i guess i will pass
That's a huge one for me also! From what I recall, it's a bit tricky to tap into Yoast hooks, because A) they don't provide many hooks B) they do a lot of post-processing, after the page rendering happens... I wonder if there's some way this plugin can perhaps crawl the page & check robots.txt before submitting the page to search engines.
We do have plans to integrate with Yoast so all excluded pages in Yoast are automatically excluded for indexing in CrawlWP. Hopefully we are able to get it done and it ships in the next update.