Hi @qtwrk
My host does not allow the default crawler to be active (due to resource limitations). Instead, they suggest to only crawl popular products and pages. I have made a crawler that checks the popularity of a given post (there’s a post meta field with a number) and crawl if it is popular. When the crawler has crawled a post, a post meta field (“last_crawled”) is added with a timestamp.
However, when a post is purged, it is not rechecked by the crawler due to the “last_crawled” meta field (my custom crawler only checks once a week at the moment). My idea is to delete the last_crawled meta field when a post is purged in order to check/crawl it on the next run.
Is that somehow possible?
Best Regards,
Peter