Feature request: filter cached pages

Hi @jroselarsen

Here the previously cached pages means those pages are removed?

Is it issue that removed page still shows 404 page not found while page visit?

Or AIOS log 404 events?

If page is removed and there is no link to it and removed from google page index,

It should not be visited and should not show a 404 page and AIOS do not log 404 event.

If you provide more details it will be good.

Well, none since yesterday.
We still get a lot of 404 errors on no longer existing pages from IP’s belonging to Google or Microsoft.
These pages was from broken links we removed a few weeks ago.

There are no parent pages to these.

Guess the same could happen to cached pages.

Will get back if problem continues.

BR Johnny

Hi @jroselarsen,

Ok, What I consider here feature request is if the 404-page request is from google bot ( microsoft bing bot) IP addresses it should be excluded. AIOS will not consider it as 404.

Here the cached pages ( crawled pages) are still the site pages which are removed but once it is removed from goolge , bing indexing it stop rasing 404 not found page but uptill it raise 404 page AIOS will consider as 404 event. It is hard to know as referrer is correct google or bing search site otherwise we may exclude that also.

Thanks for raising these issues, I will create an internal ticket for those.

Regards