Allow limited crawling even if crawler is disabled

Hello.

I understand that the crawler is disabled on most LiteSpeed shared hosting because it can overload the server.

The thing is that other cache plugins (such as WP Super Cache and WP-Optimize) do allow crawling – so I assume crawling can be made manageable.

I also assume the LiteSpeed crawler can make the crawling on a LiteSpeed server more smartly than other plugins. It might even reduce the overall load for hosting providers, assuming that some crawling done by other plugins will instead be done more smartly by the LiteSpeed plugin.

My question is if it can be considered to allow limited crawling even if the crawler isn’t enabled on the server side. For example, only twice or once a day.

I am not an expert, so maybe I am missing something essential.

• This topic was modified 10 months ago by asafm7.