LiteSpeed crawler CronJob (not working)

If the crawler is disabled at your host you can’t warmup the cache with built-in crawler, but there are 3rd crawlers that are especially made for the LScache Plugin and these crawlers can warmup the cache even when the built-in crawler is disabled.

you need to enable the crawler , then use the wp-cron.php to trigger it , I am not sure where did you get that admin-ajax.php?action=litespeed-crawler-cron URL

If the crawler is disabled at your host you can’t warmup the cache with built-in crawler, but there are 3rd crawlers that are especially made for the LScache Plugin and these crawlers can warmup the cache even when the built-in crawler is disabled.

Thanks for your advice. Tested Cache Warmer and Warm Cache but it did not help

The plugins run wel. I can see a log. The pages are visited but ..

When I visit a page which just has been warmed up and should load in 0,3 sec I get a page with is not pre-cached (in the incognito mode with cache disabled).

you need to enable the crawler , then use the?wp-cron.php?to trigger it , I am not sure where did you get that admin-ajax.php?action=litespeed-crawler-cron URL

According to https://www.perplexity.ai/

The cron job command should be similar to?wget -q -O /dev/null https://example.com/wp-content/plugins/litespeed-cache/crawler.php

According to ChatGPT 4.0

Here, you can set up a cron job by inputting a ‘crontab’ command. The cron job command to execute might be site-specific, LiteSpeed’s crawler uses this URL format: https://<your_site>/wp-admin/admin-ajax.php?action=litespeed-crawler-cron

So the command should be something like:
*/20 * * * * wget -q -O - "https://<your_site>/wp-admin/admin-ajax.php?action=litespeed-crawler-cron" > /dev/null 2>&1

Can you give an example of a cron job for wp-cron.php?

These crawlers are universal crawlers and don’t work with LScache, but there is one that is especially made for LScache.

btw. Never use Incognito mode to check cache status. This mode is not safe enough to check cache status. Use a another browser to check it.

Can you give an example of a cron job for wp-cron.php?

If the built-crawler is disabled at your host you can’t bypass this block with a system cron, so it doesn’t matter which command you use to make the crawler work.

If the built-crawler is disabled at your host you can’t bypass this block with a system cron, so it doesn’t matter which command you use to make the crawler work.

Thanks! I do not see this warning (that it is disabled) but I see this at my end

Does it mean that the crawler should work?

The hosting helpdesk does not provide a clear answer about whenever it is disabled or not. Asked 3 times! Very vague answers. I feel that they do not want to answer this question. I still do not know if this function disabled on the server or not (shared hosting).

• This reply was modified 6 months, 4 weeks ago by gopa4.

Of course there is a warning message at the top of this page:

Crawler feature is not enabled

No, I see?this at my end

There is no warning. I can click on Run Manually but nothing happens (status below stays the same)

Press the button twice with a short delay after first press.

Still the same >

Status ………… nothing

Did you press the “Show Crawler Status” button?

Yes https://ibb.co/VYpDkw6

Did you enable the crawler in General Settings?

Yes, it was enabled. Please check this https://ibb.co/nRGT951