Issue with the last update

I don’t know understand , should it not to trigger the country check ?

I mean it accesses page like a real visitor , and your page will trigger country check ?

Yes you are right that’s should happen, but beacuse it happen from the same IP it should be just once.

Any way, I’m maybe wrong, because at the first moment I think that the Crawler do it, because was at the same time, but yesterday I revert to the old version and trigger the Crawler and nothing…, but during the night (when the crawler was off) it happen again.

So with your plugin update I update few more, now return backup from this moment and I think the problem not exist, so now I will start update them one by one and will see. I begun with your plugin, but the full results probably will take few days, because I don’t know what exactly doing it. I will post back here if I found something.

But I found something else during these days tests. I use LiteSpeed server as well so that’s why I have Crawler and what is very strange for me (you probably have explanation) the Crawler “WORK” even if is no trigerred by me. It do requests on every few seconds and they looks like that:

[09/Feb/2024:19:58:20 +0000] “POST /wp-admin/admin-ajax.php?action=async_litespeed&nonce=f42d5fa004&litespeed_type=crawler HTTP/1.1” 200 21 “-” “WordPress/6.4.3;

If I disable the Crawler at General settings of the Crawler (ON/OFF) only then stops, but other wise it continue doing this requests at any time. I don’t know from when that’s happen because I not check these requests often (is not reletad with the plugin version)

I hope you can help me with this, until I found the another problem.

Thanks!

If I disable the Crawler at General settings of the Crawler (ON/OFF) only then stops

yes, this action will enable the cron job for crawler

I’m sorry, but do you read my post, in case you are not I will post it again:
‘I have Crawler and what is very strange for me (you probably have explanation) the Crawler “WORK” even if is no trigerred by me. It do requests on every few seconds and they looks like that:

[09/Feb/2024:19:58:20 +0000] “POST /wp-admin/admin-ajax.php?action=async_litespeed&nonce=f42d5fa004&litespeed_type=crawler HTTP/1.1” 200 21 “-” “WordPress/6.4.3;’

Look this screenshot https://ibb.co/sssNYX8 I’m talking about when the Crawler is finished or just on run at the moment.

even when the crawler NOT running, I get requests in the log file like this one above…

That what is strange to me, WHY when NOT running it actually ruinning.

Thanks!

BTW: I found where is the problem with the Coutry Check and is not from LiteSpeed so sorry about my first post!

• This reply was modified 9 months, 2 weeks ago by antekapa.

once you enable the crawler, the cron will trigger this request to initiate the crawler , but once it is triggered , there could something else determine if crawler should run or wait , in particular the crawler interval and server load limit

Sorry, but still not get what I mean….

I don’t know how to explain it better, but I will try for a last time:

Just imagine the Crawler set by me is finished the process in full and everything is fine and Cached properly, few hours later you checking the SERVER log and you still see a NEW requests in every few seconds by the crawler, at this moment the crawler not run if you check in the plugin Crawler page.

And this requests never stops, also these requests not trigger CACHE the page just some requests going through the site.

I guess it is some kind of CRON job and probably have a reason for it, but I’m wondering why?

Thanks!

yes , when you enable crawler , it will create a task into wp cron list , once wp cron is triggered, it will send a request to that URL you mentioned to trigger the crawler

the crawler will check its setting, interval , server load …etc and decide to run or not

Whatever, I can’t explain you in another way.

If you want answer if don’t just don’t:

The Crawler run at any time even when not actually run….

If you decide just close the ticket….

Thanks!

I think I understood the question , just not sure if I explained it clear

when you have that option enabled , this is what will happen:

every time wp cron is trigger -> it will trigger the crawler cron -> this cron will do a request to that URI to trigger the crawler -> once crawler is triggered, it will check setting and decide to run or not

you may see this request come up frequently , depends on the frequency how your wp cron is triggered

Ok, Thanks!