W3TC Image Service Speed

Hello @emilianomaina

Thank you for the information.
The notification you are receiving indicates that there was s problem with receiving a response from the API server.
Can you please check the source and see if there are any 404 ajax requests?
Have you checked the Media library and see if the issue persists if you try to convert the images individually?
Thanks!

THe request is:

https://lamiacasaelettrica.com/wp-admin/admin-ajax.php?_fs_blog_admin=true

Response is 524: A timeout occurred

Images are converted individually.

But overall 416 converted out of 9.651 total. It will take forever.

Hello @emilianomaina

Thank you for the information.
The 524 indicates that Cloudflare successfully connected to the origin web server, but the origin did not provide an HTTP response before the default 100-second connection timed out.
This may happen if the server is overloaded due to the number of requests, meaning that the origin server has limited resources
Please check this article and check with your hosting provider.
Thanks!

My hosting Is working perfectly fine for everything differenti than this W3TC.

Is there any log of W3TC plugin I can investigate?

Please consider I am using paid version.

Hello @emilianomaina

Thank you for the feedback.
I am not sure if I explained this correctly. YOu are trying to convert over 9000 images. This means that your server needs to handle this order to send the images to the API server.
This is a lot for a server to handle and this is not related to the Pro version or non-paid version of the plugin.
524 gateway Timeout Error is a Cloudflare-specific HTTP status code that indicates that the connection to the server has been closed due to a timeout. So the problem is related to the host to Cloudflare.
Either your hosting plan is limited (shared hosting) or a free Cloudflare plan that limits the timeout to 100s. As Explained in the article, this may be caused by Large date exports or in your case, a huge amount of images.
I hope this answers your question.
Thanks!

Honstly It Is not clear because I don’t know how the plugin works.

I expect It works in a batch mode converting existing images in small chunks as per any scalabile software.

Hello @emilianomaina

All images converted with the Image Service tool are sent to a third-party server maintained by the W3 Total Cache team which reduces resource consumption and allows for a large number of conversions in environments where resources can be limited such as shared hosting. Images sent to the W3TC server for conversion are only held temporarily and no permanent information is kept on the server regarding the images.

WebP optimizations with the Image Service tool do not replace the original image file and all conversions can be reverted without any loss of data.

As I’ve said before the problem is related to the server and Cloudflare connection.
Can you please share where your website is hosted and which hosting plan you are using?
Thanks!

The behaviour of the plugin with mass image conversion is still missing. I raised this issue.

If the plugin sents ALL the images conversion all together in one requests it is clear that will never work. It wouldn’t be a problem of the hosting service.

I am with Fastcomet with VPS 3 plan.

Hello @emilianomaina

The plugin does not send all images at once. It sends the images in batches.
I’ve tested this on the website that has 5000+ images, Cloudflare, and on a shared server and I was not able to replicate the problem.
I understand that you may think this is a W3TC problem, however once again the 524: A timeout that occurred is related to the connection between your hosting provider and Cloudflare.
Have you tried temporarily switching the nameservers back to the origin?
Thanks!

Dear @vmarko

I understood that it is a server timeout error. The message is quite clear.

The point, once again, is that this happens ONLY when W3TC runs for this batch.

The only workaround provided here is to increase server timeout. This is not a solution.
In the >5.000 images with Cloudflare you tested what was the server timeout?

I asked for logs to better diagnose the issue, no answer provided. Probably the W3TC plugin is not producing logs for this Image Service.

I would be more than happy to contact my hosting provider (Cloudflare) but I need what to ask exactly for.

• This reply was modified 3 years, 2 months ago by emilianomaina.

Hello @emilianomaina

Thank you for yoru feedback.
I understand that this occurs only when W3TC is sending requests for the image conversion, and no there are no W3TC Image service logs.
As I’ve stated, I was not able to replicate the problem on the website with 5000+images and Cloudflare.
All 500 errors should be logged so you should try enabling the wp_debug and check the log after the error occurs.
Thanks!

@vmarko

As per your input, Fastcomet support did the following:

by implementing the following lines to its 'wp-config.php' configuration file:

define( 'WP_DEBUG', true );
define( 'WP_DEBUG_DISPLAY', false );
define( 'WP_DEBUG_LOG', true );

Checking debug.log log file inside the /wp-content/ directory no log entry was present related to W3TC.

What should I do now to troubleshoot the issue of W3TC Image Service not working?

Thanks.

Hello @emilianomaina

Thank you for the feedback.
The only workaround is to manually add images using the Media library. W3 Total Cache Image service is working, but for some reason, your server connection with Cloudflare is blocking the requests.
Let me try to overload the server and see if I can replicate the problem.
Thanks!

or some reason, your server connection with Cloudflare is blocking the requests.

How do you make this conclusion?

I am able to handle Cloudflare through plugins without any problems.
This means the my WP server can communicate with Cloudflare.

And anyway above you explained that my server is NOT communicating with Cloudflare directly but with one of your server in the cloud.

So if there is a communication problem it would be between my WP server and W3TC Image Server on the cloud.

I can make any telnet or curl required to test it but I need info.

On top of this my box is NOT overloaded as you can see here:

[lamiacas@node3652 ~]$ sar -s 16:00:00
Linux 5.7.6-x86_64-linode136 (***)    12/27/2021      _x86_64_        (4 CPU)

04:00:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:10:01 PM     all      8.46      0.03      2.33      0.12      0.41     88.66
04:20:01 PM     all     15.04      0.02      2.95      0.10      0.35     81.53
04:30:01 PM     all     14.59      0.02      3.03      0.52      0.25     81.58
04:40:01 PM     all     12.53      0.04      2.70      0.15      0.36     84.22
04:50:01 PM     all     18.23      0.02      3.65      0.11      0.42     77.57
05:00:01 PM     all     13.91      0.02      2.87      0.09      0.22     82.88
05:10:01 PM     all     15.15      0.03      3.41      0.17      0.53     80.72
05:20:01 PM     all     16.78      0.03      3.49      0.10      0.38     79.21
05:30:02 PM     all     13.43      0.04      2.80      0.09      0.33     83.31
05:40:01 PM     all     10.35      0.02      2.38      0.08      0.42     86.75
05:50:01 PM     all     13.60      0.02      2.96      0.11      0.37     82.94
06:00:02 PM     all     12.46      0.02      2.76      0.07      0.43     84.27
Average:        all     13.71      0.03      2.94      0.14      0.37     82.80

Hello @emilianomaina

I am not saying that your server is not communicating with Cloudflare, I am simply stating that once the W3TC images service requests are sent, Cloudflare is throwing 524 which indicates that the process for the images service is timed out.
Have you tried temporarily switching the nameservers to origin?
Thanks!