willjames

I assumed dealers/authors are user accounts found in WordPress > Users > All Users; is this correct? Yes This is correct

I can confirm that the issue is still there with both Redirection and PublishPress turned off. It is only when Yoast is turned off that this appears.

I am not happy buying a licence for a product that does not work on my site, I might be better buying a licence for a different product that does work?

I have a development site that is availabile…?

Thanks

I can see the https://www.truckpages.co.uk/author/a-and-m-commercials/ in the sitemap. I can confirm that Do not allow search engines to show this author’s archives in search results does not even exist for my installation – there is no Yoast box at the bottom of the page as with other types.

All of the author (dealer) accounts shown in the sitemap have the same issue, it is not just this one, so feel free to try any of them listed.

To summarize:

Problem 1: Sitemap shows /author/ instead of /dealer/ in sitemap

Problem 2: The noindex tax on every dealer (author) page.

Thanks for your help

Many thanks for your response.

The author sitemap is important to us but, because my theme uses a bespoke user role and capability that Yoast does not recognise, I have to use PublishPress Capabilities to add the user to the author sitemap by giving them two Roles (the Theme’s one and ‘contributor’).?

I have tested with this plugin turned off on the dev site and the spurious noindex tag still remains until I deactivate the Yoast plugin.

The reason that the A&M user was not in the sitemap was because the extra ‘contributor’ step had not been carried out (it has now).

I can confirm that we are redirecting /author/ to /dealer/* but not for all users (we have different grades of users)

Looking at the sitemap, user accounts that were added after June 2022 appear as /author/ in the sitemap, whereas those added before appear as dealer. If I edit and save a user, then they become /author/ in the sitemap (I want them to say dealer as this is what is actually the URL) .

Looks like there was some work done on sitemaps just before this: https://developer.yoast.com/changelog/yoast-seo/19.0/

I would simply like /dealer/ in the sitemap for all and no ‘noindex’ tag on these pages as both issues are costing me traffic and customers.

Many thanks for your help

OK, it seems that the slowing down of the deletions is largely down to the Cloudflare APO plugin that creates the KV worker database for them. Not really sure what to do about this as I assume they need to delete the record from their caches too…

However, when I delete without WPSC on as well, the deletions happen one per second.

So wpsc does not need to check all the posts of a different post type on deletion – this would certainly help. Also the homepage would be better refreshed only once the batch is completed rather than for every record?

Thanks

The main issue seems to be when I run an import using WP All Import. I will often have to delete hundreds or thousand or so posts (custom post type, not normal WP posts). Each on takes a minute to delete – so a 1,000 minute job that means that the various caches are cleared every time. Looking at the debug below there is no need for each WP post to be checked when I delete a post in a CPT of ‘Listings’

I not it also tries to delete the author pages – although not for the author of the post (and my pages are rewritten to /dealer/ or /seller/ in any case.

Is there any way of preventing all these checks on posts so it would speed the deletions up a little?

Also should I even bother if I have Cloudflare apo installed?

Any other ideas are welcome.

Thanks

Here is an extract from the debug:

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wp_cache_post_edit: Clearing cache for post 3332950 on delete_post

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 supercache dir: /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/trucks-for-sale/for-auction-2003-daf-lf45-170-beavertail-plant-trucks-for-auction-leeds-26th27th-28th-29th-oct-2022-0800am/140315864_08-jpg-2/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wp_cache_post_id_gc post_id: 3332950 https://www.truckpages.co.uk/trucks-for-sale/for-auction-2003-daf-lf45-170-beavertail-plant-trucks-for-auction-leeds-26th27th-28th-29th-oct-2022-0800am/140315864_08-jpg-2/ clearing cache in /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/trucks-for-sale/for-auction-2003-daf-lf45-170-beavertail-plant-trucks-for-auction-leeds-26th27th-28th-29th-oct-2022-0800am/140315864_08-jpg-2/.

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_get_realpath: directory does not exist - /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/trucks-for-sale/for-auction-2003-daf-lf45-170-beavertail-plant-trucks-for-auction-leeds-26th27th-28th-29th-oct-2022-0800am/140315864_08-jpg-2/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 prune_super_cache: exiting as file/directory does not exist : /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/trucks-for-sale/for-auction-2003-daf-lf45-170-beavertail-plant-trucks-for-auction-leeds-26th27th-28th-29th-oct-2022-0800am/140315864_08-jpg-2/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wp_cache_post_id_gc clearing cache in /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/page/.

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 Post change: supercache enabled: deleting cache files in /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: deleting /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: .

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: ..

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: trucks

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: trucks-for-sale

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: for-sale

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: dealer

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: iveco-to-restart-production-in-italy-and-spain

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: free-food-drink-from-scania

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: iveco-reveals-new-s-way-racing-trucks

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: calor-buys-first-electric-fuso-ecanter

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: truckeast-wins-scanias-annual-dealer-gong

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: scania-is-first-truck-operation-to-gain-iso-45001

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: volvo-trucks-defers-3-months-finance-fees-on-new-truck-sales

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: volvo-renault-trucks-furloughed-volunteers-making-ppe

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: mercedes-truck-dealer-orwell-s-and-b

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: job-losses-announced-at-renault-trucks

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: daf-updates-emergency-braking-system-across-truck-range

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: volvo-used-trucks-new-warranties-over-1-million-kms

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: new-boss-for-volvo-trucks-uk-ireland

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: reading files: thats-the-way-to-do-it

…This goes on for over 400 posts for every deletion. Sometimes we delete 1500 posts in one import…

Then it carries on here:

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 Post change: deleting page_on_front and page_for_posts pages.

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 Post change: page_on_front 639563

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 Post change: page_for_posts 0

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wp_cache_post_change: checking /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/meta/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: deleting /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk//author/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_get_realpath: directory does not exist - /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk//author/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_files: directory does not exist: /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk//author/

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_get_realpath: directory does not exist - /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk//author//page

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 prune_super_cache: exiting as file/directory does not exist : /var/www/vhosts/truckpages.co.uk/httpdocs/wp-content/cache/supercache/www.truckpages.co.uk//author//page

14:36:39 118106 /wp-admin/admin.php?page=pmxi-admin-import&action=process&id=70&failures=0&_wpnonce=cee0cede89 wpsc_delete_post_archives: deleting cache of author archive: https://www.truckpages.co.uk/author/

Is there any way of bypassing these checks?

Looks like a lot of caches are cleared when deleting posts. I assume this is the homepage but it also seems to check other pages. Sometimes we run an import program that can delete a thousand posts a day so do not need to clear these caches so often or keep checking pages. Could this be my issue?

Thanks for all your help – TTFB in GTMetrix is good worldwide now, so I will have to sit and be patient for UX report to catch up…

View post on imgur.com

Will let you know…

I did the plantpages.co.uk site as a test (mentioned earlier, but I assume you have hundreds of these threads going at any one time!)

Hi
thanks for your thoughts, really useful. I am not seeing the cache control issue in dev tools (when the disable cache is unchecked – it appears with it checked). I can’t see anything in the htaccess file that would cause this issue.

I do get a ‘tcache’ in the ‘cf-apo-via’ instead of just ‘cache’ and it is sometimes missing this message:
cf-edge-cache: cache,platform=wordpress

I was wondering about preloading CF APO as well as the site has many pages but some are only visited rarely… If I could do this do you think it would be worth it or is that not how CF APO works?

Thanks

Thanks. I have implemented without the WP super cache but there appeared to be no difference in the page timings. There seems to be no preload option in Cloudflare APO. I also found this when researching online:
https://brianli.com/cloudflare-apo-for-wordpress-misconceptions/
`Cloudflare APO is not a replacement for page caching on the origin server. Nowadays, the majority of modern WordPress hosts have some kind of page caching configuration in place on the web server (Nginx, Litespeed, etc.). For example, Kinsta uses the FastCGI Nginx module for page caching. Since Cloudflare APO works on a layer above and external to the origin server, it’s still important to maximize origin server performance with local page caching.

For WordPress sites hosted on servers that aren’t configured for page caching, plugins like WP Rocket and W3 Total Cache are often used to replicate the server-level page caching functionality at the application level. If you’re using a plugin like WP Rocket or W3 Total Cache for page caching, make sure you keep it enabled even after enabling Cloudflare APO!

The reason for not disabling local page caching when using Cloudflare APO is simple. When APO is enabled, Cloudflare still has to make requests to your origin server in order to fill the Cloudflare Workers KV database or edge cache with your site’s HTML pages. Since page caching speeds up requests and reduces CPU and RAM load on the origin server, it’s important to keep page caching enabled.’

Not seeing huge gains either way, but maybe I have to leave it alone and check the performance in a week or so…

There are times when I see lighthouse return a 6 second ‘waiting for server to respond’ and others I get almost 100/100 for mobile and desktop…

Why would Cloudflare suggest they can stay on then?

Among the most popular caching and optimizations WordPress plugins are LiteSpeed Cache, W3 Total Cache, WP Rocket, WP Fastest Cache, WP Super Cache, Autoptimize. To successfully activate Advanced Platform Optimization when any of the plugins above already present, follow these steps:

Install and activate the Cloudflare WordPress plugin.
Enable Automatic Platform Optimization in the plugin.
Clear any server cache used via other plugins.
Verify that your origin starts serving the response header "cf-edge-cache: cache,platform=wordpress".

Activate plugins integration with Cloudflare
WP Rocket integrates with Cloudflare API.
WP Fastest Cache integrates with Cloudflare API.
W3 Total Cache integrates with Cloudflare API. Make sure to enable the Page Caching option.
3. Integration with Cloudflare cache purging
The rest of the plugins in the list, when producing content optimizations, require triggering of Cloudflare cache purging manually or via API:

LiteSpeed Cache
WP Super Cache
Autoptimize

Hapy to turn off WPSupercache, but wonder why that is not the recommendation from CF as WPSC doesn’t do anything else?

Thanks for the tip. I have set up the Cloudflare APO on my plantpages.co.uk site as a test (similar speed profile but less busy/important). I will monitor over the next 2 weeks for improvements, if so I will move ahead. I have kept WPSupercache set up but s=removed Bunny CDN – does that sound about right in terms of configuration?

Thanks

The themes for Plant and Farm are the same – but the cause of this was that I have excluded more files from Truck & Plant using Asset Clean Up than Farm. I have removed this from farm now as well. I will bring both themes up to date. Still confused…?

No luck – still showing as render blocking – do I need to clear the AO cache to test these types of changes?

I put that in the functions file, cleared WPSuper cache then tested again and it is still being called out as render blocking… Should I try the ‘Async JavaScript’ plugin?