Refresh updated pages

  • I have a website with apx. 20000 pages that are partially updated on a daily basis, several hundreds. I have a dynamic sitemap added for those pages, that have the exact date and time of the modifications for each page, Google is reading this file too. I would expect that w3tc reads the sitemap and updates the last modified pages, but it does not. I have set the garbage collection time to 36000 minutes (10 hours) and the cache preload to 50 pages/60sec. This would result in a cycle time of apx. 7 hours.

    I notice that indeed pages are preloaded at a high rate, but despite that updated pages are not refreshed after a couple of days.

    I have noticed that initially many pages had a default date of modification of 01/01/2017 and the update process went in circles. I changed the time of modification at random and that improved the process.

    I tried to clear the cache manually, but that results in an internal server error after a minute. Is it an option to manually delete the cache maps using FTP?

    Is there an advise for better settings that will do the refreshing of the cache better after updating certain pages?

Viewing 2 replies - 1 through 2 (of 2 total)

  • How pages are updated, by default, your WordPress is set to use wp-cron which only does updates when people visit your site. Because of that i can easily see your preloading not finishing for quite some time — in your case u mentioned 2days…i can see that happening.

    You can turn off the default wp-cron method via your wp-config.php file and set a real cron job for wp, which will then be able to trigger your preload much quicker (e.g. if u set your cron job to launch every 1 minute @ 50 pages/min then as you said it would take aprox 7 hours to complete).

    Thread Starter hsteigstra

    (@hsteigstra)

    OK, I understand, but is W3TC not-selective in the sequence of updating? Or in other words, all 20000 pages are refreshed/rebuild before the first is refreshed. I would like a refresh of each page that has been altered since the last build of the cache.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Refresh updated pages’ is closed to new replies.

Tags