run crawler after purge caused by a plugin update

  • Resolved persist9

    (@persist9)


    3 years, 9 months ago

    I have 47 posts and pages on my website, and I get very few visitors. I get an update for a plugin about once a week, and this purges my cache. I would like to run the lite-speed cache crawler after each plugin update so that even my rarely viewed pages will load faster.

    My service provider is concerned that “the preload, crawler options increase the server load dramatically, therefore decreasing your website performance for a website receiving few users each day.”

    Can you offer any advice here?

    ** Is there a setting that would automatically run the crawler after the cache was purged?

    Could I set the “interval between runs” to 1 month and just run the crawler manually after each update?

    ** I am considering using thee settings:
    Crawl interval = 1 month
    Threads = number of crawlers operating at the same time = 1
    Delay: between page requests: default 10,0000 = -.01 seconds
    Run duration: 60 seconds:
    Interval between runs: 600 sec = 10 minutes:
    Server load limit stops the crawl when the number of processes running or waiting for CPU exceeds this value = 3

    Would this “increase server load dramatically.”

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support qtwrk

    (@qtwrk)

    Hi,

    sadly no , current crawler can be only be either manually started , or started by cron job

    don’t set it to month , that means it will only run crawler once per month , regardless manual or cron

    you can try set crawler to one day , enable crawler cron.

    it depends on your site , but if it only gets purged on plugin upgrade, then all other days the crawler is just like visiting a static page, thus the load is like minimal.

    Best regards,

    Thread Starter persist9

    (@persist9)

    Can I solve this without using the crawler, by allowing stale cache pages to be shown to users for an extended period after each cache purge?

    I think I saw a variable for the “maximum age of a stale cache page” – but I did not see where to set it in the lite-speed settings.

    Would this cause a problem after I edited a page, with the old stale page being shown to users after I had changed the page?

    Plugin Support qtwrk

    (@qtwrk)

    Hi,

    technically , yes , but in reality , you will hit some set-back

    stale cache won’t live for long, by default is only 10 seconds and this parameters , as far as I know , only editable for server administrator.

    Best regards,

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘run crawler after purge caused by a plugin update’ is closed to new replies.

Tags