Crawler does not seem to cache pages

  • Resolved kioub

    (@kioub)


    1 year ago

    Hello,

    I have an issue with the crawler. Although it crawls all pages from the sitemap and I can see from the “Summary” and “Map” tabs at the “LiteSpeed Cache Crawler” admin page, that all pages are either green (already cached) or blue (not cached so the crawler should have already cached them), when I visit a page using my browser, I investigate the response headers, where I get “x-litespeed-cache: miss”. I can validate that the page was not cached by viewing its source, where at the bottom I read the two comments from Litespeed “Page optimized by LiteSpeed Cache @…” and “Page cached by LiteSpeed Cache 5.7.0.1 on…” where the datetime is the exact datetime that I requested/visited the page. So the page was not cached before and my visit optimized and cached it.

    Can you please help me with this?

    Looking forward to your reply.

    Best regards,
    Byron

    The page I need help with: [log in to see the link]

Viewing 8 replies - 1 through 8 (of 8 total)
  • Plugin Support qtwrk

    (@qtwrk)

    please provide the report number , you can get it in toolbox -> report -> click “send to LiteSpeed”

    Thread Starter kioub

    (@kioub)

    Hello,

    The report number is : MPGGACTF

    Looking forward to your feedback.

    Best,
    Byron

    Plugin Support qtwrk

    (@qtwrk)

    if you do manual run , once it finishes all the tasks , and immediately open any of crawled page , does it show cache hit ?

    Thread Starter kioub

    (@kioub)

    No, that is exactly the issue, as I described it in my initial message. I have tested this with manual run also and behaves as desscribed.

    Looking forward to your feedback.

    Best,
    Byron

    Plugin Support qtwrk

    (@qtwrk)

    in crawler sitemap setting , “Drop Domain from Sitemap” , set it to OFF, then please try crawl again , see how it goes.

    Thread Starter kioub

    (@kioub)

    Hello,

    That did the trick! Thank you. Nevertheless I spotted another issue now. Crawled pages remain cached until a new post is published, then ALL of them get invalidated! Why is that? I have visited the Purge tab on the LiteSpeed Cache Settings section, and at “Auto Purge Rules For Publish/Update” I have the following checked:

    Front Page
    Home Page
    Pages
    All pages with Recent Posts Widget (which I have none since I do not use the Resent Posts Widget)
    Author archive
    Post type archive
    Monthly archive
    Term archive (include category, tag, and tax)

    Is there something wrong? why to invalidate all individual pages if a new post is published?

    Looking forward to your feedback.

    Best,
    Byron

    Plugin Support qtwrk

    (@qtwrk)

    please try uncheck all of these checkboxes.

    Thread Starter kioub

    (@kioub)

    OK, fixed it.

    Thank you.

Viewing 8 replies - 1 through 8 (of 8 total)
  • The topic ‘Crawler does not seem to cache pages’ is closed to new replies.

Tags