Some Pages Are not caching

Hi,

I do see cache hit on that page

you may need to refresh it again in order to generate cache and hit it

Best regards,

1. If you look at cache control shows no cache what that is.
2. Also some of user agent(except googlebot bingbot) are crawling pages a lot so how i can make sure that they are getting cached paged version i want to reduce server load.

Hi,

1) you mean the “cache-control: no-cache,must-revalidate,max-age=0” ? that is meant to be that way

2) LSCWP will also serve cached page for crawler whenever possible

Best regards,

1. That is what i meant. What this says then

2. So how would i know crawler are getting cached page.

3. Is there any option to give some crawler only cached pages to them.

4. On our site we have 800+ pages so how would i know all of them are cached.

• This reply was modified 4 years, 2 months ago by RC Verma.

Hi,

1) that is browser cache , by that means , if it shows cache , it will instruct browser to cache the dynamic page for certain time , by that saying , repeated visitor will see cached page on their browser, won’t get latest update and new content , and believe me , unless your site doesn’t update , otherwise you will not want it

2) yes and no , you will need to have server level access to view the server log , server log will show more detailed information but if you are using shared hosting , then you probably can’t get to that.

3) yes and no , you can use robot or sitemap file to tell crawler which pages to crawl , and make these page cached by LSCWP’s crawler

4) if you are using LSCWP crawler, the status report will say something like how many pages have been crawled and cached.

Best regards,

2) I have server level access to see server log there its shows lots of caches are miss. My Sited Hosted on Closte server.
Look at Below
Date IP URL Browser
21:30 PM 11 Jan 109.69.108.22 GET /members/harrytims37922/activity Chrome
21:30 PM 11 Jan 109.69.108.22 POST / Chrome
21:29 PM 11 Jan 66.249.68.28 GET /reviews/redmi-note-4-india-miui8-global-beta-rom-unboxing/ Googlebot
21:29 PM 11 Jan 106.52.4.195 HEAD /search/www.zlhslf.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.iksd-s.cn Mobile Safari UI/WKWebView
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.xfzhz.cn UC Browser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.butylacrylate.cn Mobile Safari UI/WKWebView
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.cncman.cn UC Browser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.yidianxueche.cn MiuiBrowser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.zhuyuezhai.cn MiuiBrowser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.tzyzp.cn Mobile Safari UI/WKWebView
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.588jm.cn UC Browser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.biaodao-garments.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.nemvc.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.yunliinternational.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.bytuina.cn Chrome Mobile WebView
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.mbcnz11.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.szyhby.cn UC Browser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.4006690808.cn UC Browser
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.lfysjy.cn QQ Browser Mobile
21:28 PM 11 Jan 106.52.4.195 HEAD /search/www.sw-jewelry.cn QQ Browser Mobile
21:27 PM 11 Jan 49.36.35.247 GET /top-list/best-cervical-pillow-in-india Chrome Mobile
21:27 PM 11 Jan 49.36.35.247 GET /top-list/best-cervical-pillow-in-india/ Chrome Mobile
21:26 PM 11 Jan 66.249.68.28 GET /file/thumbs_dir/Capture-min-1-1vypguaumpek81q3ikx1cvjzorjdzfwwkoqermtpt17o.jpg Googlebot-Image
21:25 PM 11 Jan 13.79.1.62 GET /top-list/best-otg-oven-in-india/ Other
21:25 PM 11 Jan 66.249.68.28 GET /phones/lenovo-k8-plus-india-review-pros-cons/ Googlebot
21:24 PM 11 Jan 54.197.6.23 GET /top-list/best-pillow-for-sleeping-india/ Web-Crawler
21:24 PM 11 Jan 54.197.6.23 GET /top-list/best-pillow-for-sleeping-india Web-Crawler
21:24 PM 11 Jan 49.36.35.247 GET /top-list/best-pillow-for-sleeping-india/ Chrome Mobile
21:24 PM 11 Jan 66.249.68.26 GET /phones/oppo-a83-pros-and-cons-review/ Googlebot
21:22 PM 11 Jan 66.249.82.192 GET /wp-content/themes/rehub/images/default/noimage_406_220.png GmailImageProxy
21:22 PM 11 Jan 23.254.47.154 POST / Edge
21:22 PM 11 Jan 192.0.118.50 GET /file/2018/04/oppo-f7-topbestof-feature.png Other
21:18 PM 11 Jan 165.231.101.21 POST /register/ Puffin
21:17 PM 11 Jan 66.249.68.28 GET /phones/realme-x-pros-and-cons/ Googlebot
21:15 PM 11 Jan 81.19.220.205 POST /register/ Chrome
21:15 PM 11 Jan 66.249.68.26 GET /phones/nokia-7-plus-pros-and-cons/ Googlebot
21:15 PM 11 Jan 157.40.36.129 GET /wp-content/uploads/2017/09/Capture-compressor-1.jpg Chrome Mobile
21:15 PM 11 Jan 157.40.36.129 GET /author/yrcv5500/ Chrome Mobile
21:14 PM 11 Jan 66.249.68.26 GET /phones/lg-g7-plus-thinq-pros-and-cons/ Googlebot
21:10 PM 11 Jan 45.13.228.41 POST / Yandex Browser
21:09 PM 11 Jan 103.136.136.54 GET /beauty/best-shapewear-for-tummy-waist-thighs/ Chrome Mobile
21:08 PM 11 Jan 194.146.13.215 GET /members/robertaffc3743/activity Vivaldi
21:08 PM 11 Jan 194.146.13.215 POST / Vivaldi
21:04 PM 11 Jan 209.17.96.74 GET / Nimbostratus-Bot
21:04 PM 11 Jan 77.124.27.175 POST /register/ Chrome
21:02 PM 11 Jan 23.254.47.154 GET /members/dellllanes8142/activity Edge
21:02 PM 11 Jan 23.254.47.154 POST / Edge
21:01 PM 11 Jan 77.75.78.161 GET /music-player/ SeznamBot
20:57 PM 11 Jan 66.249.68.26 GET /top-list/best-microwave-ovens-under-15000/ Googlebot
20:54 PM 11 Jan 165.231.101.137 GET /members/pamcastles8063/activity Chrome

Hi,

no …

the log you posted is access log

to check this , you will need to see error_log , which I don’t think shared hosting can get to that

Best regards,

actually , if you can modify your own vhost’s apache conf

set logformat as follow

cache: %{X-LiteSpeed-Cache}o ---- %h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"

it will output log like

cache: miss ---- 123.123.123.123 - - [19/Jan/2021:22:40:19 -0500] "GET /page HTTP/1.1" 200 10153 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.141 Safari/537.36 Edg/87.0.664.75"

where to indicate the cache hit or cache miss on access log.