Crawler settings, hard to understand is it working or failing.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support qtwrk

    (@qtwrk)

    crawler will mimic different visitors

    when you enable webp , it will have webp crawler and non-webp crawler

    when you enable mobile cache , it will have mobile crawler and desktop crawler

    when you enable guest mode , it will have guest mode crawler and normal mode crawler

    so in total , you will have 8 crawler

    normal mode + desktop
    normal mode + mobile
    normal mode + desktop + webp
    normal mode + mobile + webp

    plus

    guest mode + desktop
    guest mode + mobile
    guest mode + desktop + webp
    guest mode + mobile + webp

    the important part is status number , in your screenshot , 37 , this means 37 pages were crawled by all of these 8 crawled

    Thread Starter Darius Ju

    (@dariusju)

    A If normal? Why all crawlers are with “guest” mentioned?

    B. So blue is ok? I did manual crawl now all are blue. So it means that all pages now have cached versions?

    Plugin Support qtwrk

    (@qtwrk)

    a) that “guest” refers to as non-login-user

    b) blue is usually okay , yes , blue means the pages have been cached at the time when crawler pass

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Crawler settings, hard to understand is it working or failing.’ is closed to new replies.