URL blacklist

  • Resolved itexilion

    (@itexilion)


    2 years, 11 months ago

    Hello, i have a problem with litespeed crawler adding some urls to blacklist. I have checked the pages, they are responding 200 OK
    Here is the list of affected urls:

    <a href="https://smaart.sk/blog/"></a>
<a href="https://smaart.sk/en/payroll-calculator-in-slovakia/"></a>
<a href="https://smaart.sk/mzdova-kalkulacka/"></a>
<a href="https://smaart.sk/kalkulacka-limitov-pre-obnovu-pobytu/"></a>
<a href="https://smaart.sk/kalkulacka-odvodov-szco/"></a>
<a href="https://smaart.sk/en/calculator-of-the-levies-of-self-employed/"></a>
<a href="https://smaart.sk/en/residence-renewal-limits-calculator/"></a>
<a href="https://smaart.sk/ru/kalkulator-otchislenij/"></a>
<a href="https://smaart.sk/ru/kalkulator-prodlenije/"></a>
<a href="https://smaart.sk/ru/kalkulator-zarplaty/"></a>

    Could you please help me with actions needed to fix it?

    • This topic was modified 2 years, 11 months ago by Yui.
    • This topic was modified 2 years, 11 months ago by Yui. Reason: formatting

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support qtwrk

    (@qtwrk)

    Hi,

    these pages are giving x-litespeed-cache-control: no-cache header , so it will be blacklisted

    Best regards,

    Thread Starter itexilion

    (@itexilion)

    Can you help me to fix it? In log i found follwing for affected page:

    12/14/21 11:04:05.374 [185.122.54.107:61970 1 OQJ] ?? [Tag] Add --- HTTP.200
12/14/21 11:04:05.377 [185.122.54.107:61970 1 OQJ] [Ctrl] X Cache_control init on
12/14/21 11:04:05.425 [185.122.54.107:61970 1 OQJ] [Ctrl] X Cache_control -> no Cache ( nocache CFF Form )
12/14/21 11:04:05.428 [185.122.54.107:61970 1 OQJ] [Ctrl] X Cache_control -> no Cache ( nocache CFF Form )
12/14/21 11:04:05.489 [185.122.54.107:61970 1 OQJ] [Ctrl] X Cache_control -> no Cache ( nocache CFF Form )
12/14/21 11:04:05.512 [185.122.54.107:61970 1 OQJ] [Vary] No pending comment
12/14/21 11:04:05.527 [185.122.54.107:61970 1 OQJ] [Core] Footer hook called
12/14/21 11:04:05.529 [185.122.54.107:61970 1 OQJ] [Core] Footer check passed
12/14/21 11:04:05.530 [185.122.54.107:61970 1 OQJ] ?? X-LiteSpeed-Cache-Control: public,max-age=604800
12/14/21 11:04:05.530 [185.122.54.107:61970 1 OQJ] ?? X-LiteSpeed-Tag: e02_HTTP.200,e02_post,e02_URL./ru/kalkulator-otchislenij/,e02_Po.644,e02_guest,e02_
12/14/21 11:04:05.531 [185.122.54.107:61970 1 OQJ] [Core] Footer check passed
12/14/21 11:04:05.531 [185.122.54.107:61970 1 OQJ] [Media] finalize
12/14/21 11:04:05.533 [185.122.54.107:61970 1 OQJ] [Optm] start
12/14/21 11:04:05.537 [185.122.54.107:61970 1 OQJ] [Optm] rm css snippet [Google fonts] https://fonts.googleapis.com/css?family=Cormorant+SC%3A300%2Cregular%2C500%2C600%2C700&display=swap&ver=3.1.0
12/14/21 11:04:05.538 [185.122.54.107:61970 1 OQJ] ?? [Tag] Add --- MIN.823b9ca91dc1a1bcd2f081c277d7cd88.css
12/14/21 11:04:07.179 [185.122.54.107:61970 1 OQJ] ?? [Tag] Add --- MIN.ca0eb231556106a3e62bbb62d67bf902.js
12/14/21 11:04:07.187 [185.122.54.107:61970 1 OQJ] End response

    But in CFF plugin Form Cache is activated and litespeed detected OK, any thoughts?

    Thread Starter itexilion

    (@itexilion)

    Ok, i misconfigured CFF plugin, problem is found and solved)

    • This reply was modified 2 years, 11 months ago by itexilion.
Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘URL blacklist’ is closed to new replies.