Plugin is blocking bots that we want on the site

  • Resolved joyryde

    (@joyryde)


    6 years, 9 months ago

    Hello –

    This plugin is blocking crawlers that we want crawling our site. How do we stop it from blocking IP’s that we want to access the site?

    I checked your website and the plugin settings and can’t find any way to fix it.

    The page I need help with: [log in to see the link]

Viewing 7 replies - 1 through 7 (of 7 total)
  • Plugin Support amagsumov

    (@amagsumov)

    Hello, @joyryde

    Thank you for your request.

    Please, tell us the name of these crawlers. So we can whitelist IP’s of them.

    Write back anytime.

    Best regards.

    Thread Starter joyryde

    (@joyryde)

    The crawler says that they change IP’s constantly so we won’t be able to handle it unfortunately. Thanks though!

    Plugin Support amagsumov

    (@amagsumov)

    Perhaps they have some range of IP’s which we can whitelist.
    Can you please give us the name of this crawler, as well.

    Thank you.

    Thread Starter joyryde

    (@joyryde)

    It’s seomoz.com

    Plugin Support amagsumov

    (@amagsumov)

    Ah,

    We cant include their crawler in the exception because it doesn’t have a static IP address or range of IP addresses.

    They use thousands of dynamic IP addresses which will change each time we run a crawl.

    Sorry for the inconvenience

    Feel free to contact us.

    Best regards.

    • This reply was modified 6 years, 9 months ago by amagsumov.
    Thread Starter joyryde

    (@joyryde)

    No worries, it’s ok, thank you!

    Plugin Support amagsumov

    (@amagsumov)

    Feel free to contact us anytime.

    Best regards.

Viewing 7 replies - 1 through 7 (of 7 total)
  • The topic ‘Plugin is blocking bots that we want on the site’ is closed to new replies.