Googlebots being blocked

  • Resolved mapsnbags

    (@mapsnbags)


    6 years, 6 months ago

    Hi there,

    I already checked “How should we treat Google’s crawlers” in the plugin (Wordfence > Firewall > Firewall Options > Rate Limiting), but it still blocks them, as it shows in my dashboard. But when I go to Firewall > Block, I can’t find them to unblock.
    By the way, I’m sure this IP is from Google and not a fake one.

    Can someone help me out here?

    thanks a lot!

    Bruna

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)

  • Hi Bruna,

    Could you please confirm that you have “How should we treat Google’s crawlers” option set to “Verified Google crawlers have unlimited access to this site”?

    When a request is blocked because of a rule set in “Rate Limiting” settings, it will be blocked for the amount of time defined in “How long is an IP address blocked when it breaks a rule”. That’s why you might not be able to see these requests in (Firewall > Block) page if the time set in Rate Limiting settings exceeded.

    May I know where exactly in the Dashboard you concluded that Wordfence is blocking Google crawlers? I suggest also checking the Live Traffic feed, filtering the feed by “Blocked” should be helpful, note that the Live Traffic feed will store data up to the limit set in “Amount of Live Traffic data to store” in Live Traffic options.

    Thanks.

    Thread Starter mapsnbags

    (@mapsnbags)

    Hi Wfalaa,

    Yes, I just checked it. This is the selected option in the plugin.

    I see it on the WP Dashboard. There is a box with the IPs and countries Wordfence blocked in the past week, and the 4 first ones are from Google. Besides, I have been receiving emails from Google Search Console reporting an index coverage issue.

    Can that be a glitch?

    Thanks

    Hi @mapsnbags

    Please share a screenshot showing “Wordfence activity in the past week” widget area to “alaa [at] wordfence [dot] com”, also I’m wondering what you get when you use “Fetch as Google” option in Google search console?

    Also check the Live Traffic entries for a recent request from one of these IPs that is getting blocked, if you found one please share a screenshot from there as well. (Hint: you can filter the Live Traffic feed by “Blocked” or “Blocked by Firewall”)

    Thanks.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Googlebots being blocked’ is closed to new replies.