Block All Bot’s

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author Jeff Starr

    (@specialk)

    As explained in the first paragraph of the plugin homepage, Blackhole traps bots that follow the hidden link and fall into the trap. So the plugin traps all bots except bots that do not follow the link and fall into the trap.

    I hope this makes sense, let me know if I may clarify any other details.

    Thread Starter bartridge

    (@bartridge)

    Thanks, Jeff!
    So if my robots.txt looks like this:
    User-agent *
    Disallow: /?blackhole
    Disallow: /
    And I remove all the whitelisted Bots in the settings.
    All good bots will not crawl and bad bots that follow the hidden link will get blocked?

    Plugin Author Jeff Starr

    (@specialk)

    The second disallow statement actually prevents ALL good bots from crawling your entire site. So better to just do this:

    User-agent *
Disallow: /?blackhole

    This should match what you see in the plugin settings. Not sure where you got Disallow: / from.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Block All Bot’s’ is closed to new replies.