Not working

I think you misunderstand what this plugin does, and how it works. Nowhere does it claim to block any specific bots (e.g., Amazon bot and Claudebot). In order for any bot to be blocked, it must disobey your site’s robots rules and fall into the hidden trap. Bots that obey your site’s robots rules and/or don’t fall into the trap will not be blocked. This is all explained very clearly in the plugin documentation and Help tab (on the settings page).

It sounds like you may need to find a plugin that specifically blocks Amazon bot and Claudebot in wholesale fashion, regardless of their behavior.

I hope this helps, let me know if I can provide any further information.

In order for any bot to be blocked, it must disobey your site’s robots rules and fall into the hidden trap. Bots that obey your site’s robots rules and/or don’t fall into the trap will not be blocked.

Hi,

Obviously, my robot.txt disallows these bots to operate inside my website. Your plugin, as you state, redirects them to a “black hole” if they do not “obey” my robot.txt.

Sorry if I am mistaking, but if my robot.txt says no to ClaudeBot, your plugin should redirect it to the black hole? If not, either my robot.txt is bad or your plugin is ?

Kind regards.

As explained in the plugin documentation and Help tab (on the plugin settings page), the plugin adds its own rules (just a few lines) to the site’s robots.txt file. Any bots (such as Amazon bot or ClaudeBot) that disobey those rules and/or fall into the trap are blocked. Other bots will not be blocked. You can find the added rules both in your robots.txt file and at the top of the plugin settings page.

I hope this description is more clear, let me know if I can explain further. Also just fyi this same information (about how the plugin works, what it does, etc.) is always available on the plugin home page, installation guide, readme/documentation, Help tab, and elsewhere.

If anything is not clear, or could be made more clear, please let me know, thank you.

• This reply was modified 7 months, 3 weeks ago by Jeff Starr. Reason: Clarity

Clear as crystal, but your plugin does not work.

Your plugin ads a rule, but bots are still scraping.

Of course it works. As evidenced by 30K users and many great reviews.

It just doesn’t do what you want it to do. It doesn’t stop all bots, only those that fall into the hidden trap. Many bots are not looking for hidden traps, but instead are doing other things, like crawling posts, pages, and other content.

It does not do what it is advertised to do. You are adding a link to the footer, we ask the bot not to follow the link. because they behave badly they will follow the link ? The shall be in the black hole.

1. does not work if the bot is already on your site through other links
2. does not work if bot never finds the link

Don’t worry, i tested Wordfence and they do not do a better job then you.

The plugin does exactly what it advertises: It blocks bad bots that disobey your site’s robots rules and fall into the hidden trap. It does not block other bots, as you have noticed. If that were not true, the plugin ratings would be mostly one-star poor reviews. Fortunately that’s not the case and many people find the plugin to be lightweight, fast, and very effective at stopping bad bots.

If you want to use Wordfence or any other plugin, please by all means do so. That’s the beauty of WordPress: there are many ways to go about doing things.