NinjaFirewall WP+ Rate-Limiting

Normally it doesn’t, because Google and Bing bots don’t hammer your site with tons of connections at once. So far, I haven’t seen any user complaining about that.

Sorry. I meant: Does the Rate-Limiting setting also applies to Googlebots? Meaning: all the traffic is Rate-Limited including the Googlebots? For instance, WordFence doesn’t Rate-Limits Google bots if that’s what we want; among other things.

WordFence’s Rate-Limiting settings:

Rate Limiting:
How should we treat Google’s crawlers – Verified Google Crawlers will not be rate-limiting etc.
If anyone’s requests exceed
If a crawler’s page views exceed
If a crawler’s pages not found (404s) exceed
If a human’s page views exceed
If a human’s pages not found (404s) exceed
How long is an IP address blocked when it breaks a rule
Allowlisted 404 URLs
These URL patterns will be excluded from the throttling rules used to limit crawlers.

I wished NinjaFirewall also had such settings for fine-tuning rate-limiting rather than rate-limiting everything. Thanks.

Rate-limit applies to everyone, just like Geoip restriction etc.
But, you can whitelist Google’s AS number simply by entrering AS15169 in the IP access control and all Google bot’s IP addresses will be allowed. We prefer to use this approach since NinjaFirewall accepts AS number (both in its whitelist and blacklist), which is way more convenient and faster than checking it’s IP addresses.

NinjaFirewall accepting AS numbers is great news. Thanks. That solves my concern. I tried searching for a list of AS numbers for different search engines, but couldn’t find any. A list would have been handy. Thanks for the prompt replies.

You can download it in CSV format: https://nintechnet.com/share/GeoLite2-ASN-CSV.zip

Hats off for your help. I am marking this thread as solved. I had already left a 5-star review even before opening this thread. Thanks bunch. God bless.