Separate Whitelist for Rate Limiting

  • Dear Wordfence Team

    I’m the developer of a Link Checker and Sitemap Generator plugin for WordPress. Both plugins use an external crawler, operated by me, to do their job.

    Sadly the crawler often triggers the Wordfence rate limit and thus cannot do its job.

    A workaround for my users would be to whitelist my crawler with the “Whitelisted IP addresses that bypass all rules” option. However, this wouldn’t be a good solution from a security point of view.

    It might be better to have a separate whitelist just for rate limiting. Is such a whitelist something you might consider implementing in a future version of Wordfence?

    Thank you in advance.

    Best regards
    Marco

Viewing 2 replies - 1 through 2 (of 2 total)

  • Hi @mbsec,

    I’ve shared your suggestion for whitelisting rate limiting with the development team for them to consider. Thanks for sharing it with us!

    As for whitelisting your crawler, that does seem to be the best solution at this time. The other option would be to have your users increase their rate limits for crawlers enough to allow your crawler to function, but the IP address whitelist solution would be a better choice from a security and performance standpoint.

    Thread Starter Marco Beierer

    (@mbsec)

    Hi @wfchar

    Thank you very much for your effort and your reply. I’m glad that you consider adding a separate whitelist.

    Best regards
    Marco

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Separate Whitelist for Rate Limiting’ is closed to new replies.