How The Shield protects against Scrapers bots

  • Resolved dimal

    (@dimalifragis)


    8 months, 1 week ago

    Hi,

    The last months we are plagued with scraping bots from Honk Kong, Singapore, China and Vietnam. They scrape directly IMAGES only from what i see.

    I have the Shield in one site, and i see no real protection. Maybe i miss something? Must i increase some settings?

    The scrapers IPs are different (cloud probably) so manually blocking doesn’t make any sense.

    Thanks

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Paul

    (@paultgoodchild)

    Shield doesn’t have any direct mitigations for scrapers like you’re describing, but if you notice anything similar about the requests, such as their user-agents, for example, you could create custom security rules for them.

    If you don’t want to go down that route, you could try implementing some rate limiting on the site to slow them down and when they exceed the limits, ultimately they’ll be blocked.

    These are all premium features, however and not available/supported in the free version at this time. We can’t discuss ShieldPRO here on these forum, but if you’d like to consider supporting our work, you can do this here.

    Thread Starter dimal

    (@dimalifragis)

    Hi,

    I’m using the free version, so all those are not available to me.

    There is nothing special to their requests, maybe an old browser user agent. Also they are slow, so even a rate limit wouldn’t be any good.

    thanks for the reply

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘How The Shield protects against Scrapers bots’ is closed to new replies.