• Resolved CamZL1

    (@danishhaidri)


    What is the best practice when you are getting attacked by BOT on the LIVE monitoring? Is there an email where I can share more info?

Viewing 4 replies - 1 through 4 (of 4 total)
  • Thread Starter CamZL1

    (@danishhaidri)

    5/5/2019 10:48:35 PM (25 seconds ago)
    IP: 66.249.79.85 Hostname: crawl-66-249-79-85.googlebot.com
    Human/Bot: Bot
    Browser: undefined
    Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)

    Do I block the IP Range in this case?

    Thread Starter CamZL1

    (@danishhaidri)

    5/5/2019 10:49:39 PM (12 seconds ago)
    IP: 46.229.168.144 Hostname: crawl16.bl.semrush.com
    Human/Bot: Bot
    Browser: undefined
    Mozilla/5.0 (compatible; SemrushBot/3~bl; +https://www.semrush.com/bot.html)

    Do I block the IP Range in this case?

    Thread Starter CamZL1

    (@danishhaidri)

    Apologies for so many messages but I am new to WP and WF and not sure if this is a website hacking attack or friendly bots trying to parse the site or something? Appreciate your advice.

    Hi @danishhaidri,

    The first one is a legitimate GoogleBot, which is used in crawling and indexing your site for Google. (66.249.79.85)

    The second one is also another bot, the information they collect is used in their own tool called SEMrush backlinks.

    In either case, you can choose to tell the bots to stop crawling your website by editing your robots.txt and adding:

    User-agent: SemrushBot
    Disallow: /

    I would recommend blocking bots on a case-by-case basis. Look up the bot names and find out what they do. For example, the GoogleBot indexes your site, so that is can be found on Google search. You’ll probably want to allow that bot.

    Dave

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘BOT Attack’ is closed to new replies.