Facing High Network traffic due to lots of bot 404 errors

  • Resolved hemasusi

    (@hemasusi)


    1 year, 12 months ago

    Hi,

    We are seeing lots of 404 errors in log –

    https://prnt.sc/VvDsEMH3bJlt

    https://prnt.sc/PUGqSOF5jhSj

    Some of them is due to missing theme assets. But half of them is like /404 & /-/-/-/-/-/

    Because of this, facing too much traffic across our site. We need to know the reason and debug. Is there any way to check 301 redirects plugin error logs in detailly? or How to avoid 404 errors in logs?

    Please answer to fix.

    Thank you.

Viewing 1 replies (of 1 total)
  • Plugin Author Alexandru Tapuleasa

    (@talextech)

    Hi,

    Unfortunately, weather the traffic results in a 404 or not, it’s volume is the same. The server load is probably lower for 404 as a 404/not-found error page is usually a bit less demanding than a regular page.

    In any case, you will need to check where the traffic is coming from:

    • in 301 Redirects PRO you can see the URL referrer in case they are human visitors coming in by clicking on a link on a referring page
    • From your screenshots though it seems more likely you are dealing with a bot/crawler scraping your website. It could be a search engine like Google, Bing etc. that has ended up with a list of URLs that don’t actually exist on your website, or it could be some other crawler. You will need to check your server’s access logs and see more information about those requests
Viewing 1 replies (of 1 total)
  • The topic ‘Facing High Network traffic due to lots of bot 404 errors’ is closed to new replies.

Tags