Webmaster Tool – Slows my site!

  • radicalgel

    (@radicalgel)


    13 years ago

    I run the site https://www.agletdesign.com and recently noticed that things got super sluggish and very often my dashboard wouldn’t even load, giving me a internal server error. I then thought of the last thing that I had done and that was register with webmaster tools. I then went to the ‘crawler access’ in the settings and saw these lines in the robot.txt file:
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    I deleted this and did a test then went to my dashboard and everything was back to lightening quick. I have now reinserted these lines back into the robot.txt in webmaster tools and wordpress is still quick. Can someone explain to me why this slow down happened, could it be webmasters fault? Also, do I need those lines of code in the robot.txt, how does it help?

Viewing 1 replies (of 1 total)
  • Thread Starter radicalgel

    (@radicalgel)

    UPDATE: Well I guess that was a one time thing. My site is back to being extremely sluggish and nothing I change in webmaster tools is helping. I keeping getting 504 gateway time-outs and 500 internal server errors. ?? No clue why this is happening. I use only 4 or 5 plugins. Could all-in-one-seo pack cause such a slowdown?

Viewing 1 replies (of 1 total)
  • The topic ‘Webmaster Tool – Slows my site!’ is closed to new replies.