Google Server Crawl Errors & robot txt fetch errors

  • Changed to WordPress in January ’14 from standard a html format website. Getting GWT crawl errors at average 800+/day for last 90 days (at least) and all the errors listed show a /xxxxx.html URL. These are the old (pre-WrodPress) URL’s and I don’t what is causing Google to look for those old URLs and not being directed to my new WP site (https://pgaa.com). On Jan 2 I started getting robot txt fetch errors several times and as late as January 26. Are these affecting the visibility of my new WP sites? Should my hosting company be doing something?

Viewing 1 replies (of 1 total)

  • Are all the pages from your old website deleted that had different URL then existing pages?

    Have you done any redirecting from old pages to new ones if the URL has changed?

    Have you created a new sitemap and submitted to Google through your Webmaster tools? I did not see a sitemap at pgaa.com/sitemap.xml

    I scanned 500 pages of your website and found only 3 broken links.

Viewing 1 replies (of 1 total)
  • The topic ‘Google Server Crawl Errors & robot txt fetch errors’ is closed to new replies.

Tags