Googlebot can't access your site

  • Resolved hurra03

    (@hurra03)


    9 years, 1 month ago

    Not sure where to post this, but for the last two days I’ve been getting the error “Googlebot can’t access your site”.

    My robots file can be accessed (https://alteregovoices.com/robots.txt), as can the sitemap, but if I test the robots.txt file or submit the sitemap via Webmaster, I’m getting an error “You have a robots.txt file that we are currently unable to fetch. In such cases we stop crawling your site until we get hold of a robots.txt, or fall back to the last known good robots.txt file.”

    The value for “Discourage search engines from indexing this site” is not checked under the WP dashboard.

    My host says everything is fine their end…..so any help from you lot would be great.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Theme Author nobita

    (@nobita)

    Hi hurra03

    html elements to prohibit Google bot access it has been described　In your WEB site, 

    <meta name="ROBOTS" content="INDEX,FOLLOW">
	<!-- REH - End extra info-->

    Basic setting

    Dashboard / Settings

    If Search Engine Visibility set checked then apear this element on header

    Or, it might have been added in your own customized

    Thank you

    Thread Starter hurra03

    (@hurra03)

    Thanks – I sorted it – it seems to be a feature of a another plugin (Yoast SEO) – which was creating a robots.txt file on-the-fly.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Googlebot can't access your site’ is closed to new replies.

Tags