HTTP header X-Robots-Tag and sitemaps

  • Resolved argenta99

    (@argenta99)


    5 years, 11 months ago

    My problem is that I can’t send the sitemap of my website to Google Search Console; Google won’t crawl the sitemap because “the noindex tag has been detected in the HTTP header X-Robots-Tag“.
    But, all published pages and posts are in ”index-follow”. (All the pages and post have content).
    The taxonomies (category and tag page) are in ”no index” (I need this configuration).
    So I have checked the.htaccess file but I haven′t found the “noindex” tag here.
    Those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye.
    The sitemap is virtually generated by Yoast SEO (I have followed all your tips in detail) and I have seen a number of other post indicating this setting is coming from this plugin.

    Thanks in advance

    Regards

    The page I need help with: [log in to see the link]

Viewing 6 replies - 1 through 6 (of 6 total)

  • The sitemaps have the HTTP header because sitemaps don’t belong in the search results. However, Google Search Console shouldn’t have any issues with this when you submit them. Can you elaborate or share a screenshot?

    Jeroen

    Thread Starter argenta99

    (@argenta99)

    Hello Jeroen
    Excuse the delay but I have manually sent each URL to Search Console and I was waiting the reports in order to find the problem.

    How can I upload an image?

    Thanks

    Plugin Support devnihil

    (@devnihil)

    You would need to upload the image to an image sharing site such as https://pasteboard.co/ and then post the link to the image.

    No: ‘noindex’ detected in ‘X-Robots-Tag’ http header —–>>> how to fix this

    Hi @abhsinchau

    This is expected behavior. Yoast outputs a noindex tag on the sitemap file. This prevents Google from making your actual sitemap file appear in a Google Search. It is bad for SEO to make the sitemap file appear in Google as it contains thin content for your users and is supposed to be used by robots rather than humans.

    Please know Google is still expected to scan the sitemap and crawl the links on it. Those links on the sitemap file are expected to appear in Google.

    Hi, I got this from google search console, How can I solve this, Help me
    https://prnt.sc/p9qj43

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘HTTP header X-Robots-Tag and sitemaps’ is closed to new replies.