Robots and Sitemap Errors

PS: When I live test the sitemap.xml it says “Page cannot be indexed: Excluded by ‘noindex’ tag” but you can see my robots.txt file above.

Hi @sdagency,

Thanks for reaching out, and I apologize for the inconvenience caused!

No: ‘noindex’ detected in ‘X-Robots-Tag’ http header

Could you confirm if you’re getting this error for your sitemap? If yes, there’s nothing to be worried about as XML sitemaps are specifically created for search engines to crawl the website efficiently. They hold no other SEO value for your website and are not helpful for your site visitors.

Hence, they’re intentionally set to Noindex, as they should only be submitted to webmaster tools like Google Search Console and not get indexed on the search results.

You should submit the sitemaps under the Sitemaps section of your Google Search Console account and not run the sitemap URL in the URL Inspection Tool.

Here’s a guide you can follow to submit the sitemap to Google: https://aioseo.com/docs/submitting-a-sitemap-to-google/

Also, it is important to note that setting the sitemaps to Noindex does not, in any manner, restrict search engines from crawling them.

for every sitemap is says “Couldn’t fetch” and “Sitemap could not be read” even though Google can access the sitemap and says “Success” for that.

Could you please share the actual URL of your sitemap so I can investigate the issue?

I’m looking forward to helping you.

Hi @sdagency,

We haven’t heard back from you in a few days. I’m going to go ahead and close this thread for now. But if you’d like us to assist, please feel welcome to continue the conversation.

Thanks!