Google Search Console – ROBOTS.TXT Unreachable

  • Resolved netiger

    (@netiger)


    9 months, 3 weeks ago

    Hello.

    I need help with the following problem. Google Search Console displays ROBOTS.TXT Unreachable.

    The sitemap is also unavailable.

    Google started rejecting products and pages, claiming that the landing page was not available.

    The website actually works flawlessly.

    The hosting provider said that there were no blocks on their side and they did not see a problem.

    All online testers show that robots.txt and the sitemap are available.

    I suspect that the problem may have appeared after updating the RankMath plugin.

    What could be causing these problems and how to fix them?

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support Rank Math Support

    (@rankmathsupport)

    Hello @netiger,

    Thank you for contacting Rank Math support.

    Your robots.txt file and sitemap are working fine. Please request a recrawl in your GSC account, and the issue should be resolved once Google recrawls the site. If the issue persists, please share some screenshots of the error so we can check further. You can use a tool like https://imgur.com/ to share the screenshots.

    Looking forward to helping you.

    Thread Starter netiger

    (@netiger)

    Hello,

    My testing also shows there are no issues with the sitemap or robots.txt files.

    Below is a link to screenshots showing GSC errors:

    View post on imgur.com

    I tried to request a recrawl of individual pages, but there is an error visible in the screenshots.

    Is it possible to request a recrawl of the entire sitemap?

    Plugin Support Rank Math Support

    (@rankmathsupport)

    Hello @netiger,

    Please remove your submitted sitemap and submit this format instead:
    ?sitemap=1

    Here’s a link for more information:
    https://rankmath.com/kb/couldnt-fetch-error-google-search-console/

    Once done, give Google some time to recrawl your site and the “Last read” date column should populate as well.

    Let us know how this goes.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Google Search Console – ROBOTS.TXT Unreachable’ is closed to new replies.