Main website URL removed from Google index, robots.txt and sitemap not fetched

  • Resolved feswp

    (@feswp)


    3 years, 1 month ago

    Hello,
    we are currently facing a major issue with our wordpress site.

    Problems started in September, before everything was fine and all major pages were indexed, robots.txt and sitemaps were working. The site is using the Yoast SEO plugin.

    Currently the main URL has been removed from the index, last successful crawl was on 09/2/21 according to Coverage section in GSC.

    When using the URL inspector i receive: Crawled, currently not indexed
    When requesting indexing, i receive: Indexing request rejected
    After Live test, i receive: Availability – URL is unknown to Google

    The robots.txt can’t be fetched. Last successful fetch of the robots.txt according to the robots.txt Tester was on 10/1/21

    The sitemaps can’t be fetched also and were re-submitted on 10/13/21

    According to the hoster, the Google Bot was able to reach the site and returned a 200 Status code for the robots.txt

    66.249.69.154 – – [13/Oct/2021:11:19:02 +0200] “GET /robots.txt HTTP/1.1” 200 466 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)”

    Any help to solve this issue would be greatly appreciated. I am running out of ideas, what might cause this.

    Thank you

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Support Suwash

    (@suascat_wp)

    @feswp

    Checking your website, it seems you’re running Yoast SEO Premium on your website.

    This forum is reserved for supporting the free version of Yoast SEO. Your site is using a premium plugin so this thread has been marked as resolved per the forum guidelines.

    If you have an active premium subscription, please contact our support team for assistance. How can I get premium support?

    If you do not have an active premium subscription, you can either purchase a subscription or downgrade to the free version.`

    Plugin Support devnihil

    (@devnihil)

    We are going ahead and marking this issue as resolved due to inactivity. If you require any further assistance please create a new issue.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Main website URL removed from Google index, robots.txt and sitemap not fetched’ is closed to new replies.