Huge SEO Issue: You’re blocking access to robots.

  • Resolved jordanwebdev

    (@jordanwebdev)


    4 years, 6 months ago

    I’m getting this “huge SEO issue”, but I’ve unchecked the “Discourage search engines from indexing this site” option in reading settings a few days ago. Why am I still getting this notification?

    Should I dismiss this message? If I do that, will it appear again if there really is a problem with the robots.txt file?

Viewing 4 replies - 1 through 4 (of 4 total)

  • Same thing here. There is nothing on my robots.txt file that indicates it is blocking it. Also it validates with Google Webmaster Tools as 0 errors and 0 warnings.

    Would love to hear more about something I might be missing!

    • This reply was modified 4 years, 6 months ago by alondonb.

    Try deactivating and reactivating the plugin. That resolved the error message for me! No idea why.

    Plugin Support devnihil

    (@devnihil)

    @jordanwebdev If you previously had the ‘Discourage search engines from indexing this site’ this could be related to caching. If you clear your cache (server, plugin/theme, or CDN such as Cloudflare) does this resolve the issue? If you are not sure how to clear your server cache you should speak with your host provider.

    If you are still receiving the notification after clearing the caching, can you please provide us with the URL of the site so we can review it for anything that might be causing the notification? Also, we have a guide on resolving this issue here as well: https://yoast.com/help/crawl-error-submitted-url-blocked-by-robots-txt/

    Plugin Support Jerlyn

    (@jerparx)

    Hi @jordanwebdev ,

    We’re closing this thread because we haven’t heard back from you in a while. Should you have further questions, please open a new thread.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Huge SEO Issue: You’re blocking access to robots.’ is closed to new replies.