My Site's Description on google block by Robots.txt

  • Hi guys , my website is having problems showing up properly on google searches and shows :

    A description for this result is not available because of this site’s robots.txt – learn more.

    my site here : excelforth.com
    My robots.txt file contains :
    User-agent: *
    Disallow:

    And I have indexed my site on google webmasters yesterday.

    Is there anything Im doing wrong? I have also unticked
    “Discourage search engines from indexing this site”

    Please advise… thanks!!

Viewing 3 replies - 1 through 3 (of 3 total)

  • Remove you custom robots.txt file and let WordPress use the virtual robots.txt file. Simply remove yours and WordPress will see that one is not manually placed and when /robot.txt is read by search engines (or anyone, simply browse to it) WordPress will output a virtual robots.txt file based on that checkbox setting.

    You will need to give Google time to index the site. You can submit your robots.txt file at Google Webmaster Tools. You can also submit a sitemap.

    Thread Starter gunzbry

    (@gunzbry)

    Okay! I have deleted my robots.txt file.
    Now it reads:

    User-agent: *
    Disallow: /site/wp-admin/
    Disallow: /site/wp-includes/

    Sitemap: https://www.excelforth.com/sitemap.xml.gz

    Is that okay?

    Yes, those both look fine – Use Google Webmaster Tools to submit both files for quicker indexing.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘My Site's Description on google block by Robots.txt’ is closed to new replies.