Google Not Indexing Site

  • Resolved louseey

    (@louseey)


    12 years ago

    We launched a website about two weeks ago (a new site, migrating most of the content from an old wordpress site to new). The URL did change, and now Google’s not seeing the site or indexing it. If I do the search for “site:https://themavinsgroup.com&#8221; I get a message saying to check the robots.txt file, but I’m not sure how to do that. The privacy setting is not checked so it shouldn’t be blocked by search engines. If I view the source for the home page, I see this: <meta name=”robots” content=”noodp,noydir” />
    Thanks for any help.

Viewing 9 replies - 1 through 9 (of 9 total)
  • Krishna

    (@1nexus)

    If I view the source for the home page, I see this: <meta name=”robots” content=”noodp,noydir” />

    It will not affect indexing because the metatag only tells search engines not to use Open Directory Project (odp) or yahoo directory listings.

    Did you check your privacy settings? Also check if you have a robots txt file in your root directory or where you have WordPress, and see if there are restrictions.

    Thread Starter louseey

    (@louseey)

    Hi Krishna,
    Yes, I do see a robots.txt file in the root directory. I’m not sure what you mean by where do I have WordPress? Do you mean who is hosting the site?
    Thanks!

    Krishna

    (@1nexus)

    Check the robots.txt file in your root directory to see if you have restrictive features. I just meant the location where you have WordPress installed, if not in root.

    Also read:
    https://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449

    Thread Starter louseey

    (@louseey)

    Krishna, Next to the file on the FTP list, it says “Web Visible” – do you think that means it’s unrestrictive? I am pretty sure WP is installed in the root. It’s the only site hosted on this account.

    And thank you for the link, I will read it now.

    Thread Starter louseey

    (@louseey)

    Krishna, I just read that link. So now I’m really confused. If there IS a robots.txt file listed in my root directory, should I request that the developer delete it?

    Thread Starter louseey

    (@louseey)

    Krishna, in Google Webmaster Tools, I checked blocked URLs, and this is what I found,

    https://www.themavinsgroup.com/robots.txt

    User-agent: *
    Disallow:

    Then if I run the test, this is what I get:
    Allowed by line 2: Disallow:
    Detected as a directory; specific files may have different restrictions

    But I’m not sure what it means.

    Krishna

    (@1nexus)

    Keep only the first line. It allows all bots. Remove the second line (Disallow).

    Thread Starter louseey

    (@louseey)

    Thank you! You’ve been fantastic, I really appreciate your help.

    Krishna

    (@1nexus)

    You are welcome.

    If the issue is resolved, will you please mark the thread as resolved?

Viewing 9 replies - 1 through 9 (of 9 total)
  • The topic ‘Google Not Indexing Site’ is closed to new replies.