Post not being indexed by google, or picked up by crawlers

  • Resolved alexDx

    (@alexdx)


    10 years, 3 months ago

    Hello, I have a site here: https://www.seattlevetassoc.com/

    None of my posts are being indexed by Google. Also, none of my posts will show up when I crawl the site with ScreamingFrog SEO spider.

    Strange thing is, I have a robots.txt:

    User-agent: *
    Disallow: /wp-admin/

    I have a sitemap, and the posts are listed there.

    Each post is categorized, and each category is set to be indexed.

    I did import these posts from an old blogger blog at:

    https://seattleveterinary.blogspot.com/

    The posts imported fine, but I cannot figure out why the wont be indexed or picked up by bots.

    I also have this in my header.php:

    <meta name=”robots” content=”index, follow”>
    <meta name=”robots” content=”all”>

    All of my pages are being indexed, just no posts.

    Also another strange thing, if I create a new post and don’t set a category on it, it is indexed.

Viewing 4 replies - 1 through 4 (of 4 total)
  • Matt

    (@mattcheahgmailcom)

    Hi Alex,

    Screaming frog crawls are working for me and are finding your blog posts. What does webmaster tools look like for you? Can you submit a fetch and render request on one of the blog posts?

    I’m not sure what’s causing this but maybe spend some time cleaning up the 404 errors on your page and Google will have more of a crawl budget to spend time on your site?

    Thread Starter alexDx

    (@alexdx)

    Hey Matt, thanks for the quick reply!

    This is one example post:

    https://www.seattlevetassoc.com/car-sickness-in-pets/

    This one isn’t showing for me in Screaming Frog.

    I submitted a fetch and render on this one, and this was the response:

    https://www.seattlevetassoc.com/car-sickness-in-pets/
    Googlebot type: Desktop (render requested)
    Partial on Monday, December 15, 2014 at 2:43:28 PM PST
    This is how Googlebot fetched the page:

    (image of my post)

    Googlebot couldn’t get all resources for this page. Here’s a list:
    https://www.seattlevetassoc.com/car-sickness-in-pets/redirection_mobile.min.js Type: script Reason: Not Found

    Is this post showing for you in SF?

    Also, none of the staff posts are showing for me:

    https://www.seattlevetassoc.com/sva_staff/shelly/

    Matt

    (@mattcheahgmailcom)

    the car-sickness one is showing for me in SF.
    The Shelly page – as far as i can tell – has no links to it from your site, which would be why it isn’t showing in Screaming frog.
    I’m not sure which of the 4 hospitals she works for but she wasn’t on any of the lists of vets, and your links to the hospital staff all return 404s (btw, i’d recommend creating a specific 404 page too! – right now all 404 pages are blank.)

    btw, i think your redirection.js file just needs to be referenced with the full URL. to clean up those errors.
    Were you not able to submit that car sickness page to the index in GWT?

    Thread Starter alexDx

    (@alexdx)

    Hey Matt, I really appreciate your help on this. Helped us narrow down the issue we were having ??

    Thanks man!

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Post not being indexed by google, or picked up by crawlers’ is closed to new replies.