Syndication and Duplicate content?

  • Hi,

    I have a quick question regarding the syndication plugin and duplicate content (in the wise eyes of Google!)

    First of all, I should explain that my site is a blog network and I am using the syndication plugin to aggregate 5 feeds. 4 of which at the minute are hosted by myself and one is somebody else’s blog who has agreed to join the network.

    I have set the plugin to grab the feeds but keep the permalink to the original source. Also, when you view the list of all the posts in category view, it just shows an exerpt which is what I want.

    My concern however is that if you manually type in https://example.com/date/post-title, you actually get a copy in full of the post that has been found by Syndication.

    I am assuming that this constitues as duplicate content, which is something that I am trying to avoid obviously!

    I was wondering if anyone knows of any solutions that avoid this?

    All the best,
    Sam

    (my site is onyahead.com if you would like to see an example of what I am talking about!)

Viewing 4 replies - 1 through 4 (of 4 total)

  • You can use robots.txt, sitemaps or add a meta-robots noindex to exclude the particular URI. And try validate the robots.txt or sitemaps with googlewebmaster tool.

    Thread Starter sam_h1

    (@sam_h1)

    so say for example, I had all my syndicated posts in the ‘news’ category, I could create a robots.txt file that said to exculde the directory /news/ when crawling?

    would that just help solve the issue of duplicate content without losing any value of having the feeds syndicated on my site?

    would that just help solve the issue of duplicate content without losing any value of having the feeds syndicated on my site?

    yes, major search engine crawler will honored the robots.txt

    try

    User-agent: Googlebot
Disallow: /news

    valid robots.txt example.

    Thread Starter sam_h1

    (@sam_h1)

    thanks for your help chaoskaizer, i have added a robots.txt file as discussed…hopefully it should work!!

    all the best

    sam

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Syndication and Duplicate content?’ is closed to new replies.