More than 40,000 Duplicate posts

Screenshot

what is the url of the feed where you are getting multiple posts – the plugin uses the permalink as an indicator it’s a unique post – are the permalinks unique?

I am fetching feed from Google news by separating feed based on Google categories Like this >> https://news.google.com/news/feeds?pz=1&cf=all&ned=uk&hl=en&q=Asperger+Syndrome&output=rss i have 23 more feed urls.

permalinks are unique if news name is change in feeds , but in the duplication it’s making posts like this >> example.com/permalink-2 and so on.. i downgraded to version 2.67.4 , it’s not duplicating on this version but on current one.

ok..I had to get rid of checking the titles in the current version due to a problem with people upgrading to php 5.0 on their servers. I’m going to put up an update to the plugin today that will hopefully handle the Google News problem (another person in the forum suggested a fix for this – all of this is happening because of the way Google News handles their feed.

Thank You so much i look forward for update but right now old version is working awesome as always , Thanks a lot for making this amazing plugin and for the response ??

in fact, if you like, try replacing this file on your server (in the plugin’s inc folder)..this has the fix that will be released today or tomorrow

https://www.dropbox.com/s/slomcuvoue0dvzs/import_posts.php

I have uploaded file now testing ..

I fetched around 250 posts and almost 30% posts were got repeated .. i will test it again in few hours to check that if it’s due to fetching so frequently..

alright, well, this isn’t happening on my servers with google news (using the url from your earlier comment), even when I manually keep fetching it over and over again. Watch here:

https://www.screencast.com/t/lA4kOeTJfh

also, the duplicates you are getting right now are due to the changeover from the way the permalinks were processed before…so the duplicates shouldn’t happen from now on.

Video is taking time to load ?? , I was fetching from all the URLS , the one i have given you , at my side that URL have made 12 items and 3 were got repeated. I am deleting all the posts for today and trying again may be before update posts are confusing me , as you said it should not duplicate now so it’s defiantly before update posts .. Try again..

Tried Again

Check out this link Please https://awesomescreenshot.com/0de304i9e6

ok…try this file and see if this helps

https://www.dropbox.com/s/slomcuvoue0dvzs/import_posts.php

Hey

I tried it and it worked like miracle , no posts got repeated ..

Awesome !! , Thanks a lot ??

great…glad to know I got a solution for you.