Comment-page in Sitemap
-
Hi. I use the Screaming Frog SEO Spider tool. I also use pagination for WordPress comments. Through robot.txt, I prevented the pagination index that is placed at the end of the page url, for example: comment-page-1 or comment-page. But in the Screaming Frog SEO Spider software sitemap tab, it crawls these URLs in the comment-page and places them in the site map.
Even in the Google search console, in the blocked robot.txt section, it crawls and identifies the url’s that include comment-page.Did your sitemap plugin actually add these items to the sitemap? If yes, how do I prevent them from creeping? Not good for SEO.
Viewing 1 replies (of 1 total)
Viewing 1 replies (of 1 total)
- The topic ‘Comment-page in Sitemap’ is closed to new replies.