Site map and webmaster tools error

  • MattyWP

    (@mattywordpress)


    11 years, 4 months ago

    Hi guys i’m currently getting ‘Sitemap contains urls which are blocked by robots.txt.’

    I’m using a sitemap plugin named ‘Google XML Sitemaps‘.

    My robots .txt contents are

    User-agent: *
Disallow: /privacy
Disallow: /prices
Disallow: /pay-invoice
Disallow: /cancellations-and-returns
Disallow: /tag

    I would assume I could just remove the links from the sitemap but there are no options to do so in the plugin.

    All I need the robots file for is to block the ‘tags’ pages are they’re duplicate content and the pages privacy, prices, pay-invoice, cancellations-and-returns as I have them pages on another site with the same content.

  • The topic ‘Site map and webmaster tools error’ is closed to new replies.