Sitemap doesn’t exclude wp-includes

  • Resolved tom coady

    (@tomcoady)


    5 years, 12 months ago

    User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

    Not sure why google has picked up 70 URLs starting with wp-includes or how to add this as disallowed in jetpack

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Contributor James Huff

    (@macmanx)

    Your sitemap will not include /wp-includes/ files, but sitemaps also don’t tell Google to exclude anything.

    Its your robots.txt file which handles the exclusions, and that’s controlled by WordPress, not Jetpack.

    We don’t recommend excluding /wp-includes/ in robots.txt, as that includes resources necessary for rending pages, meaning that Google won’t be able to process some pages.

    Thread Starter tom coady

    (@tomcoady)

    Thanks James
    I had a feeling there was a reason for not excluding wp-includes; that may explain how google spiders managed to index some of them.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Sitemap doesn’t exclude wp-includes’ is closed to new replies.