Robots.txt File Testing Help

  • Sitemap: https://www.xyz.com/sitemap.xml

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:

# digg mirror
User-agent: duggmirror
Disallow: /

    above is the robots.txt file I made ! please let me know if this is correct !? I dunno much about robots.txt

  • The topic ‘Robots.txt File Testing Help’ is closed to new replies.