Change robots.txt file?
-
I’m trying to set up Yoast SEO and for the robots.txt file there wasn’t one so I ended up creating one. When it created one it gave me something I’m not sure how to comprehend. I’m trying to make sure my website isn’t blocking CSS and javascript files so google can better crawl and index my website. Basically, what showed up in my files was this:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.phpI believe I am supposed to put this down:
User-agent: *
Disallow: /out/What are the differences between these two?
my sources for this decision are *section 10* of https://www.godaddy.com/garage/smallbusiness/launch/15-things-you-must-do-with-yoast-seo-for-wordpress/
and *section 4* of https://kb.yoast.com/kb/how-to-edit-robots-txt-through-yoast-seo/
- The topic ‘Change robots.txt file?’ is closed to new replies.
