[Plugin: WordPress SEO by Yoast] No editor for robots.txt

bump…

my robots.txt file is blank after editing the indexation settings page. I’m looking at the page:
mysite.com/robots.txt

Is there possibly another page created by the yoast seo tool?

The plugin doesn’t use robots.txt to enforce all these settings but meta robots tags.

But Joost, your Feature #8 on the WordPress SEO Plugin feature list
is “Edit your robots.txt and .htaccess” –
https://yoast.com/wordpress/seo/

Also, I’m pretty certain I’ve seen an editor for the robot.txt file in this plugin for the robots.txt file here before, haven’t I?

OK, I get it now…

To be clear, The Yoast plugin does nothing to create or ever edit or add to an existing robots.txt file. The robots tags he’s referring to just appear in your code.

If you want to edit an actual robots .txt file from the admin panel, you need to create one manually.

I just added my generic one below, and an F5 refresh made it appear in the WP admin panel…

Sitemap: https://www.DOMAIN.com/sitemap_index.xml

User-agent: *
Disallow: /wp-admin

User-agent: *
Disallow: /wp-includes

You are right Scott, on some sites there is a robots.txt editor, however my site doesn’t have one and I can’t figure out how to get it to show up.

I created one manually and it still doesn’t show up the Edit Files tab of the Yoast plugin. I had another Robots plugin installed that perhaps commandeered that part of WP or something…?

I also get this entry in the .htaccess portion of the Edit Files page:
“If your .htaccess file were writable, we could do this automatically, but it isn’t so these are the mod_rewrite rules you should have in your .htaccess file.” Then in the box it says, “Options +SymlinksIfOwnerMatch”

My site is old enough I was running Yoast’s plugin back before it had the Robots/HTAccess integration I believe also, when he had the separate Robots Meta plugin…
_____________________

Yoast if you get time, I’m sure you have dealt with these issues before so link us up to some details for the resolution(s) if you can! Thanks!