Andrew Brooks

I have looked at the site and I cannot see a long bar, so it might be fixed!

If not, I know there is a bug with 3.25+. Mobile versions of the pages show menus that shouldn’t be hidden for that resolution. While we wait, rolling back to 3.24+ might fix it for you.

I am also experiencing this issue with menus that should be hidden on the mobile version appearing, rolling back to 3.24.X fixes the issue.

Thanks so much for your help everyone, I have it working now!

The issue was the .conf file for the Nginx server. To try and pay it forward, I have tried to write the solution as instructions for the fix.

If you have permalinks enabled and still can’t get a virtual robots.txt to work, here is a fix to try.

Find your gnix .conf file; mine was in /etc/ngnix/conf.d called wordpress_http.conf & wordpress_https.conf.

Make a backup of these files and look for the following lines

location = /robots.txt {
allow all;
log_not_found off;
access_log off;
}

If you have the above, replace it with this :

I changed it to this:
location = /robots.txt {
try_files $uri $uri/ /index.php?$args;
access_log off;
log_not_found off;
}

From your console, restart nginx server, with “sudo systemctl reload nginx”

Now check again you should get the the better-robots.txt generated robots.txt

What have you just changed?
Just having the equals sign means that when the request matches, only these rules are performed and nothing else. When you have a robots file, you don’t have any issues – it just gets served with no issues. But if you don’t, and are relying on a virtual one, nothing in the block lets WordPress handle the request, so you get a 404.

You can remove that block completely, and it will be handled along with everything else. However, it will fill up your log file with all the robots.txt requests. But changing it to the above suggestion WordPress will handle the request and not fill up your log file.

Thanks very much for your support, I still can’t get it to work.

I have followed your instructions, but it hasn’t worked. It looks like an issue with the Nginx server on my end.

When I delete my existing robots.txt file without your plugin installed, RankMath doesn’t create an accessible robots.txt either; I just get a 404 error. This is the same as when I installed your plugin.

I have tried disabling rank math and just installing your plugin, but that doesn’t work either.

So, the issue is definitely my configuration; I just don’t know where to start.

Hi

I know I have a robots.txt file; I delete it, then try to access it and I get a 404 error.

The website is working, we are getting plenty of orders, Cloudflare validates IP address locations and if you are not in New Zealand, should present a managed challenge. If you tick the box you’ll be directed to the site without this we are the target of a bunch of attacks. I have moved robots.txt to not be covered by the geographical restrictions.

Are you saying RankMath is not compatible with your plugin?

Thanks for your help. That seems to have fixed it.

• This reply was modified 1 year, 2 months ago by Andrew Brooks.

https://www.dropbox.com/scl/fi/vujelmbgasfoz9c03bwjb/Breadcrumbs2.jpg?rlkey=jsdjiydhwnxyf6c59a3uno3ua&dl=0

https://www.dropbox.com/scl/fi/vujelmbgasfoz9c03bwjb/Breadcrumbs2.jpg?rlkey=jsdjiydhwnxyf6c59a3uno3ua&dl=0

Google screen shots.

• This reply was modified 1 year, 2 months ago by Andrew Brooks.