Robots Text File Issue

  • Resolved dianagalli

    (@dianagalli)


    3 years, 2 months ago

    The web site admin section’s robots text file contents don’t match the site’s generated file. There is a line of code disallowing all files in the root. I tried updating this file in my wordpress admin but it’s not fixing the issues

    In the admin area, the preview of the robots.txt file shows this:

    User-agent: *
    Allow: /wp-admin/admin-ajax.php
    Disallow: /wp-admin/
    Disallow: /wp-content/uploads/wpo-plugins-tables-list.json

    Sitemap: https://flyingsolotoronto.com/sitemap.xml
    Sitemap: https://flyingsolotoronto.com/sitemap.rss

    If you look at the robots.txt file on the site that was generated by AIO SEO, there’s an additional line to disallow the root directory. I’ve tried regenerating it through the admin, but it’s always there in the web link but not in the admin section.

    https://flyingsolotoronto.com/robots.txt
    They don’t match.

    User-agent: *
    Allow: /wp-admin/admin-ajax.php
    Disallow: /wp-admin/
    Disallow: /wp-content/uploads/wpo-plugins-tables-list.json
    Disallow: /

    Sitemap: https://flyingsolotoronto.com/sitemap.xml
    Sitemap: https://flyingsolotoronto.com/sitemap.rss

    Can you help me fix this issue?

    • This topic was modified 3 years, 2 months ago by dianagalli.
    • This topic was modified 3 years, 2 months ago by dianagalli. Reason: spelling

    The page I need help with: [log in to see the link]

Viewing 1 replies (of 1 total)
Viewing 1 replies (of 1 total)
  • The topic ‘Robots Text File Issue’ is closed to new replies.