• Resolved lauratraveler

    (@lauratraveler)


    Hi,

    I have checked:

    • Apply noindex to Media? – attachment
    • Apply noindex to Categories? –category 
    • Apply noindex to Tags? – post_tag
    • Apply noindex to Formats? – post_format
    • Apply noindex to Author pages? 
    • Apply noindex to Date archives? 
    • Apply noindex to Search pages?

    but my robots.txt only displays

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

    Is this correct? Shouldn’t there be more to it?

    Also, if I want to add:

    User-agent: ChatGPT-User
    Disallow: /

    to my robots.txt. How can I do this?

Viewing 3 replies - 1 through 3 (of 3 total)
Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Robots.txt’ is closed to new replies.