Modify robots.txt

  • Resolved coolicious

    (@coolicious)


    4 years, 11 months ago

    Hey guys,

    thx for this beautiful plugin which I use on all of my websites. But one thing I cant find to do some things: How and where can I modify my robots.txt?

    I want to disallow the search string “?s=”. Can you tell me that?

    Thank you!

    Best regards,
    Tom

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Sybre Waaijer

    (@cybr)

    Hi Tom,

    I’m glad to see you’re still around after all these years ??

    TSF should block the /?s={term} and /search/{term} requests automatically when you’ve set noindex for search pages via the general settings.

    But, if you still want to disallow that query-string via robots.txt, then you can do that by supplying a custom robots.txt file in the root folder of your website via FTP. That file will override the output TSF brings otherwise.

    If you’d rather do that programmatically, please check out this filter; it allows you to append custom rules to the virtual output, or even override it completely.

    Now, we’re still considering making a UI-powered option available for this. Feel free to add your voice to the active issue: https://github.com/sybrew/the-seo-framework/issues/59

    I hope this helps ?? Cheers!

    Thread Starter coolicious

    (@coolicious)

    Nice, thank you!

    That rly helps ??

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Modify robots.txt’ is closed to new replies.