Meta tags – How to make a page unsearchable

  • Hi there,

    I want to make only one of my pages unsearchable by robots from any search engines, while keeping the rest of my website searchable. What is the most effective way to make this modification?

    Thanks!

Viewing 1 replies (of 1 total)

  • Hello,

    User-agent: *
    Disallow: /

    With the above declared, all robots (indicated by “*”) are instructed to not index any of your pages (indicated by “/”). Most likely not what you want, but you get the idea.

    The following disallows all search engines and robots from crawling select directories and pages:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /privatedir/
    Disallow: /tutorials/blank.htm

    If you would like to allow everything then your robots.txt should look like the following:

    User-agent: *
    Disallow:

    Hope this helps

Viewing 1 replies (of 1 total)
  • The topic ‘Meta tags – How to make a page unsearchable’ is closed to new replies.