Robots.txt Disallow folder and subfolders?

  • Resolved chinwag

    (@chinwag)


    4 years, 10 months ago

    Hi, what is the Robots.txt configuration that I need to Disallow access to a certain Folder and subsequent sub-folders please?

    Currently:

    User-agent: XmlSitemapGenerator
    Disallow: /property/*

    but still doesnt stop the folder being accessed.

    Thanks.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author xmlsitemapgenerator

    (@xmlsitemapgenerator)

    Hello.

    sorry for the delay.

    The robots file simply tells search engines what it should / shouldn’t access.
    It does not set any permissions or control access.
    you should consider them hints rather than instructions.

    Plugin Author xmlsitemapgenerator

    (@xmlsitemapgenerator)

    Forgot to mark as resolved.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Robots.txt Disallow folder and subfolders?’ is closed to new replies.