• A Korean web search service requires that my website creates a page with a URL that ends in “/robots.txt”.

    How do you created a page with “/robots.txt” URL at the end?

    I tried to add “/robots.txt” to the custom URL, but WordPress keeps changing it to “/robots-txt”.

Viewing 2 replies - 1 through 2 (of 2 total)
  • You can not add robot.txt as page of wordpress. .txt is a extension. If you really want to create robot.txt file than try from ftp.
    You must have a good knowledge of robot.txt handling before touching.
    Robot.txt
    The robots exclusion standard, also known as the robots exclusion protocol or robots.txt protocol, is a standard used by websites to communicate with web crawlers and other web robots.

    You can’t add robot.txt as WordPress page you must have to create this page from your FTP.
    As we can see .txt is a extension and permalink won’t allow.
    Before creating Robot.txt you must have a good knowledge of it’s usage.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘How do you created a page with "/robots.txt" URL at the end?’ is closed to new replies.