htaccess config and issues with robots.txt

  • Resolved adam__ph

    (@adam_ph)


    7 years, 2 months ago

    I’ve noticed that when trying to access the robots.txt file on a site that uses Cache Enabler with an advanced htaccess configuration the robots.txt file redirects the user to the site homepage.

    This only happens as if the robots.txt file is cached and then viewed by a non logged in user it redirects.

    Is there a way to exclude the robots.txt file?

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)

  • Have you tried removing the advanced configuration to see if this solves the issue?

    The difference in speed between the advanced config and the default settings are negligible.

    Thread Starter adam__ph

    (@adam_ph)

    I tried removing the htaccess configuration and that does fix the issue but we do seem slightly better performance when bypassing PHP completely.

    I was hoping for a way to exclude robots.txt when using the htaccess advanced setup.

    It sounds as though it might be a configuration issue with your .htaccess file. We don’t have a way that will explicitly exclude your robots.txt file within the .htaccess. I’d still recommend using the default settings if you continue to experience this issue.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘htaccess config and issues with robots.txt’ is closed to new replies.