robot.txt help

  • Resolved stretcharama

    (@stretcharama)


    1 year ago

    Hi, I am able to edit my robot.txt file in Yoast, and if I enter stretcharama.co.uk/robots.txt this is confirmed by the Yoast robot.txt file displaying – but if I enter https://www.stretcharama.co.uk/robots.txt I get a different robot.txt file appear that has ‘disallow: /’, this is the one google is seeing and therefore wont crawl the site – how can I find and amend this robot.txt file please – also I’m hugely great with web stuff so please dont get too technical – thanks

    The page I need help with: [log in to see the link]

Viewing 4 replies - 1 through 4 (of 4 total)
  • threadi

    (@threadi)

    This is probably located as a robots.txt file in your main WordPress directory. This means that the information in Yoast does not work.

    To solve this, you would have to log in to your hosting via FTP. You can then find the list of all files there and delete robots.txt. Your host’s support team could help you with this.

    Thread Starter stretcharama

    (@stretcharama)

    Thanks for the reply, by hosting you mean Cloudflare not word press

    threadi

    (@threadi)

    www.remarpro.com does not offer hosting. Since you are asking your question here in the forum, I assume that you have installed the software in a hosting of your choice. According to https://digital.com/who-is-hosting-this/#search=www.stretcharama.co.uk, your host is Cloudflare – so yes, that is your host.

    Thread Starter stretcharama

    (@stretcharama)

    Thanks for your help, Ill contact Cloud flare

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘robot.txt help’ is closed to new replies.