robots.txt

  • Wonder if anyone could help me . I never placed a robots.txt file in my blog but however when i check myblog.mydomain.com/robots.txt , it shows opens up the page. It is also detected when checked through google webmaster tools. I dunno how this actually works. I tried locating the robots.txt using ftp as well as control panel but it doesn;t seem to exist at all.

    This is also probably preventing my pages from getting indexed.

Viewing 1 replies (of 1 total)
  • Anonymous User 252516

    (@anonymized-252516)

    which folder are you checking in? if you use cpanel (and using your example url) you should be checking in /www/myblog/

    Also what is the content of the file? It is possible that the webserver is set to return a specific robot file. A good place to check would be in any .htaccess file you may have in / or /www/ or /www/myblog/ (all 3 can affect the subdomain folder) to see if there are any redirects specified.

Viewing 1 replies (of 1 total)
  • The topic ‘robots.txt’ is closed to new replies.