Googlebot grabbing files ;)

  • Hello. Thanks for a great tool!

    Could you please help me with one strange thing? My site was launched for a few minutes after that i’ve got about 25-30 downloads. I was checking the ip in a log and found that they belong to google bot. How can i avoid this situation and have a more realistic log?

    Regards.

Viewing 16 replies (of 16 total)
  • Thread Starter kirillm

    (@kirillm)

    Hi. Not sure that blocking google/yandex crawlers is good idea. And there’s always new ip’s from time to time.

Viewing 16 replies (of 16 total)
  • The topic ‘Googlebot grabbing files ;)’ is closed to new replies.