This is from my awstats program in cpanel:
I think some of these bots are not legitimate.
Is there a way of getting rid of them?
cheers
Ken Gray please respond to [ email deleted. Don’t do that again on this site please. ]
bingbot 52,459+172 1.44 GB 18 Oct 2021 – 04:15
Googlebot 17,189+431 316.73 MB 18 Oct 2021 – 04:14
oBot 12,716+68 278.39 MB 17 Oct 2021 – 23:35
Unknown robot identified by bot\* 5,373+1114 216.91 MB 18 Oct 2021 – 04:13
Java ( catchall ) 5,996 178.07 MB 18 Oct 2021 – 03:21
facebookexternalhit 5,393 150.78 MB 18 Oct 2021 – 04:06
nutch ( catchall ) 4,851+64 77.42 MB 18 Oct 2021 – 00:47
Mediapartners-Google 4,464 100.06 MB 18 Oct 2021 – 03:57
Unknown robot (identified by hit on robots.txt) 0+3054 577.69 KB 18 Oct 2021 – 04:12
empty user agent string 1,721+892 125.38 MB 18 Oct 2021 – 04:02
Applebot 2,005+17 59.74 MB 18 Oct 2021 – 03:52
Feedfetcher-Google 1,591 13.04 MB 18 Oct 2021 – 03:58
feed 1,308 20.99 MB 18 Oct 2021 – 03:53
crawl 1,248+39 16.86 MB 18 Oct 2021 – 03:49
GrapeshotCrawler 1,133+22 33.80 MB 18 Oct 2021 – 03:39
Googlebot-Image 1,048 12.94 MB 18 Oct 2021 – 04:01
fetcher 977 29.32 MB 18 Oct 2021 – 03:38
proximic 825+47 24.54 MB 18 Oct 2021 – 00:35
Baidu ( catchall ) 790 20.31 MB 17 Oct 2021 – 19:46
YandexBot 637+148 19.44 MB 18 Oct 2021 – 04:13
MojeekBot 420+323 12.24 MB 18 Oct 2021 – 03:02
Curl 515 69.87 MB 18 Oct 2021 – 02:43
link 429+25 5.82 MB 18 Oct 2021 – 04:07
Firefox version 10 and lower – various robots 377 26.99 MB 18 Oct 2021 – 00:00
Mail.RU Bot