35 different robots | Hits | Bandwidth | Last visit |
Googlebot | 39867+703 | 44.24 GB | 31 Jul 2017 - 23:53 |
Unknown robot (identified by 'bot*') | 27552+377 | 52.27 GB | 31 Jul 2017 - 23:55 |
Unknown robot (identified by 'crawl') | 11934+240 | 724.94 MB | 31 Jul 2017 - 23:05 |
Yahoo Slurp | 7332+49 | 2.06 GB | 31 Jul 2017 - 23:54 |
BaiDuSpider | 5783+6 | 980.56 MB | 31 Jul 2017 - 23:53 |
Yandex bot | 3434+185 | 2.98 GB | 31 Jul 2017 - 23:51 |
yacy | 1990+6 | 71.56 MB | 11 Jul 2017 - 10:44 |
Sogou Spider | 772+119 | 614.49 MB | 31 Jul 2017 - 23:55 |
Java (Often spam bot) | 808+1 | 51.88 MB | 31 Jul 2017 - 22:42 |
Unknown robot (identified by hit on 'robots.txt') | 0+319 | 34.58 KB | 31 Jul 2017 - 23:01 |
Unknown robot (identified by empty user agent string) | 211+5 | 60.63 MB | 31 Jul 2017 - 11:46 |
psbot | 195+9 | 3.11 MB | 07 Jul 2017 - 09:51 |
Unknown robot (identified by '*bot') | 169+23 | 393.55 MB | 31 Jul 2017 - 19:12 |
Alexa (IA Archiver) | 122+22 | 3.35 MB | 30 Jul 2017 - 21:07 |
UniversalFeedParser | 107 | 681.10 KB | 30 Jul 2017 - 20:29 |
MJ12bot | 31+33 | 268.80 KB | 31 Jul 2017 - 07:03 |
Python-urllib | 37+24 | 139.14 MB | 31 Jul 2017 - 15:41 |
FavIconizer | 53 | 453.45 KB | 31 Jul 2017 - 23:34 |
Unknown robot (identified by 'spider') | 50+2 | 76.60 MB | 30 Jul 2017 - 03:19 |
archive.org bot | 37+12 | 54.98 MB | 30 Jul 2017 - 16:15 |
Nutch | 32+9 | 78.61 MB | 27 Jul 2017 - 22:44 |
Unknown robot (identified by 'robot') | 14+13 | 2.51 MB | 30 Jul 2017 - 20:36 |
Web Core / Roots | 25 | 4.20 MB | 26 Jul 2017 - 13:40 |
Exabot | 15+9 | 262.04 KB | 31 Jul 2017 - 23:44 |
FaceBook bot | 22 | 520.15 KB | 28 Jul 2017 - 03:29 |
Sift | 12 | 198.30 KB | 29 Jul 2017 - 05:19 |
Mail.ru bot | 5+6 | 10.00 KB | 19 Jul 2017 - 17:23 |
SeznamBot | 3+3 | 28.25 MB | 31 Jul 2017 - 22:04 |
LinkWalker | 4+2 | 213.65 KB | 20 Jul 2017 - 20:10 |
Phantom | 6 | 73.76 KB | 14 Jul 2017 - 22:55 |
HTTrack off-line browser | 5 | 32.56 MB | 29 Jul 2017 - 21:09 |
CFNetwork | 4 | 20.70 MB | 17 Jul 2017 - 15:00 |
Netcraft | 3 | 8.56 KB | 06 Jul 2017 - 04:35 |
WordPress | 1 | 0 | 13 Jul 2017 - 14:22 |
WebFilter | 1 | 5.45 MB | 08 Jul 2017 - 20:55 |