40 different robots | Hits | Bandwidth | Last visit |
Googlebot | 20895+713 | 37.50 GB | 31 Dec 2013 - 23:59 |
Unknown robot (identified by 'bot*') | 20807+209 | 60.76 GB | 31 Dec 2013 - 23:59 |
Yandex bot | 7132+60 | 7.71 GB | 31 Dec 2013 - 23:50 |
BaiDuSpider | 2042+1 | 467.05 MB | 31 Dec 2013 - 23:59 |
Unknown robot (identified by 'crawl') | 1979+14 | 60.60 MB | 30 Dec 2013 - 15:07 |
NG 1.x (Exalead) | 727 | 5.13 GB | 31 Dec 2013 - 19:28 |
psbot | 598+75 | 11.01 MB | 31 Dec 2013 - 17:54 |
Sogou Spider | 402+65 | 140.42 MB | 31 Dec 2013 - 14:56 |
Unknown robot (identified by empty user agent string) | 342+1 | 713.60 MB | 31 Dec 2013 - 17:19 |
MSNBot | 256+31 | 35.11 MB | 31 Dec 2013 - 17:20 |
Unknown robot (identified by hit on 'robots.txt') | 0+168 | 15.91 KB | 31 Dec 2013 - 22:07 |
WordPress | 119 | 19.85 MB | 29 Dec 2013 - 06:11 |
Yahoo Slurp | 73+9 | 224.37 MB | 31 Dec 2013 - 09:03 |
MSNBot-media | 14+40 | 29.30 MB | 31 Dec 2013 - 16:22 |
FavIconizer | 52 | 434.13 KB | 30 Dec 2013 - 14:59 |
Unknown robot (identified by 'spider') | 26+24 | 228.11 KB | 31 Dec 2013 - 17:08 |
Java (Often spam bot) | 46+3 | 9.47 MB | 25 Dec 2013 - 07:56 |
legs | 27+11 | 40.89 MB | 04 Dec 2013 - 14:27 |
Unknown robot (identified by 'robot') | 28+9 | 358.87 KB | 28 Dec 2013 - 23:06 |
Exabot | 27+8 | 867.73 KB | 28 Dec 2013 - 18:54 |
Alexa (IA Archiver) | 25 | 129.62 MB | 30 Dec 2013 - 15:57 |
Mail.ru bot | 11+11 | 135.74 MB | 31 Dec 2013 - 16:44 |
Nutch | 8+8 | 41.53 MB | 13 Dec 2013 - 02:38 |
MJ12bot | 8+7 | 856.81 KB | 30 Dec 2013 - 18:49 |
SeznamBot | 7+6 | 3.15 MB | 30 Dec 2013 - 13:07 |
Python-urllib | 6+5 | 25.48 MB | 31 Dec 2013 - 13:15 |
Jakarta commons-httpclient | 10 | 4.36 MB | 15 Dec 2013 - 15:45 |
Turn It In | 6+4 | 894.45 KB | 15 Dec 2013 - 12:36 |
archive.org bot | 1+9 | 898.07 KB | 29 Dec 2013 - 19:52 |
FaceBook bot | 6 | 357.06 KB | 10 Dec 2013 - 13:43 |
larbin | 2+3 | 74.16 KB | 04 Dec 2013 - 13:14 |
Unknown robot (identified by '*bot') | 1+2 | 795.36 KB | 22 Dec 2013 - 14:49 |
Phantom | 3 | 16.34 MB | 27 Dec 2013 - 08:19 |
WGet tools | 3 | 10.47 MB | 09 Dec 2013 - 19:21 |
Unknown robot (identified by 'checker') | 3 | 40.04 MB | 19 Dec 2013 - 20:24 |
Netcraft | 2 | 8.35 KB | 10 Dec 2013 - 12:23 |
CFNetwork | 1 | 98.09 MB | 13 Dec 2013 - 12:43 |
Perl tool | 1 | 787.11 KB | 04 Dec 2013 - 22:06 |
yacy | 0+1 | 97 Bytes | 10 Dec 2013 - 02:48 |
MSIECrawler | 1 | 8.35 KB | 23 Dec 2013 - 19:36 |