34 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 212552+508 | 2.86 GB | 30 Apr 2011 - 23:56 |
Googlebot | 13412+32 | 7.28 GB | 30 Apr 2011 - 23:59 |
Yahoo Slurp | 5462+64 | 301.07 MB | 30 Apr 2011 - 23:53 |
Heritrix | 2163+4 | 20.64 MB | 21 Apr 2011 - 22:40 |
Unknown robot (identified by 'bot*') | 1265+78 | 2.13 GB | 30 Apr 2011 - 18:54 |
Unknown robot (identified by 'robot') | 1132+6 | 29.57 MB | 29 Apr 2011 - 14:35 |
bender focused_crawler | 285+46 | 880.51 MB | 30 Apr 2011 - 23:37 |
BaiDuSpider | 174+56 | 380.97 MB | 30 Apr 2011 - 21:30 |
Yandex bot | 191+26 | 110.45 MB | 30 Apr 2011 - 11:21 |
Unknown robot (identified by empty user agent string) | 199+11 | 311.51 MB | 30 Apr 2011 - 23:25 |
Unknown robot (identified by hit on 'robots.txt') | 0+143 | 4.86 KB | 30 Apr 2011 - 16:44 |
WGet tools | 69 | 187.50 MB | 25 Apr 2011 - 18:33 |
FaceBook bot | 35+27 | 77.65 MB | 17 Apr 2011 - 21:46 |
MSNBot | 38+19 | 239.47 KB | 19 Apr 2011 - 04:26 |
Java (Often spam bot) | 40 | 18.97 MB | 22 Apr 2011 - 01:41 |
OutfoxBot/YodaoBot | 31 | 214.73 KB | 12 Apr 2011 - 00:18 |
Nutch | 20+11 | 1.60 MB | 28 Apr 2011 - 14:23 |
Sogou Spider | 22+5 | 45.25 MB | 28 Apr 2011 - 19:51 |
ichiro | 12+2 | 1.30 MB | 09 Apr 2011 - 07:33 |
Motor | 12 | 26.22 MB | 30 Apr 2011 - 10:01 |
Speedy Spider | 6+6 | 63.59 KB | 29 Apr 2011 - 20:45 |
HTMLParser | 11 | 26.87 MB | 19 Apr 2011 - 15:40 |
Alexa (IA Archiver) | 4+4 | 54.70 KB | 29 Apr 2011 - 22:15 |
Unknown robot (identified by 'spider') | 3+3 | 20.90 KB | 16 Apr 2011 - 22:32 |
The web archive (IA Archiver) | 0+4 | 124 Bytes | 30 Apr 2011 - 12:12 |
CFNetwork | 4 | 7.86 MB | 26 Apr 2011 - 21:11 |
WordPress | 4 | 3.49 MB | 24 Apr 2011 - 13:05 |
Turn It In | 2+1 | 12.62 KB | 21 Apr 2011 - 17:46 |
Perl tool | 3 | 1.48 MB | 26 Apr 2011 - 03:52 |
Python-urllib | 3 | 8.49 MB | 22 Apr 2011 - 06:45 |
MJ12bot | 1+1 | 6.96 KB | 07 Apr 2011 - 08:55 |
Netcraft | 2 | 6.93 KB | 28 Apr 2011 - 12:19 |
Jakarta commons-httpclient | 1 | 6.93 KB | 12 Apr 2011 - 16:33 |
FavIconizer | 1 | 6.93 KB | 26 Apr 2011 - 16:05 |