36 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 279964+529 | 6.54 GB | 28 Feb 2011 - 18:21 |
Googlebot | 12463+29 | 5.76 GB | 28 Feb 2011 - 23:58 |
Yahoo Slurp | 5361+60 | 645.33 MB | 28 Feb 2011 - 23:59 |
Yandex bot | 2680+26 | 1.02 GB | 26 Feb 2011 - 11:41 |
Unknown robot (identified by empty user agent string) | 1020+14 | 1.98 GB | 28 Feb 2011 - 18:29 |
Unknown robot (identified by 'bot*') | 431+74 | 50.72 MB | 28 Feb 2011 - 23:38 |
bender focused_crawler | 260+30 | 652.60 MB | 28 Feb 2011 - 21:12 |
legs | 204+6 | 15.93 MB | 12 Feb 2011 - 19:01 |
Jakarta commons-httpclient | 194 | 844.50 MB | 28 Feb 2011 - 23:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+117 | 3.54 KB | 28 Feb 2011 - 20:50 |
BaiDuSpider | 50+54 | 46.65 MB | 28 Feb 2011 - 23:18 |
Unknown robot (identified by 'robot') | 81+8 | 7.54 MB | 26 Feb 2011 - 23:04 |
MSNBot | 41+4 | 3.03 MB | 21 Feb 2011 - 07:26 |
Spiderman | 37+6 | 1.83 MB | 19 Feb 2011 - 19:18 |
Python-urllib | 35 | 66.10 MB | 15 Feb 2011 - 13:03 |
Sogou Spider | 26 | 35.94 MB | 28 Feb 2011 - 10:37 |
WordPress | 18 | 6.34 MB | 28 Feb 2011 - 12:43 |
Unknown robot (identified by 'discovery') | 7+9 | 11.98 MB | 27 Feb 2011 - 16:14 |
Motor | 15 | 23.45 MB | 15 Feb 2011 - 17:43 |
Nutch | 6+6 | 318.63 KB | 17 Feb 2011 - 00:55 |
Alexa (IA Archiver) | 6+6 | 16.31 MB | 27 Feb 2011 - 02:39 |
Java (Often spam bot) | 10 | 50.62 MB | 19 Feb 2011 - 10:34 |
FaceBook bot | 4+4 | 7.24 MB | 26 Feb 2011 - 20:37 |
DoCoMo | 6+2 | 43.89 KB | 06 Feb 2011 - 19:00 |
Unknown robot (identified by 'spider') | 3+3 | 20.87 KB | 27 Feb 2011 - 03:41 |
MSNBot-media | 4+2 | 42.35 KB | 23 Feb 2011 - 17:29 |
Powermarks | 5 | 31.31 KB | 02 Feb 2011 - 16:16 |
WGet tools | 5 | 21.97 MB | 24 Feb 2011 - 13:03 |
Ask | 2+2 | 8.69 MB | 11 Feb 2011 - 20:06 |
Speedy Spider | 2+2 | 12.49 KB | 25 Feb 2011 - 10:13 |
The web archive (IA Archiver) | 0+3 | 93 Bytes | 22 Feb 2011 - 00:52 |
CFNetwork | 3 | 9.64 MB | 21 Feb 2011 - 11:44 |
FavIconizer | 2 | 13.85 KB | 25 Feb 2011 - 12:33 |
UCSD Crawl | 1 | 20.95 MB | 12 Feb 2011 - 12:35 |
Perl tool | 1 | 6.93 KB | 19 Feb 2011 - 13:36 |
Netcraft | 1 | 0 | 23 Feb 2011 - 11:31 |