37 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 349268+2585 | 10.69 GB | 31 Jul 2011 - 23:58 |
Googlebot | 15443+36 | 16.41 GB | 31 Jul 2011 - 23:59 |
Yahoo Slurp | 7876+63 | 494.04 MB | 31 Jul 2011 - 23:57 |
BaiDuSpider | 5650+33 | 69.71 MB | 31 Jul 2011 - 23:08 |
Unknown robot (identified by 'bot*') | 1609+189 | 458.75 MB | 31 Jul 2011 - 16:44 |
bender focused_crawler | 1160+59 | 3.68 GB | 31 Jul 2011 - 09:19 |
Java (Often spam bot) | 490 | 9.28 MB | 23 Jul 2011 - 23:37 |
Unknown robot (identified by empty user agent string) | 361+14 | 634.68 MB | 31 Jul 2011 - 22:29 |
Yandex bot | 307+30 | 177.89 MB | 31 Jul 2011 - 21:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+158 | 4.78 KB | 31 Jul 2011 - 22:44 |
Nutch | 110+21 | 11.10 MB | 27 Jul 2011 - 21:52 |
Unknown robot (identified by 'robot') | 82+8 | 11.42 MB | 25 Jul 2011 - 02:43 |
Unknown robot (identified by '*bot') | 32+57 | 2.03 MB | 31 Jul 2011 - 17:50 |
Sogou Spider | 46+1 | 31.23 MB | 30 Jul 2011 - 22:50 |
archive.org bot | 41+1 | 6.05 MB | 19 Jul 2011 - 09:54 |
Web Core / Roots | 40 | 1.38 MB | 02 Jul 2011 - 10:52 |
BSpider | 0+26 | 806 Bytes | 31 Jul 2011 - 21:50 |
FaceBook bot | 22 | 1.15 MB | 26 Jul 2011 - 22:00 |
WGet tools | 21 | 32.36 MB | 28 Jul 2011 - 15:38 |
DoCoMo | 13+7 | 5.34 MB | 30 Jul 2011 - 13:29 |
WordPress | 18 | 11.98 MB | 27 Jul 2011 - 13:45 |
legs | 6+8 | 48.19 KB | 28 Jul 2011 - 13:12 |
Speedy Spider | 7+7 | 329.29 KB | 23 Jul 2011 - 19:58 |
Turn It In | 9+1 | 1.28 MB | 14 Jul 2011 - 11:51 |
Unknown robot (identified by 'discovery') | 0+8 | 248 Bytes | 30 Jul 2011 - 06:26 |
MJ12bot | 4+4 | 25.99 KB | 31 Jul 2011 - 16:39 |
Powermarks | 6 | 2.87 MB | 27 Jul 2011 - 23:46 |
Unknown robot (identified by 'spider') | 3+3 | 21.20 KB | 30 Jul 2011 - 16:12 |
Alexa (IA Archiver) | 3+3 | 40.85 KB | 31 Jul 2011 - 10:50 |
Steeler | 3+1 | 6.65 MB | 22 Jul 2011 - 10:43 |
Motor | 4 | 15.75 MB | 29 Jul 2011 - 14:37 |
larbin | 2+2 | 19.71 KB | 26 Jul 2011 - 07:06 |
CFNetwork | 3 | 11.58 MB | 21 Jul 2011 - 00:51 |
Netcraft | 3 | 14.09 KB | 28 Jul 2011 - 22:19 |
Perl tool | 1 | 2.97 MB | 31 Jul 2011 - 18:32 |
HTTrack off-line browser | 0+1 | 31 Bytes | 21 Jul 2011 - 06:03 |
Python-urllib | 1 | 7.22 MB | 24 Jul 2011 - 16:11 |