34 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 327711+2478 | 7.42 GB | 31 Aug 2011 - 23:59 |
BaiDuSpider | 826+48 | 684.69 MB | 31 Aug 2011 - 23:51 |
Googlebot | 13134+33 | 15.75 GB | 31 Aug 2011 - 23:50 |
Yahoo Slurp | 7937+59 | 774.46 MB | 31 Aug 2011 - 23:43 |
Yandex bot | 568+28 | 4.64 GB | 31 Aug 2011 - 23:41 |
Unknown robot (identified by '*bot') | 58+56 | 5.42 MB | 31 Aug 2011 - 21:53 |
Unknown robot (identified by 'discovery') | 269+98 | 51.17 MB | 31 Aug 2011 - 18:30 |
Java (Often spam bot) | 254 | 4.38 MB | 31 Aug 2011 - 18:09 |
Unknown robot (identified by empty user agent string) | 310+7 | 695.56 MB | 31 Aug 2011 - 14:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+139 | 4.21 KB | 31 Aug 2011 - 11:25 |
Nutch | 76+20 | 7.26 MB | 31 Aug 2011 - 11:03 |
Unknown robot (identified by 'bot*') | 1366+98 | 406.45 MB | 30 Aug 2011 - 22:17 |
FaceBook bot | 4 | 170.60 KB | 30 Aug 2011 - 17:17 |
Exabot | 1+1 | 13.79 KB | 30 Aug 2011 - 16:05 |
MJ12bot | 6+6 | 1.98 MB | 30 Aug 2011 - 04:10 |
Python-urllib | 3 | 21.11 KB | 30 Aug 2011 - 04:01 |
Heritrix | 48+1 | 716.34 KB | 29 Aug 2011 - 17:48 |
Unknown robot (identified by 'robot') | 1246+8 | 32.03 MB | 29 Aug 2011 - 14:33 |
Speedy Spider | 14+13 | 2.14 MB | 28 Aug 2011 - 18:15 |
FavIconizer | 3 | 21.11 KB | 23 Aug 2011 - 14:03 |
Powermarks | 3 | 1.52 MB | 22 Aug 2011 - 20:40 |
Sogou Spider | 8+1 | 5.63 MB | 20 Aug 2011 - 22:36 |
bender focused_crawler | 398+14 | 1.17 GB | 20 Aug 2011 - 18:20 |
Unknown robot (identified by 'spider') | 3+1 | 4.86 MB | 20 Aug 2011 - 00:14 |
DoCoMo | 1+1 | 670.25 KB | 17 Aug 2011 - 01:31 |
WGet tools | 6 | 17.37 MB | 14 Aug 2011 - 23:14 |
Perl tool | 5 | 8.05 MB | 14 Aug 2011 - 18:28 |
archive.org bot | 43+2 | 8.31 MB | 12 Aug 2011 - 19:33 |
MSNBot-media | 8+4 | 147.25 KB | 12 Aug 2011 - 16:17 |
WordPress | 6 | 6.82 MB | 10 Aug 2011 - 02:17 |
VORTEX | 2 | 2.48 MB | 08 Aug 2011 - 16:44 |
yacy | 16+2 | 189.78 KB | 08 Aug 2011 - 01:29 |
BSpider | 0+3 | 93 Bytes | 04 Aug 2011 - 20:56 |
Alexa (IA Archiver) | 3+1 | 9.16 MB | 01 Aug 2011 - 16:37 |