25 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 4377+67 | 498.37 MB | 30 Nov 2010 - 23:44 |
Googlebot | 10708+38 | 3.59 GB | 30 Nov 2010 - 23:43 |
Ask | 359+48 | 776.94 MB | 30 Nov 2010 - 23:29 |
Unknown robot (identified by 'crawl') | 219560+701 | 14.29 GB | 30 Nov 2010 - 21:39 |
Yandex bot | 1149+17 | 1.79 GB | 30 Nov 2010 - 20:54 |
Unknown robot (identified by empty user agent string) | 120+7 | 135.41 MB | 30 Nov 2010 - 18:12 |
Unknown robot (identified by 'bot*') | 14+13 | 90.78 KB | 30 Nov 2010 - 13:27 |
BaiDuSpider | 51+46 | 73.19 MB | 30 Nov 2010 - 12:02 |
Jakarta commons-httpclient | 93 | 582.51 MB | 30 Nov 2010 - 10:22 |
Unknown robot (identified by hit on 'robots.txt') | 0+94 | 2.85 KB | 30 Nov 2010 - 07:51 |
Unknown robot (identified by 'robot') | 3+3 | 3.24 MB | 30 Nov 2010 - 05:46 |
Unknown robot (identified by 'spider') | 207+3 | 27.16 MB | 29 Nov 2010 - 13:57 |
DoCoMo | 2+1 | 67.94 KB | 29 Nov 2010 - 08:30 |
Java (Often spam bot) | 35 | 14.81 MB | 28 Nov 2010 - 15:30 |
Sogou Spider | 14 | 411.47 KB | 27 Nov 2010 - 07:06 |
MSNBot | 7+4 | 42.80 KB | 26 Nov 2010 - 08:35 |
Netcraft | 4 | 6.92 KB | 26 Nov 2010 - 07:20 |
Heritrix | 2035+9 | 21.34 MB | 25 Nov 2010 - 15:46 |
WGet tools | 1 | 2.07 MB | 25 Nov 2010 - 07:34 |
The web archive (IA Archiver) | 0+1 | 31 Bytes | 24 Nov 2010 - 20:24 |
Alexa (IA Archiver) | 2+2 | 67.97 KB | 19 Nov 2010 - 09:56 |
Motor | 2 | 15.14 MB | 18 Nov 2010 - 09:07 |
Unknown robot (identified by 'discovery') | 2 | 6.93 KB | 16 Nov 2010 - 08:55 |
Spiderman | 3+1 | 25.79 KB | 15 Nov 2010 - 11:18 |
MJ12bot | 2+1 | 67.94 KB | 14 Nov 2010 - 22:31 |