40 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 8787+49 | 5.03 GB | 30 Sep 2012 - 23:58 |
BaiDuSpider | 11004+86 | 1.42 GB | 30 Sep 2012 - 23:57 |
Unknown robot (identified by 'bot*') | 20383+154 | 29.83 GB | 30 Sep 2012 - 23:55 |
Googlebot | 18051+42 | 26.49 GB | 30 Sep 2012 - 23:54 |
Sogou Spider | 267+6 | 88.32 MB | 30 Sep 2012 - 23:52 |
Unknown robot (identified by empty user agent string) | 157+11 | 302.25 MB | 30 Sep 2012 - 23:00 |
Unknown robot (identified by hit on 'robots.txt') | 0+215 | 6.51 KB | 30 Sep 2012 - 22:27 |
Java (Often spam bot) | 448+9 | 200.26 MB | 30 Sep 2012 - 21:51 |
OutfoxBot/YodaoBot | 138 | 956.97 KB | 30 Sep 2012 - 20:49 |
Unknown robot (identified by 'discovery') | 8024+12 | 21.75 GB | 30 Sep 2012 - 18:26 |
Unknown robot (identified by 'spider') | 189+6 | 433.93 MB | 30 Sep 2012 - 18:15 |
FaceBook bot | 27 | 2.45 MB | 30 Sep 2012 - 17:51 |
Unknown robot (identified by 'crawl') | 140334+9200 | 2.96 GB | 30 Sep 2012 - 13:33 |
BSpider | 106+28 | 4.01 MB | 30 Sep 2012 - 11:45 |
MSNBot | 127+9 | 15.86 MB | 30 Sep 2012 - 08:27 |
Unknown robot (identified by 'robot') | 65+6 | 195.30 MB | 30 Sep 2012 - 07:12 |
CFNetwork | 2 | 173.60 KB | 30 Sep 2012 - 04:53 |
MJ12bot | 32+6 | 1.13 MB | 30 Sep 2012 - 03:50 |
Exabot | 19+9 | 243.40 KB | 29 Sep 2012 - 14:10 |
Mail.ru bot | 70+12 | 329.77 MB | 28 Sep 2012 - 18:38 |
Alexa (IA Archiver) | 3+13 | 85.87 KB | 28 Sep 2012 - 15:11 |
Powermarks | 1 | 2.97 MB | 27 Sep 2012 - 09:33 |
Phantom | 2 | 14.14 MB | 27 Sep 2012 - 09:02 |
Unknown robot (identified by '*bot') | 4+4 | 1.35 MB | 25 Sep 2012 - 14:33 |
FavIconizer | 3 | 20.80 KB | 25 Sep 2012 - 13:32 |
Yahoo Slurp | 27+3 | 1.69 MB | 23 Sep 2012 - 06:33 |
MSNBot-media | 1+1 | 93.21 KB | 22 Sep 2012 - 11:22 |
Motor | 1 | 6.93 KB | 21 Sep 2012 - 12:26 |
psbot | 193+8 | 3.19 MB | 20 Sep 2012 - 18:42 |
bender focused_crawler | 8+4 | 43.74 MB | 20 Sep 2012 - 18:37 |
Web Core / Roots | 3 | 0 | 19 Sep 2012 - 07:46 |
WordPress | 24 | 9.84 MB | 17 Sep 2012 - 04:48 |
archive.org bot | 3+3 | 15.33 MB | 15 Sep 2012 - 00:26 |
Calif | 1 | 0 | 14 Sep 2012 - 17:07 |
Jakarta commons-httpclient | 1 | 1.90 MB | 11 Sep 2012 - 20:12 |
NG 1.x (Exalead) | 1 | 5.84 MB | 11 Sep 2012 - 11:42 |
HTMLParser | 2 | 10.52 KB | 10 Sep 2012 - 07:10 |
Netcraft | 2 | 6.93 KB | 08 Sep 2012 - 20:13 |
legs | 80+40 | 1013.47 KB | 05 Sep 2012 - 23:41 |
Heritrix | 2+1 | 72.45 KB | 02 Sep 2012 - 08:36 |