36 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 424858+10661 | 40.58 GB | 31 Jan 2012 - 23:58 |
Python-urllib | 62105+8 | 31.87 GB | 22 Jan 2012 - 22:36 |
Googlebot | 15927+39 | 24.71 GB | 31 Jan 2012 - 23:25 |
Unknown robot (identified by 'bot*') | 3642+519 | 2.30 GB | 31 Jan 2012 - 22:49 |
BaiDuSpider | 2227+33 | 1.05 GB | 31 Jan 2012 - 23:48 |
Yandex bot | 1627+27 | 3.96 GB | 31 Jan 2012 - 17:02 |
Unknown robot (identified by 'robot') | 1494+4 | 145.14 MB | 23 Jan 2012 - 23:05 |
Nutch | 968+241 | 2.14 GB | 31 Jan 2012 - 04:21 |
OutfoxBot/YodaoBot | 323+51 | 1.52 MB | 31 Jan 2012 - 19:32 |
Unknown robot (identified by empty user agent string) | 350+3 | 1.33 GB | 31 Jan 2012 - 21:53 |
Unknown robot (identified by 'discovery') | 310+13 | 327.47 MB | 31 Jan 2012 - 20:04 |
bender focused_crawler | 284+5 | 2.09 GB | 16 Jan 2012 - 18:41 |
Java (Often spam bot) | 181 | 11.44 MB | 30 Jan 2012 - 12:43 |
Sogou Spider | 161+2 | 33.59 MB | 31 Jan 2012 - 23:50 |
Unknown robot (identified by hit on 'robots.txt') | 0+106 | 3.21 KB | 30 Jan 2012 - 11:35 |
WordPress | 77 | 34.64 MB | 31 Jan 2012 - 09:39 |
FaceBook bot | 35 | 4.17 MB | 30 Jan 2012 - 21:01 |
MSNBot | 18+16 | 216.74 KB | 31 Jan 2012 - 04:24 |
GigaBot | 15+15 | 105.79 KB | 30 Jan 2012 - 17:02 |
Alexa (IA Archiver) | 9+14 | 768.81 KB | 26 Jan 2012 - 01:08 |
Yahoo Slurp | 12+6 | 3.55 MB | 24 Jan 2012 - 15:28 |
Exabot | 9+4 | 171.20 KB | 21 Jan 2012 - 14:16 |
MJ12bot | 6+6 | 1.34 MB | 31 Jan 2012 - 23:17 |
Unknown robot (identified by '*bot') | 5+6 | 1.34 MB | 31 Jan 2012 - 23:34 |
Unknown robot (identified by 'spider') | 8+2 | 35.17 KB | 24 Jan 2012 - 02:39 |
MSNBot-media | 6+3 | 308.36 KB | 28 Jan 2012 - 01:45 |
Powermarks | 8 | 3.25 MB | 29 Jan 2012 - 11:31 |
ichiro | 5+1 | 80.42 KB | 26 Jan 2012 - 08:51 |
Speedy Spider | 2+2 | 1.67 MB | 28 Jan 2012 - 05:48 |
archive.org bot | 2+1 | 13.42 KB | 21 Jan 2012 - 23:27 |
psbot | 1+1 | 80.09 KB | 26 Jan 2012 - 00:34 |
FavIconizer | 2 | 14.04 KB | 19 Jan 2012 - 09:37 |
Jakarta commons-httpclient | 1 | 1.55 MB | 31 Jan 2012 - 11:44 |
WGet tools | 1 | 2.05 MB | 25 Jan 2012 - 00:17 |
CFNetwork | 1 | 26.31 KB | 31 Jan 2012 - 17:46 |
Netcraft | 1 | 0 | 27 Jan 2012 - 12:03 |