33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 350177+3444 | 13.48 GB | 31 Oct 2011 - 23:59 |
BaiDuSpider | 1407+57 | 31.01 MB | 31 Oct 2011 - 23:57 |
Yandex bot | 772+28 | 435.15 MB | 31 Oct 2011 - 23:32 |
Googlebot | 17080+33 | 25.76 GB | 31 Oct 2011 - 23:20 |
Unknown robot (identified by empty user agent string) | 180+2 | 692.53 MB | 31 Oct 2011 - 23:02 |
Unknown robot (identified by 'bot*') | 2468+423 | 267.61 MB | 31 Oct 2011 - 21:24 |
Alexa (IA Archiver) | 64+31 | 31.45 MB | 31 Oct 2011 - 20:14 |
Unknown robot (identified by hit on 'robots.txt') | 0+150 | 4.54 KB | 31 Oct 2011 - 17:59 |
Sogou Spider | 92+6 | 25.99 MB | 31 Oct 2011 - 11:30 |
FaceBook bot | 10 | 1004.23 KB | 29 Oct 2011 - 22:57 |
Unknown robot (identified by 'robot') | 2805+19 | 53.72 MB | 29 Oct 2011 - 22:03 |
Unknown robot (identified by 'spider') | 10+8 | 2.50 MB | 29 Oct 2011 - 13:37 |
Netcraft | 2 | 7.02 KB | 28 Oct 2011 - 20:01 |
Nutch | 7+5 | 46.67 KB | 28 Oct 2011 - 19:02 |
MJ12bot | 6+6 | 1.33 MB | 28 Oct 2011 - 10:49 |
WGet tools | 4 | 11.92 MB | 28 Oct 2011 - 06:12 |
DoCoMo | 1+1 | 13.77 KB | 28 Oct 2011 - 06:12 |
Unknown robot (identified by '*bot') | 85+18 | 2.40 MB | 28 Oct 2011 - 04:08 |
bender focused_crawler | 7+4 | 33.76 MB | 27 Oct 2011 - 19:01 |
Unknown robot (identified by 'discovery') | 2 | 14.04 KB | 27 Oct 2011 - 13:17 |
WordPress | 18 | 30.10 MB | 26 Oct 2011 - 13:53 |
Yahoo Slurp | 6742+49 | 1.06 GB | 26 Oct 2011 - 12:49 |
Turn It In | 15+1 | 2.59 MB | 26 Oct 2011 - 06:45 |
CFNetwork | 9 | 1.63 GB | 25 Oct 2011 - 22:06 |
Java (Often spam bot) | 4 | 3.33 MB | 20 Oct 2011 - 12:49 |
Speedy Spider | 9+9 | 1.72 MB | 18 Oct 2011 - 13:46 |
Python-urllib | 2 | 14.04 KB | 17 Oct 2011 - 08:18 |
Jakarta commons-httpclient | 1 | 1.90 MB | 15 Oct 2011 - 17:00 |
yacy | 1+1 | 6.16 KB | 13 Oct 2011 - 21:09 |
Powermarks | 3 | 1.74 MB | 13 Oct 2011 - 03:36 |
legs | 3+3 | 40.04 MB | 12 Oct 2011 - 02:50 |
MSNBot-media | 2+1 | 96.65 KB | 10 Oct 2011 - 05:08 |
OutfoxBot/YodaoBot | 3+1 | 42.09 KB | 09 Oct 2011 - 21:00 |