| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 327711+2478 | 7.42 GB | 31 Aug 2011 - 23:59 |
| Googlebot | 13134+33 | 15.75 GB | 31 Aug 2011 - 23:50 |
| Yahoo Slurp | 7937+59 | 774.46 MB | 31 Aug 2011 - 23:43 |
| Unknown robot (identified by 'bot*') | 1366+98 | 406.45 MB | 30 Aug 2011 - 22:17 |
| Unknown robot (identified by 'robot') | 1246+8 | 32.03 MB | 29 Aug 2011 - 14:33 |
| BaiDuSpider | 826+48 | 684.69 MB | 31 Aug 2011 - 23:51 |
| Yandex bot | 568+28 | 4.64 GB | 31 Aug 2011 - 23:41 |
| bender focused_crawler | 398+14 | 1.17 GB | 20 Aug 2011 - 18:20 |
| Unknown robot (identified by 'discovery') | 269+98 | 51.17 MB | 31 Aug 2011 - 18:30 |
| Unknown robot (identified by empty user agent string) | 310+7 | 695.56 MB | 31 Aug 2011 - 14:39 |
| Java (Often spam bot) | 254 | 4.38 MB | 31 Aug 2011 - 18:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+139 | 4.21 KB | 31 Aug 2011 - 11:25 |
| Unknown robot (identified by '*bot') | 58+56 | 5.42 MB | 31 Aug 2011 - 21:53 |
| Nutch | 76+20 | 7.26 MB | 31 Aug 2011 - 11:03 |
| Heritrix | 48+1 | 716.34 KB | 29 Aug 2011 - 17:48 |
| archive.org bot | 43+2 | 8.31 MB | 12 Aug 2011 - 19:33 |
| Speedy Spider | 14+13 | 2.14 MB | 28 Aug 2011 - 18:15 |
| yacy | 16+2 | 189.78 KB | 08 Aug 2011 - 01:29 |
| MSNBot-media | 8+4 | 147.25 KB | 12 Aug 2011 - 16:17 |
| MJ12bot | 6+6 | 1.98 MB | 30 Aug 2011 - 04:10 |
| Sogou Spider | 8+1 | 5.63 MB | 20 Aug 2011 - 22:36 |
| WGet tools | 6 | 17.37 MB | 14 Aug 2011 - 23:14 |
| WordPress | 6 | 6.82 MB | 10 Aug 2011 - 02:17 |
| Perl tool | 5 | 8.05 MB | 14 Aug 2011 - 18:28 |
| Unknown robot (identified by 'spider') | 3+1 | 4.86 MB | 20 Aug 2011 - 00:14 |
| FaceBook bot | 4 | 170.60 KB | 30 Aug 2011 - 17:17 |
| Alexa (IA Archiver) | 3+1 | 9.16 MB | 01 Aug 2011 - 16:37 |
| Powermarks | 3 | 1.52 MB | 22 Aug 2011 - 20:40 |
| BSpider | 0+3 | 93 Bytes | 04 Aug 2011 - 20:56 |
| Python-urllib | 3 | 21.11 KB | 30 Aug 2011 - 04:01 |
| FavIconizer | 3 | 21.11 KB | 23 Aug 2011 - 14:03 |
| DoCoMo | 1+1 | 670.25 KB | 17 Aug 2011 - 01:31 |
| Exabot | 1+1 | 13.79 KB | 30 Aug 2011 - 16:05 |
| VORTEX | 2 | 2.48 MB | 08 Aug 2011 - 16:44 |