| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 278293+1002 | 11.43 GB | 31 May 2011 - 23:59 |
| Yahoo Slurp | 7018+62 | 521.75 MB | 31 May 2011 - 23:57 |
| bender focused_crawler | 460+127 | 1.38 GB | 31 May 2011 - 23:52 |
| Unknown robot (identified by '*bot') | 249+25 | 3.93 MB | 31 May 2011 - 23:37 |
| Yandex bot | 194+23 | 356.23 MB | 31 May 2011 - 23:29 |
| Unknown robot (identified by 'bot*') | 505+146 | 942.77 MB | 31 May 2011 - 23:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+143 | 4.33 KB | 31 May 2011 - 23:06 |
| FaceBook bot | 134 | 7.29 MB | 31 May 2011 - 22:36 |
| Googlebot | 12933+31 | 9.45 GB | 31 May 2011 - 21:43 |
| Unknown robot (identified by empty user agent string) | 270+10 | 367.91 MB | 31 May 2011 - 20:51 |
| MSNBot-media | 4+2 | 222.13 KB | 31 May 2011 - 13:03 |
| MSNBot | 44+22 | 279.28 KB | 31 May 2011 - 06:22 |
| BaiDuSpider | 115+23 | 121.92 MB | 31 May 2011 - 02:54 |
| Unknown robot (identified by 'robot') | 20+5 | 3.49 MB | 30 May 2011 - 15:08 |
| Sogou Spider | 24+9 | 39.82 MB | 29 May 2011 - 20:44 |
| Unknown robot (identified by 'discovery') | 11+19 | 20.39 MB | 29 May 2011 - 17:06 |
| Netcraft | 4 | 13.85 KB | 28 May 2011 - 14:08 |
| VORTEX | 2 | 2.66 MB | 28 May 2011 - 09:06 |
| Motor | 4 | 21.46 MB | 27 May 2011 - 16:59 |
| MSIECrawler | 1 | 6.93 KB | 27 May 2011 - 15:34 |
| Python-urllib | 12 | 45.42 MB | 27 May 2011 - 11:21 |
| Java (Often spam bot) | 37 | 9.20 MB | 27 May 2011 - 01:39 |
| WGet tools | 66 | 189.49 MB | 26 May 2011 - 11:17 |
| MJ12bot | 3+3 | 19.68 KB | 26 May 2011 - 07:39 |
| Exabot | 1+1 | 6.96 KB | 24 May 2011 - 18:44 |
| Alexa (IA Archiver) | 4+3 | 54.30 KB | 23 May 2011 - 17:58 |
| lwp-trivial | 1 | 6.93 KB | 21 May 2011 - 23:16 |
| FavIconizer | 3 | 20.78 KB | 17 May 2011 - 15:37 |
| Jakarta commons-httpclient | 1 | 1.81 MB | 15 May 2011 - 15:20 |
| The web archive (IA Archiver) | 0+7 | 217 Bytes | 14 May 2011 - 20:44 |
| Nutch | 14+4 | 1.56 MB | 12 May 2011 - 23:18 |
| OutfoxBot/YodaoBot | 2 | 13.85 KB | 12 May 2011 - 03:15 |
| WordPress | 6 | 1.30 MB | 11 May 2011 - 22:08 |
| CFNetwork | 2 | 174.61 KB | 10 May 2011 - 20:19 |