| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by empty user agent string) | 704+1 | 1.35 GB | 31 May 2014 - 23:59 |
| Unknown robot (identified by 'bot*') | 36273+277 | 96.91 GB | 31 May 2014 - 23:59 |
| Googlebot | 21366+706 | 45.05 GB | 31 May 2014 - 23:54 |
| BaiDuSpider | 2639+2 | 2.22 GB | 31 May 2014 - 23:51 |
| Yandex bot | 8318+58 | 20.00 GB | 31 May 2014 - 23:39 |
| Yahoo Slurp | 5370+33 | 3.08 GB | 31 May 2014 - 23:37 |
| Unknown robot (identified by 'spider') | 42+22 | 35.35 MB | 31 May 2014 - 22:03 |
| Java (Often spam bot) | 808+8 | 118.08 MB | 31 May 2014 - 21:03 |
| CFNetwork | 3 | 5.87 MB | 31 May 2014 - 20:27 |
| Unknown robot (identified by 'robot') | 82+32 | 228.55 MB | 31 May 2014 - 19:01 |
| FavIconizer | 50 | 417.43 KB | 31 May 2014 - 18:49 |
| archive.org bot | 3+19 | 7.53 MB | 31 May 2014 - 17:42 |
| Sogou Spider | 312+42 | 405.07 MB | 31 May 2014 - 15:46 |
| NG 1.x (Exalead) | 238 | 1.04 GB | 31 May 2014 - 11:51 |
| WordPress | 132 | 64.39 MB | 31 May 2014 - 11:33 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3084 | 292.14 KB | 31 May 2014 - 11:16 |
| Exabot | 25+14 | 332.28 KB | 31 May 2014 - 03:36 |
| Python-urllib | 6+7 | 35.97 MB | 30 May 2014 - 21:15 |
| Mail.ru bot | 7+7 | 26.51 KB | 30 May 2014 - 02:08 |
| WGet tools | 15 | 57.26 MB | 29 May 2014 - 15:42 |
| Phantom | 36 | 33.59 MB | 29 May 2014 - 08:21 |
| FaceBook bot | 17+1 | 4.50 MB | 28 May 2014 - 22:54 |
| MJ12bot | 38+13 | 5.17 MB | 28 May 2014 - 10:02 |
| Perl tool | 6 | 8.54 MB | 27 May 2014 - 08:14 |
| psbot | 223+16 | 8.22 MB | 27 May 2014 - 04:20 |
| yacy | 1+1 | 515.94 KB | 26 May 2014 - 07:34 |
| SeznamBot | 12+9 | 36.95 MB | 25 May 2014 - 15:59 |
| MSNBot-media | 11+12 | 92.12 KB | 25 May 2014 - 15:51 |
| MSNBot | 3+6 | 4.25 MB | 25 May 2014 - 00:42 |
| Unknown robot (identified by 'crawl') | 1155+41 | 44.63 MB | 24 May 2014 - 00:01 |
| Alexa (IA Archiver) | 2+1 | 5.53 MB | 20 May 2014 - 13:04 |
| Jakarta commons-httpclient | 1 | 1.87 MB | 15 May 2014 - 19:42 |
| Netcraft | 2 | 8.35 KB | 15 May 2014 - 10:01 |
| HTTrack off-line browser | 2 | 18.81 KB | 14 May 2014 - 10:42 |
| TITAN | 1 | 1.90 MB | 12 May 2014 - 21:34 |
| Heritrix | 257+1 | 8.96 MB | 12 May 2014 - 10:29 |