| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| archive.org bot | 28404+64 | 5.94 GB | 28 Sep 2015 - 11:03 |
| Unknown robot (identified by 'bot*') | 27578+465 | 13.81 GB | 30 Sep 2015 - 23:59 |
| Googlebot | 19725+674 | 26.63 GB | 30 Sep 2015 - 23:59 |
| Yahoo Slurp | 13407+63 | 3.99 GB | 30 Sep 2015 - 23:59 |
| Unknown robot (identified by 'crawl') | 7466+81 | 268.22 MB | 30 Sep 2015 - 23:34 |
| BaiDuSpider | 3532 | 739.82 MB | 30 Sep 2015 - 23:59 |
| Yandex bot | 1835+111 | 1.57 GB | 30 Sep 2015 - 23:55 |
| Nutch | 744+54 | 53.53 MB | 29 Sep 2015 - 05:45 |
| psbot | 488+17 | 7.78 MB | 10 Sep 2015 - 21:03 |
| Sogou Spider | 323+24 | 116.15 MB | 30 Sep 2015 - 20:13 |
| FaceBook bot | 298 | 9.91 MB | 30 Sep 2015 - 10:46 |
| Unknown robot (identified by hit on 'robots.txt') | 0+290 | 27.47 KB | 30 Sep 2015 - 19:16 |
| Unknown robot (identified by empty user agent string) | 246+12 | 73.72 MB | 30 Sep 2015 - 06:11 |
| Heritrix | 113+2 | 69.67 MB | 07 Sep 2015 - 12:34 |
| WordPress | 73 | 4.45 MB | 30 Sep 2015 - 12:11 |
| FavIconizer | 43 | 367.89 KB | 30 Sep 2015 - 23:17 |
| Unknown robot (identified by 'robot') | 20+22 | 11.50 MB | 29 Sep 2015 - 16:08 |
| Unknown robot (identified by 'spider') | 21+13 | 22.07 MB | 29 Sep 2015 - 13:09 |
| Phantom | 34 | 2.27 MB | 27 Sep 2015 - 16:03 |
| WGet tools | 34 | 217.03 MB | 30 Sep 2015 - 06:13 |
| MJ12bot | 25+3 | 4.26 MB | 29 Sep 2015 - 07:20 |
| Exabot | 16+8 | 268.63 KB | 30 Sep 2015 - 07:13 |
| Java (Often spam bot) | 22+1 | 981.03 KB | 30 Sep 2015 - 18:01 |
| HTTrack off-line browser | 21+1 | 24.85 MB | 21 Sep 2015 - 04:36 |
| Mail.ru bot | 5+10 | 23.50 MB | 24 Sep 2015 - 13:51 |
| Alexa (IA Archiver) | 7+8 | 11.49 MB | 29 Sep 2015 - 22:19 |
| Sift | 13 | 206.84 KB | 27 Sep 2015 - 17:44 |
| larbin | 5+4 | 32.60 MB | 10 Sep 2015 - 10:55 |
| SeznamBot | 3+3 | 18.03 MB | 27 Sep 2015 - 05:23 |
| Python-urllib | 3+3 | 14.41 MB | 28 Sep 2015 - 20:00 |
| yacy | 2+2 | 31.73 MB | 30 Sep 2015 - 15:16 |
| Turn It In | 1+2 | 194 Bytes | 28 Sep 2015 - 20:15 |
| MSNBot | 1+1 | 915 Bytes | 11 Sep 2015 - 00:39 |
| Motor | 2 | 8.56 KB | 03 Sep 2015 - 04:30 |
| CsCrawler | 1+1 | 8.65 KB | 21 Sep 2015 - 17:41 |
| Netcraft | 2 | 8.56 KB | 08 Sep 2015 - 16:49 |
| Y!J Yahoo Japan | 0+1 | 97 Bytes | 23 Sep 2015 - 15:59 |
| Feedfetcher-Google | 1 | 1.36 MB | 14 Sep 2015 - 09:24 |