| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 20807+209 | 60.76 GB | 31 Dec 2013 - 23:59 |
| Googlebot | 20895+713 | 37.50 GB | 31 Dec 2013 - 23:59 |
| BaiDuSpider | 2042+1 | 467.05 MB | 31 Dec 2013 - 23:59 |
| Yandex bot | 7132+60 | 7.71 GB | 31 Dec 2013 - 23:50 |
| Unknown robot (identified by hit on 'robots.txt') | 0+168 | 15.91 KB | 31 Dec 2013 - 22:07 |
| NG 1.x (Exalead) | 727 | 5.13 GB | 31 Dec 2013 - 19:28 |
| psbot | 598+75 | 11.01 MB | 31 Dec 2013 - 17:54 |
| MSNBot | 256+31 | 35.11 MB | 31 Dec 2013 - 17:20 |
| Unknown robot (identified by empty user agent string) | 342+1 | 713.60 MB | 31 Dec 2013 - 17:19 |
| Unknown robot (identified by 'spider') | 26+24 | 228.11 KB | 31 Dec 2013 - 17:08 |
| Mail.ru bot | 11+11 | 135.74 MB | 31 Dec 2013 - 16:44 |
| MSNBot-media | 14+40 | 29.30 MB | 31 Dec 2013 - 16:22 |
| Sogou Spider | 402+65 | 140.42 MB | 31 Dec 2013 - 14:56 |
| Python-urllib | 6+5 | 25.48 MB | 31 Dec 2013 - 13:15 |
| Yahoo Slurp | 73+9 | 224.37 MB | 31 Dec 2013 - 09:03 |
| MJ12bot | 8+7 | 856.81 KB | 30 Dec 2013 - 18:49 |
| Alexa (IA Archiver) | 25 | 129.62 MB | 30 Dec 2013 - 15:57 |
| Unknown robot (identified by 'crawl') | 1979+14 | 60.60 MB | 30 Dec 2013 - 15:07 |
| FavIconizer | 52 | 434.13 KB | 30 Dec 2013 - 14:59 |
| SeznamBot | 7+6 | 3.15 MB | 30 Dec 2013 - 13:07 |
| archive.org bot | 1+9 | 898.07 KB | 29 Dec 2013 - 19:52 |
| WordPress | 119 | 19.85 MB | 29 Dec 2013 - 06:11 |
| Unknown robot (identified by 'robot') | 28+9 | 358.87 KB | 28 Dec 2013 - 23:06 |
| Exabot | 27+8 | 867.73 KB | 28 Dec 2013 - 18:54 |
| Phantom | 3 | 16.34 MB | 27 Dec 2013 - 08:19 |
| Java (Often spam bot) | 46+3 | 9.47 MB | 25 Dec 2013 - 07:56 |
| MSIECrawler | 1 | 8.35 KB | 23 Dec 2013 - 19:36 |
| Unknown robot (identified by '*bot') | 1+2 | 795.36 KB | 22 Dec 2013 - 14:49 |
| Unknown robot (identified by 'checker') | 3 | 40.04 MB | 19 Dec 2013 - 20:24 |
| Jakarta commons-httpclient | 10 | 4.36 MB | 15 Dec 2013 - 15:45 |
| Turn It In | 6+4 | 894.45 KB | 15 Dec 2013 - 12:36 |
| CFNetwork | 1 | 98.09 MB | 13 Dec 2013 - 12:43 |
| Nutch | 8+8 | 41.53 MB | 13 Dec 2013 - 02:38 |
| FaceBook bot | 6 | 357.06 KB | 10 Dec 2013 - 13:43 |
| Netcraft | 2 | 8.35 KB | 10 Dec 2013 - 12:23 |
| yacy | 0+1 | 97 Bytes | 10 Dec 2013 - 02:48 |
| WGet tools | 3 | 10.47 MB | 09 Dec 2013 - 19:21 |
| Perl tool | 1 | 787.11 KB | 04 Dec 2013 - 22:06 |
| legs | 27+11 | 40.89 MB | 04 Dec 2013 - 14:27 |
| larbin | 2+3 | 74.16 KB | 04 Dec 2013 - 13:14 |