| 35 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 30373+632 | 37.66 GB | 30 Sep 2016 - 23:59 |
| Unknown robot (identified by 'bot*') | 21960+423 | 12.40 GB | 30 Sep 2016 - 23:49 |
| Java (Often spam bot) | 10447 | 242.04 MB | 30 Sep 2016 - 23:47 |
| Yahoo Slurp | 8926+72 | 2.28 GB | 30 Sep 2016 - 23:52 |
| BaiDuSpider | 6557+16 | 3.34 GB | 30 Sep 2016 - 23:51 |
| Yandex bot | 6413+108 | 4.38 GB | 30 Sep 2016 - 23:45 |
| Unknown robot (identified by 'crawl') | 4561+65 | 1.48 GB | 30 Sep 2016 - 14:32 |
| Web Core / Roots | 3865 | 65.74 MB | 24 Sep 2016 - 21:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+391 | 37.08 KB | 30 Sep 2016 - 14:10 |
| Sogou Spider | 302+31 | 12.69 MB | 30 Sep 2016 - 23:48 |
| Unknown robot (identified by empty user agent string) | 252+9 | 99.28 MB | 30 Sep 2016 - 21:34 |
| psbot | 86+6 | 3.51 MB | 17 Sep 2016 - 18:19 |
| Unknown robot (identified by 'robot') | 50+31 | 117.20 MB | 29 Sep 2016 - 17:03 |
| FavIconizer | 58 | 35.87 MB | 29 Sep 2016 - 22:17 |
| FaceBook bot | 38 | 2.51 MB | 30 Sep 2016 - 19:21 |
| yacy | 23+11 | 319.90 MB | 15 Sep 2016 - 00:33 |
| Nutch | 14+18 | 1.27 MB | 18 Sep 2016 - 04:49 |
| MSNBot-media | 27 | 3.71 MB | 29 Sep 2016 - 13:09 |
| archive.org bot | 21+3 | 62.29 KB | 16 Sep 2016 - 19:28 |
| Unknown robot (identified by 'spider') | 19+3 | 7.83 MB | 29 Sep 2016 - 11:29 |
| Alexa (IA Archiver) | 11+10 | 2.40 MB | 29 Sep 2016 - 08:02 |
| Phantom | 18 | 3.51 MB | 14 Sep 2016 - 10:19 |
| SeznamBot | 6+7 | 4.86 MB | 20 Sep 2016 - 16:38 |
| Exabot | 7+5 | 75.45 KB | 28 Sep 2016 - 20:55 |
| Perl tool | 12 | 9.63 MB | 29 Sep 2016 - 09:12 |
| WGet tools | 6 | 88.87 MB | 27 Sep 2016 - 17:24 |
| Python-urllib | 6 | 23.41 MB | 21 Sep 2016 - 13:47 |
| Unknown robot (identified by 'checker') | 5 | 0 | 30 Sep 2016 - 18:10 |
| HTTrack off-line browser | 4 | 19.08 MB | 22 Sep 2016 - 07:10 |
| CFNetwork | 2+1 | 125.70 MB | 16 Sep 2016 - 17:13 |
| Speedy Spider | 2+1 | 838.83 KB | 28 Sep 2016 - 04:47 |
| ichiro | 0+3 | 291 Bytes | 12 Sep 2016 - 20:08 |
| Turn It In | 0+2 | 194 Bytes | 26 Sep 2016 - 13:42 |
| MojeekBot | 1+1 | 8.65 KB | 08 Sep 2016 - 10:34 |
| Sift | 1 | 16.28 KB | 24 Sep 2016 - 21:27 |