| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 31314+625 | 41.41 GB | 31 Aug 2016 - 23:55 |
| Unknown robot (identified by 'bot*') | 25406+716 | 11.90 GB | 31 Aug 2016 - 23:52 |
| Yahoo Slurp | 9496+45 | 1.88 GB | 31 Aug 2016 - 23:58 |
| Unknown robot (identified by 'crawl') | 9418+33 | 1.91 GB | 31 Aug 2016 - 16:55 |
| BaiDuSpider | 6032+16 | 1.93 GB | 31 Aug 2016 - 23:59 |
| WGet tools | 5837+3 | 158.23 MB | 29 Aug 2016 - 19:51 |
| Yandex bot | 5186+108 | 7.32 GB | 31 Aug 2016 - 23:59 |
| Web Core / Roots | 3806 | 64.00 MB | 25 Aug 2016 - 11:38 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3759 | 356.08 KB | 31 Aug 2016 - 23:27 |
| Python-urllib | 2678 | 135.16 MB | 31 Aug 2016 - 17:56 |
| psbot | 1231+43 | 25.51 MB | 31 Aug 2016 - 22:34 |
| Java (Often spam bot) | 1176 | 213.48 MB | 31 Aug 2016 - 23:51 |
| Sogou Spider | 282+38 | 596.23 MB | 30 Aug 2016 - 15:56 |
| Unknown robot (identified by empty user agent string) | 161+11 | 273.82 MB | 31 Aug 2016 - 16:00 |
| Alexa (IA Archiver) | 142+28 | 2.53 MB | 31 Aug 2016 - 23:08 |
| Unknown robot (identified by 'spider') | 140+1 | 1.32 MB | 26 Aug 2016 - 05:06 |
| Unknown robot (identified by 'robot') | 69+32 | 150.56 MB | 30 Aug 2016 - 13:36 |
| FavIconizer | 53 | 33.44 MB | 31 Aug 2016 - 23:23 |
| MSNBot-media | 43 | 706.68 KB | 31 Aug 2016 - 18:28 |
| Exabot | 17+10 | 167.02 KB | 28 Aug 2016 - 13:29 |
| yacy | 14+5 | 94.17 MB | 31 Aug 2016 - 17:29 |
| Phantom | 17 | 1.14 MB | 30 Aug 2016 - 14:15 |
| CFNetwork | 15 | 1.38 GB | 31 Aug 2016 - 17:07 |
| MJ12bot | 6+8 | 60.00 KB | 27 Aug 2016 - 11:35 |
| Nutch | 0+9 | 873 Bytes | 27 Aug 2016 - 14:22 |
| archive.org bot | 3+6 | 8.71 MB | 30 Aug 2016 - 00:17 |
| WordPress | 8 | 0 | 21 Aug 2016 - 20:13 |
| FaceBook bot | 7 | 194.36 KB | 24 Aug 2016 - 23:33 |
| HTTrack off-line browser | 7 | 75.31 MB | 29 Aug 2016 - 17:51 |
| legs | 5+1 | 4.05 MB | 28 Aug 2016 - 08:34 |
| Unknown robot (identified by 'checker') | 6 | 0 | 26 Aug 2016 - 18:10 |
| Netcraft | 4 | 25.67 KB | 09 Aug 2016 - 18:14 |
| SeznamBot | 1+1 | 830.27 KB | 09 Aug 2016 - 06:02 |
| Heritrix | 1+1 | 8.65 KB | 05 Aug 2016 - 12:17 |
| ichiro | 1+1 | 915 Bytes | 27 Aug 2016 - 16:52 |
| Spiderman | 1 | 8.56 KB | 22 Aug 2016 - 03:23 |