| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 14915+123 | 604.58 MB | 31 Mar 2017 - 23:59 |
| BaiDuSpider | 7799+21 | 730.90 MB | 31 Mar 2017 - 23:59 |
| Googlebot | 38705+699 | 52.04 GB | 31 Mar 2017 - 23:58 |
| Unknown robot (identified by 'bot*') | 22865+209 | 16.45 GB | 31 Mar 2017 - 23:54 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2728 | 295.71 KB | 31 Mar 2017 - 23:52 |
| Yahoo Slurp | 7354+47 | 2.63 GB | 31 Mar 2017 - 23:43 |
| Yandex bot | 11464+131 | 6.76 GB | 31 Mar 2017 - 23:30 |
| Nutch | 93+414 | 67.07 MB | 31 Mar 2017 - 23:28 |
| Phantom | 7 | 15.18 MB | 31 Mar 2017 - 23:11 |
| Unknown robot (identified by 'spider') | 11+6 | 8.68 MB | 31 Mar 2017 - 23:08 |
| Python-urllib | 3941+1961 | 104.82 MB | 31 Mar 2017 - 23:00 |
| Java (Often spam bot) | 1034 | 51.99 MB | 31 Mar 2017 - 22:53 |
| UniversalFeedParser | 909 | 7.97 MB | 31 Mar 2017 - 20:46 |
| Unknown robot (identified by empty user agent string) | 176+4 | 279.58 MB | 31 Mar 2017 - 20:27 |
| Sogou Spider | 303+36 | 204.41 MB | 31 Mar 2017 - 19:31 |
| MSNBot-media | 76 | 2.11 MB | 31 Mar 2017 - 17:56 |
| Unknown robot (identified by '*bot') | 88+23 | 271.68 MB | 31 Mar 2017 - 13:37 |
| LinkWalker | 0+3 | 333 Bytes | 31 Mar 2017 - 09:49 |
| MJ12bot | 31+29 | 242.70 KB | 31 Mar 2017 - 06:43 |
| Unknown robot (identified by 'robot') | 11987+36 | 199.36 MB | 31 Mar 2017 - 04:34 |
| Alexa (IA Archiver) | 2+2 | 854.44 KB | 29 Mar 2017 - 22:19 |
| FavIconizer | 57 | 13.65 MB | 29 Mar 2017 - 21:12 |
| Exabot | 21+11 | 237.73 KB | 29 Mar 2017 - 20:19 |
| FaceBook bot | 22 | 4.09 MB | 29 Mar 2017 - 20:02 |
| Web Core / Roots | 6 | 1.77 MB | 28 Mar 2017 - 23:03 |
| archive.org bot | 0+4 | 444 Bytes | 28 Mar 2017 - 22:09 |
| yacy | 1989+5 | 125.50 MB | 27 Mar 2017 - 21:33 |
| CFNetwork | 6 | 61.28 MB | 27 Mar 2017 - 18:47 |
| WGet tools | 4 | 2.02 MB | 24 Mar 2017 - 12:58 |
| psbot | 817+25 | 13.02 MB | 22 Mar 2017 - 20:10 |
| Sift | 3 | 41.12 KB | 22 Mar 2017 - 19:01 |
| HTTrack off-line browser | 5 | 1.35 MB | 21 Mar 2017 - 08:42 |
| Unknown robot (identified by 'checker') | 1+1 | 16.43 KB | 15 Mar 2017 - 23:58 |
| GigaBot | 0+1 | 111 Bytes | 15 Mar 2017 - 05:08 |
| Netcraft | 2 | 8.56 KB | 09 Mar 2017 - 02:36 |
| Mail.ru bot | 1+1 | 7.95 MB | 05 Mar 2017 - 23:33 |
| SeznamBot | 2+2 | 6.42 MB | 05 Mar 2017 - 09:30 |
| larbin | 3+1 | 134.08 KB | 02 Mar 2017 - 22:30 |