35 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 31717+8636 | 14.35 GB | 31 Dec 2015 - 23:58 |
Googlebot | 16624+676 | 22.23 GB | 31 Dec 2015 - 23:58 |
Yahoo Slurp | 13628+58 | 3.98 GB | 31 Dec 2015 - 23:59 |
BaiDuSpider | 12240 | 530.61 MB | 31 Dec 2015 - 23:56 |
Unknown robot (identified by 'crawl') | 9000+86 | 3.61 GB | 31 Dec 2015 - 20:05 |
Yandex bot | 8120+108 | 21.46 GB | 31 Dec 2015 - 23:45 |
Unknown robot (identified by 'robot') | 2660+12 | 105.00 MB | 28 Dec 2015 - 21:19 |
Sogou Spider | 400+44 | 149.75 MB | 31 Dec 2015 - 20:39 |
Unknown robot (identified by empty user agent string) | 359+8 | 838.07 MB | 30 Dec 2015 - 21:09 |
Nutch | 139+116 | 54.18 MB | 31 Dec 2015 - 18:13 |
Unknown robot (identified by hit on 'robots.txt') | 0+156 | 14.78 KB | 31 Dec 2015 - 12:36 |
WordPress | 154 | 7.96 MB | 28 Dec 2015 - 01:35 |
archive.org bot | 125+23 | 21.08 MB | 25 Dec 2015 - 06:03 |
WGet tools | 145+1 | 9.62 GB | 31 Dec 2015 - 23:16 |
FavIconizer | 58 | 9.21 MB | 31 Dec 2015 - 06:36 |
Sift | 39 | 643.71 KB | 31 Dec 2015 - 13:34 |
Mail.ru bot | 11+20 | 49.04 MB | 30 Dec 2015 - 19:41 |
Unknown robot (identified by 'spider') | 19+6 | 2.65 MB | 30 Dec 2015 - 14:51 |
Exabot | 16+8 | 293.29 KB | 31 Dec 2015 - 16:31 |
Alexa (IA Archiver) | 5+5 | 879.24 KB | 22 Dec 2015 - 07:57 |
Python-urllib | 8+2 | 17.84 MB | 29 Dec 2015 - 18:57 |
Phantom | 8 | 11.02 MB | 31 Dec 2015 - 21:36 |
SpiderBot | 4+4 | 3.20 MB | 19 Dec 2015 - 07:50 |
FaceBook bot | 6 | 110.89 KB | 29 Dec 2015 - 18:50 |
Java (Often spam bot) | 5 | 8.66 MB | 20 Dec 2015 - 13:42 |
Y!J Yahoo Japan | 2+2 | 1.60 MB | 22 Dec 2015 - 16:47 |
MSNBot | 1+1 | 915 Bytes | 08 Dec 2015 - 21:35 |
Turn It In | 1+1 | 5.60 MB | 17 Dec 2015 - 15:41 |
mnoGoSearch search engine software | 1+1 | 8.65 KB | 31 Dec 2015 - 08:26 |
MojeekBot | 1+1 | 8.65 KB | 11 Dec 2015 - 10:54 |
yacy | 1+1 | 515.94 KB | 17 Dec 2015 - 23:56 |
Heritrix | 0+2 | 194 Bytes | 19 Dec 2015 - 13:04 |
Netcraft | 2 | 8.56 KB | 09 Dec 2015 - 19:39 |
fido | 1 | 8.89 MB | 30 Dec 2015 - 11:51 |
HTTrack off-line browser | 1 | 5.60 MB | 24 Dec 2015 - 03:56 |