36 different robots | Hits | Bandwidth | Last visit |
Googlebot | 30192+659 | 37.36 GB | 31 Jan 2017 - 23:59 |
Web Core / Roots | 14518 | 242.68 MB | 30 Jan 2017 - 20:45 |
Unknown robot (identified by 'bot*') | 12831+291 | 9.71 GB | 31 Jan 2017 - 23:52 |
Python-urllib | 10528+1 | 400.23 MB | 30 Jan 2017 - 18:24 |
Yahoo Slurp | 8552+49 | 1.29 GB | 31 Jan 2017 - 23:46 |
Yandex bot | 8367+180 | 7.35 GB | 31 Jan 2017 - 23:01 |
BaiDuSpider | 7425+12 | 755.35 MB | 31 Jan 2017 - 23:52 |
Unknown robot (identified by hit on 'robots.txt') | 0+2858 | 309.80 KB | 31 Jan 2017 - 23:53 |
Java (Often spam bot) | 886 | 27.73 MB | 31 Jan 2017 - 22:36 |
Sogou Spider | 470+39 | 241.43 MB | 31 Jan 2017 - 23:54 |
Unknown robot (identified by empty user agent string) | 143+7 | 311.77 MB | 31 Jan 2017 - 22:30 |
Unknown robot (identified by 'crawl') | 115+6 | 121.01 MB | 31 Jan 2017 - 20:13 |
FavIconizer | 69 | 40.66 MB | 31 Jan 2017 - 20:17 |
CFNetwork | 63 | 1.74 GB | 24 Jan 2017 - 07:47 |
Nutch | 33+23 | 17.48 MB | 25 Jan 2017 - 21:08 |
Unknown robot (identified by 'robot') | 40+16 | 21.95 MB | 31 Jan 2017 - 01:27 |
FaceBook bot | 48 | 1.05 MB | 29 Jan 2017 - 10:24 |
MSNBot-media | 42 | 7.89 MB | 21 Jan 2017 - 09:54 |
yacy | 27+12 | 137.93 MB | 30 Jan 2017 - 07:55 |
Exabot | 30+8 | 1.45 MB | 28 Jan 2017 - 12:01 |
Unknown robot (identified by '*bot') | 19+11 | 92.99 MB | 31 Jan 2017 - 06:06 |
MJ12bot | 13+14 | 5.26 MB | 27 Jan 2017 - 18:57 |
StackRambler | 20 | 1.20 MB | 21 Jan 2017 - 01:19 |
Unknown robot (identified by 'spider') | 14+5 | 19.06 MB | 29 Jan 2017 - 19:19 |
archive.org bot | 1+8 | 3.36 MB | 26 Jan 2017 - 15:32 |
psbot | 5+1 | 81.48 KB | 10 Jan 2017 - 07:46 |
Alexa (IA Archiver) | 3+3 | 893.68 KB | 30 Jan 2017 - 10:05 |
WGet tools | 5 | 30.43 MB | 28 Jan 2017 - 23:39 |
SeznamBot | 2+2 | 1.63 MB | 21 Jan 2017 - 18:30 |
WordPress | 4 | 16.23 MB | 12 Jan 2017 - 09:36 |
HTTrack off-line browser | 3 | 0 | 26 Jan 2017 - 16:30 |
MojeekBot | 1+1 | 8.66 KB | 14 Jan 2017 - 20:32 |
Spiderman | 2 | 17.11 KB | 12 Jan 2017 - 15:14 |
Netcraft | 2 | 8.56 KB | 10 Jan 2017 - 16:43 |
ichiro | 1+1 | 929 Bytes | 14 Jan 2017 - 00:38 |
Raven Search | 1 | 0 | 17 Jan 2017 - 13:57 |