36 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 8982+144 | 2.26 GB | 30 Nov 2016 - 23:59 |
Unknown robot (identified by 'bot*') | 16353+228 | 5.22 GB | 30 Nov 2016 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+1629 | 176.58 KB | 30 Nov 2016 - 23:58 |
BaiDuSpider | 7639+16 | 838.86 MB | 30 Nov 2016 - 23:58 |
Googlebot | 35332+669 | 52.77 GB | 30 Nov 2016 - 23:57 |
Java (Often spam bot) | 946+4 | 106.41 MB | 30 Nov 2016 - 23:47 |
Sogou Spider | 348+30 | 27.33 MB | 30 Nov 2016 - 23:41 |
Unknown robot (identified by 'robot') | 51+29 | 88.37 MB | 30 Nov 2016 - 22:32 |
Unknown robot (identified by empty user agent string) | 123+3 | 279.86 MB | 30 Nov 2016 - 22:03 |
FavIconizer | 55 | 19.78 MB | 30 Nov 2016 - 21:09 |
psbot | 1294+42 | 21.41 MB | 30 Nov 2016 - 19:46 |
MSNBot-media | 28 | 2.01 MB | 30 Nov 2016 - 19:44 |
Yandex bot | 720+105 | 867.23 MB | 30 Nov 2016 - 19:29 |
Nutch | 5+3 | 31.74 MB | 30 Nov 2016 - 13:15 |
WGet tools | 6 | 84.53 MB | 30 Nov 2016 - 13:13 |
WordPress | 169 | 190.17 MB | 30 Nov 2016 - 11:18 |
Unknown robot (identified by 'crawl') | 1853+65 | 164.52 MB | 29 Nov 2016 - 18:44 |
archive.org bot | 4+6 | 16.18 MB | 29 Nov 2016 - 17:52 |
FaceBook bot | 49 | 3.81 MB | 28 Nov 2016 - 08:07 |
Web Core / Roots | 7791 | 126.88 MB | 27 Nov 2016 - 01:48 |
MJ12bot | 41+17 | 4.49 MB | 27 Nov 2016 - 01:26 |
Unknown robot (identified by 'checker') | 5 | 0 | 25 Nov 2016 - 17:47 |
Heritrix | 57+1 | 74.64 MB | 24 Nov 2016 - 19:16 |
Exabot | 6+4 | 43.64 KB | 23 Nov 2016 - 23:51 |
Phantom | 18 | 3.03 MB | 23 Nov 2016 - 13:19 |
Unknown robot (identified by 'spider') | 5+1 | 68.72 KB | 21 Nov 2016 - 12:45 |
Python-urllib | 13 | 55.04 MB | 21 Nov 2016 - 08:49 |
Alexa (IA Archiver) | 7+7 | 13.96 MB | 20 Nov 2016 - 01:39 |
HTTrack off-line browser | 11 | 152.59 MB | 19 Nov 2016 - 06:00 |
Netcraft | 2 | 8.56 KB | 17 Nov 2016 - 09:10 |
SeznamBot | 2+2 | 832.46 KB | 17 Nov 2016 - 02:20 |
Sift | 24 | 396.58 KB | 15 Nov 2016 - 11:27 |
WebMiner | 1 | 8.56 KB | 14 Nov 2016 - 22:02 |
LinkWalker | 601+2 | 10.44 MB | 14 Nov 2016 - 21:05 |
yacy | 19+2 | 73.38 MB | 10 Nov 2016 - 00:51 |
MojeekBot | 1+1 | 833.24 KB | 08 Nov 2016 - 07:20 |