36 different robots | Hits | Bandwidth | Last visit |
Googlebot | 20069+695 | 39.22 GB | 30 Nov 2013 - 23:58 |
Unknown robot (identified by 'bot*') | 25857+125 | 79.14 GB | 30 Nov 2013 - 23:58 |
BaiDuSpider | 2948+1 | 4.21 GB | 30 Nov 2013 - 23:52 |
Yandex bot | 6055+60 | 6.92 GB | 30 Nov 2013 - 23:46 |
psbot | 284+46 | 6.21 MB | 30 Nov 2013 - 23:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+214 | 20.27 KB | 30 Nov 2013 - 23:18 |
Unknown robot (identified by 'crawl') | 1923+7 | 43.11 MB | 30 Nov 2013 - 23:06 |
WordPress | 174 | 15.48 MB | 30 Nov 2013 - 22:30 |
MSNBot-media | 16+14 | 52.36 MB | 30 Nov 2013 - 21:02 |
Unknown robot (identified by 'spider') | 30+23 | 371.69 KB | 30 Nov 2013 - 20:33 |
Unknown robot (identified by empty user agent string) | 267+2 | 686.85 MB | 30 Nov 2013 - 19:12 |
MSNBot | 267+34 | 19.11 MB | 30 Nov 2013 - 18:18 |
FavIconizer | 10 | 83.49 KB | 30 Nov 2013 - 15:53 |
Mail.ru bot | 59+44 | 1.07 GB | 30 Nov 2013 - 13:10 |
Sogou Spider | 574+72 | 286.19 MB | 30 Nov 2013 - 06:30 |
archive.org bot | 10+19 | 7.55 MB | 30 Nov 2013 - 03:22 |
NG 1.x (Exalead) | 974 | 5.48 GB | 29 Nov 2013 - 22:31 |
Java (Often spam bot) | 217 | 530.68 MB | 29 Nov 2013 - 04:39 |
SeznamBot | 9+8 | 43.88 KB | 29 Nov 2013 - 00:13 |
Custo | 3 | 20.21 MB | 28 Nov 2013 - 17:52 |
Alexa (IA Archiver) | 8+1 | 15.86 MB | 28 Nov 2013 - 09:46 |
Python-urllib | 3+8 | 11.60 MB | 28 Nov 2013 - 03:01 |
Unknown robot (identified by 'robot') | 15+6 | 208.66 KB | 27 Nov 2013 - 06:02 |
Exabot | 14+8 | 211.20 KB | 27 Nov 2013 - 06:01 |
WGet tools | 16 | 75.68 MB | 26 Nov 2013 - 21:10 |
Unknown robot (identified by '*bot') | 4+4 | 1.56 MB | 24 Nov 2013 - 01:35 |
Unknown robot (identified by 'checker') | 3 | 40.04 MB | 23 Nov 2013 - 22:29 |
Turn It In | 5+5 | 14.61 MB | 23 Nov 2013 - 15:39 |
Nutch | 944+78 | 400.74 MB | 23 Nov 2013 - 04:41 |
GigaBot | 1 | 8.35 KB | 21 Nov 2013 - 14:42 |
CFNetwork | 1 | 86.61 KB | 20 Nov 2013 - 19:57 |
larbin | 0+1 | 97 Bytes | 14 Nov 2013 - 07:34 |
Yahoo Slurp | 1+2 | 11.33 MB | 13 Nov 2013 - 15:49 |
Powermarks | 1 | 9.50 MB | 10 Nov 2013 - 23:20 |
yacy | 0+2 | 194 Bytes | 10 Nov 2013 - 10:43 |
Netcraft | 2 | 8.35 KB | 10 Nov 2013 - 09:53 |