43 different robots | Hits | Bandwidth | Last visit |
Googlebot | 34572+667 | 45.52 GB | 31 Oct 2016 - 23:57 |
Unknown robot (identified by 'bot*') | 23310+368 | 10.53 GB | 31 Oct 2016 - 23:50 |
BaiDuSpider | 6560+7 | 1.42 GB | 31 Oct 2016 - 23:50 |
Yahoo Slurp | 9724+69 | 1.60 GB | 31 Oct 2016 - 23:24 |
Java (Often spam bot) | 1066 | 41.22 MB | 31 Oct 2016 - 23:19 |
Web Core / Roots | 3893 | 64.72 MB | 31 Oct 2016 - 23:12 |
Unknown robot (identified by hit on 'robots.txt') | 0+468 | 50.73 KB | 31 Oct 2016 - 22:40 |
Yandex bot | 2038+111 | 1.37 GB | 31 Oct 2016 - 22:18 |
Sogou Spider | 248+23 | 4.13 MB | 31 Oct 2016 - 21:22 |
Unknown robot (identified by empty user agent string) | 91+3 | 67.49 MB | 31 Oct 2016 - 18:14 |
Python-urllib | 36 | 32.38 MB | 31 Oct 2016 - 14:31 |
Unknown robot (identified by 'crawl') | 11486+72 | 627.80 MB | 31 Oct 2016 - 13:51 |
Unknown robot (identified by 'robot') | 58+35 | 153.55 MB | 31 Oct 2016 - 12:45 |
FavIconizer | 52 | 22.13 MB | 31 Oct 2016 - 10:49 |
Turn It In | 1+2 | 1.67 MB | 31 Oct 2016 - 06:30 |
FaceBook bot | 21 | 1.39 MB | 30 Oct 2016 - 20:20 |
MSNBot-media | 53 | 3.38 MB | 30 Oct 2016 - 16:48 |
Exabot | 18+9 | 327.51 KB | 30 Oct 2016 - 16:43 |
MJ12bot | 6+7 | 61.09 KB | 30 Oct 2016 - 15:07 |
HTTrack off-line browser | 3 | 29.24 MB | 30 Oct 2016 - 10:13 |
Nutch | 21+67 | 31.96 MB | 30 Oct 2016 - 06:32 |
MSIECrawler | 3 | 47.96 KB | 30 Oct 2016 - 01:08 |
WGet tools | 7 | 73.44 MB | 29 Oct 2016 - 16:36 |
Alexa (IA Archiver) | 13+10 | 9.14 MB | 28 Oct 2016 - 23:08 |
Unknown robot (identified by 'checker') | 4 | 0 | 28 Oct 2016 - 18:04 |
Heritrix | 3040+3 | 122.63 MB | 28 Oct 2016 - 07:57 |
Spiderman | 2 | 17.11 KB | 27 Oct 2016 - 15:28 |
archive.org bot | 4+10 | 6.53 MB | 27 Oct 2016 - 01:12 |
JoBo Java Web Robot | 2 | 831.44 KB | 26 Oct 2016 - 21:42 |
Unknown robot (identified by '*bot') | 0+1 | 111 Bytes | 26 Oct 2016 - 00:51 |
Unknown robot (identified by 'spider') | 9+1 | 6.61 MB | 24 Oct 2016 - 18:27 |
WordPress | 2 | 0 | 24 Oct 2016 - 07:20 |
Sift | 3 | 48.85 KB | 23 Oct 2016 - 19:48 |
yacy | 24+4 | 117.34 MB | 22 Oct 2016 - 12:43 |
LinkChecker | 2+2 | 222 Bytes | 21 Oct 2016 - 14:41 |
Powermarks | 6 | 95.92 KB | 20 Oct 2016 - 22:39 |
Speedy Spider | 2+1 | 840.11 KB | 19 Oct 2016 - 22:31 |
CFNetwork | 5 | 18.55 MB | 17 Oct 2016 - 18:37 |
Netcraft | 2 | 8.56 KB | 15 Oct 2016 - 11:17 |
SeznamBot | 1+1 | 831.55 KB | 11 Oct 2016 - 09:45 |
larbin | 20+3 | 1.26 MB | 10 Oct 2016 - 08:49 |
psbot | 22+2 | 1.59 MB | 07 Oct 2016 - 17:36 |
ichiro | 1+1 | 929 Bytes | 04 Oct 2016 - 21:42 |