| 37 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 394322+24792 | 16.64 GB | 30 Jun 2012 - 23:57 |
| Googlebot | 21948+36 | 33.99 GB | 30 Jun 2012 - 23:57 |
| Unknown robot (identified by 'bot*') | 10797+222 | 13.97 GB | 30 Jun 2012 - 23:37 |
| Yandex bot | 8627+33 | 9.48 GB | 30 Jun 2012 - 23:49 |
| BaiDuSpider | 7033+59 | 186.35 MB | 30 Jun 2012 - 23:59 |
| Unknown robot (identified by hit on 'robots.txt') | 0+417 | 12.62 KB | 30 Jun 2012 - 22:07 |
| Unknown robot (identified by empty user agent string) | 287+6 | 342.65 MB | 30 Jun 2012 - 17:59 |
| Sogou Spider | 253+5 | 96.61 MB | 30 Jun 2012 - 23:58 |
| Alexa (IA Archiver) | 182+45 | 362.58 MB | 26 Jun 2012 - 00:18 |
| OutfoxBot/YodaoBot | 186+1 | 1.25 MB | 30 Jun 2012 - 21:39 |
| BSpider | 110+18 | 8.13 MB | 30 Jun 2012 - 23:53 |
| Nutch | 67+15 | 827.02 KB | 30 Jun 2012 - 16:49 |
| MSNBot | 58+11 | 461.38 KB | 29 Jun 2012 - 10:15 |
| Unknown robot (identified by 'robot') | 56+5 | 115.05 MB | 28 Jun 2012 - 12:58 |
| Java (Often spam bot) | 47 | 14.83 MB | 30 Jun 2012 - 08:36 |
| bender focused_crawler | 33+3 | 170.44 MB | 17 Jun 2012 - 00:03 |
| WordPress | 26 | 37.59 MB | 30 Jun 2012 - 01:32 |
| archive.org bot | 16+8 | 110.45 KB | 16 Jun 2012 - 23:10 |
| Unknown robot (identified by 'discovery') | 18+4 | 51.00 MB | 28 Jun 2012 - 01:13 |
| Yahoo Slurp | 21 | 664.58 KB | 20 Jun 2012 - 14:00 |
| Exabot | 10+7 | 128.11 KB | 29 Jun 2012 - 03:46 |
| MSNBot-media | 10+6 | 587.63 KB | 21 Jun 2012 - 19:06 |
| Unknown robot (identified by 'spider') | 12+2 | 12.17 MB | 29 Jun 2012 - 00:52 |
| Python-urllib | 14 | 356.97 KB | 25 Jun 2012 - 00:45 |
| MJ12bot | 6+6 | 1.36 MB | 28 Jun 2012 - 13:58 |
| FaceBook bot | 9 | 1.13 MB | 27 Jun 2012 - 18:33 |
| WGet tools | 7 | 14.70 MB | 26 Jun 2012 - 13:49 |
| Mail.ru bot | 2+4 | 13.99 KB | 22 Jun 2012 - 02:15 |
| Powermarks | 4 | 3.06 MB | 23 Jun 2012 - 18:31 |
| W3C Validator | 3 | 1.75 MB | 01 Jun 2012 - 06:50 |
| CFNetwork | 2 | 169.81 KB | 27 Jun 2012 - 00:17 |
| DoCoMo | 1+1 | 681.69 KB | 20 Jun 2012 - 23:20 |
| Netcraft | 2 | 6.93 KB | 02 Jun 2012 - 13:43 |
| Perl tool | 1 | 3.25 KB | 12 Jun 2012 - 09:55 |
| lwp-trivial | 1 | 14.71 KB | 08 Jun 2012 - 12:58 |
| FavIconizer | 1 | 6.93 KB | 25 Jun 2012 - 10:33 |
| WebFilter | 1 | 6.93 KB | 20 Jun 2012 - 22:52 |