Robots |
1 | 2109 | 50.86 | msnbot-media/1.1 (+http://search.msn.com... |
2 | 1070 | 25.80 | msnbot/2.0b (+http://search.msn.com/msnb... |
3 | 208 | 5.02 | Sogou web spider/4.0(+http://www.sogou.c... |
4 | 141 | 3.40 | compatible Mozilla/5.0 |
5 | 129 | 3.11 | Googlebot/2.1 |
6 | 121 | 2.92 | Baiduspider+(+http://www.baidu.com/searc... |
7 | 92 | 2.22 | Yahoo! Slurp |
8 | 81 | 1.95 | YandexBot/3.0 |
9 | 41 | 0.99 | psbot/0.1 (+http://www.picsearch.com/bot... |
10 | 31 | 0.75 | Ask Jeeves/Teoma |
11 | 14 | 0.34 | Yahoo! Slurp China |
12 | 14 | 0.34 | Googlebot-Image/1.0 |
13 | 10 | 0.24 | - |
14 | 9 | 0.22 | ScoutJet |
15 | 8 | 0.19 | Mediapartners-Google |
16 | 8 | 0.19 | DotBot/1.1 |
17 | 8 | 0.19 | MLBot (www.metadatalabs.com/mlbot) |
18 | 6 | 0.14 | webmoney.advisor/Nutch-1.0 |
19 | 6 | 0.14 | Exabot/3.0 |
20 | 6 | 0.14 | Baiduspider+(+http://www.baidu.jp/spider... |
21 | 5 | 0.12 | LinkWalker/2.0 |
22 | 4 | 0.10 | spbot/2.0.4 |
23 | 3 | 0.07 | MJ12bot/v1.3.3 |
24 | 3 | 0.07 | Netscape 4.7 |
25 | 2 | 0.05 | msnbot/2.0b (+http://search.msn.com/msnb... |
26 | 2 | 0.05 | MSIE 6.0 |
27 | 2 | 0.05 | Fedora/1.0.7 |
28 | 2 | 0.05 | ia_archiver-web.archive.org |
29 | 2 | 0.05 | MSIE 5.01 |
30 | 1 | 0.02 | YandexImages/3.0 |
31 | 1 | 0.02 | page_test ([email protected]) |
32 | 1 | 0.02 | TwengaBot-Discover (http://www.twenga.fr... |
33 | 1 | 0.02 | http://domino.research.ibm.com/comm/rese... |
34 | 1 | 0.02 | L.webis/0.80 (http://webalgo.iit.cnr.it/... |
35 | 1 | 0.02 | MSIE 7.0 |
36 | 1 | 0.02 | StackRambler/2.0 (MSIE incompatible) |
37 | 1 | 0.02 | CamontSpider/1.0 +http://epweb2.ph.bham.... |
38 | 1 | 0.02 | Hailoobot/1.2 |
39 | 1 | 0.02 | CCBot/1.0 (+http://www.commoncrawl.org/b... |