Robots |
1 | 1240 | 39.29 | msnbot-media/1.1 (+http://search.msn.com... |
2 | 971 | 30.77 | bingbot/2.0 |
3 | 220 | 6.97 | compatible Mozilla/5.0 |
4 | 194 | 6.15 | Googlebot/2.1 |
5 | 113 | 3.58 | Baiduspider+(+http://www.baidu.com/searc... |
6 | 101 | 3.20 | Yahoo! Slurp |
7 | 72 | 2.28 | YandexBot/3.0 |
8 | 26 | 0.82 | Mediapartners-Google |
9 | 21 | 0.67 | MLBot (www.metadatalabs.com/mlbot) |
10 | 20 | 0.63 | msnbot/2.0b (+http://search.msn.com/msnb... |
11 | 19 | 0.60 | - |
12 | 18 | 0.57 | DotBot/1.1 |
13 | 15 | 0.48 | MJ12bot/v1.3.3 |
14 | 14 | 0.44 | Sogou web spider/4.0(+http://www.sogou.c... |
15 | 14 | 0.44 | SBIder/Nutch-1.0-dev (http://www.sitesel... |
16 | 14 | 0.44 | Ask Jeeves/Teoma |
17 | 12 | 0.38 | Yahoo! Slurp China |
18 | 10 | 0.32 | SiteBot/0.1 |
19 | 7 | 0.22 | ScoutJet |
20 | 6 | 0.19 | msnbot/2.0b (+http://search.msn.com/msnb... |
21 | 5 | 0.16 | YandexImages/3.0 |
22 | 5 | 0.16 | LinkWalker/2.0 |
23 | 5 | 0.16 | Googlebot-Image/1.0 |
24 | 4 | 0.13 | Exabot/3.0 |
25 | 4 | 0.13 | page_test ([email protected]) |
26 | 3 | 0.10 | NaverBot/1.0 |
27 | 3 | 0.10 | Gigabot/3.0 (http://www.gigablast.com/sp... |
28 | 3 | 0.10 | spbot/2.1 |
29 | 2 | 0.06 | MSIE 6.0 |
30 | 2 | 0.06 | Fedora/1.0.7 |
31 | 2 | 0.06 | Exabot/3.0 (BiggerBetter) |
32 | 2 | 0.06 | curl/7.19.7 (x86_64-pc-linux-gnu) libcur... |
33 | 2 | 0.06 | StackRambler/2.0 (MSIE incompatible) |
34 | 1 | 0.03 | compatible Mozilla/4.0 |
35 | 1 | 0.03 | TurnitinBot/2.1 (http://www.turnitin.com... |
36 | 1 | 0.03 | panscient.com |
37 | 1 | 0.03 | BlackBerry9000/4.6.0.167 Profile/MIDP-2.... |
38 | 1 | 0.03 | CamontSpider/1.0 +http://epweb2.ph.bham.... |
39 | 1 | 0.03 | MSIE 5.01 |
40 | 1 | 0.03 | ia_archiver-web.archive.org |