Robots |
1 | 451 | 22.60 | msnbot-media/1.1 (+http://search.msn.com... |
2 | 342 | 17.13 | Googlebot/2.1 |
3 | 291 | 14.58 | compatible Mozilla/5.0 |
4 | 268 | 13.43 | bingbot/2.0 |
5 | 159 | 7.97 | Baiduspider+(+http://www.baidu.com/searc... |
6 | 121 | 6.06 | MJ12bot/v1.4.0 |
7 | 86 | 4.31 | Yahoo! Slurp |
8 | 49 | 2.45 | Sosospider+(+http://help.soso.com/webspi... |
9 | 34 | 1.70 | YandexBot/3.0 |
10 | 31 | 1.55 | msnbot/2.0b (+http://search.msn.com/msnb... |
11 | 20 | 1.00 | YandexImages/3.0 |
12 | 15 | 0.75 | Ezooms/1.0 |
13 | 14 | 0.70 | ScoutJet |
14 | 12 | 0.60 | AhrefsBot/1.0 |
15 | 9 | 0.45 | Yahoo! Slurp China |
16 | 9 | 0.45 | MSIE 8.0 |
17 | 8 | 0.40 | Exabot/3.0 |
18 | 7 | 0.35 | FlightDeckReportsBot/2.0 (http://www.fli... |
19 | 6 | 0.30 | Sogou web spider/4.0(+http://www.sogou.c... |
20 | 6 | 0.30 | MLBot (www.metadatalabs.com/mlbot) |
21 | 5 | 0.25 | TurnitinBot/2.1 (http://www.turnitin.com... |
22 | 5 | 0.25 | rgspider |
23 | 5 | 0.25 | MSIE 6.0 |
24 | 5 | 0.25 | TimKimSearch/2.1 |
25 | 4 | 0.20 | NaverBot/1.0 |
26 | 4 | 0.20 | - |
27 | 3 | 0.15 | Ubuntu/10.04 |
28 | 3 | 0.15 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
29 | 3 | 0.15 | linkdex.com/v2.0 |
30 | 3 | 0.15 | Firefox/3.6.15 |
31 | 2 | 0.10 | Firefox/2.0.0.1 |
32 | 2 | 0.10 | findlinks/2.1.3 (+http://wortschatz.uni-... |
33 | 2 | 0.10 | Wget/1.9+cvs-stable (Red Hat modified) |
34 | 2 | 0.10 | Kavande Crawler 1.0/Nutch-1.4-dev (Irani... |
35 | 1 | 0.05 | psbot/0.1 (+http://www.picsearch.com/bot... |
36 | 1 | 0.05 | Mail.RU/2.0 |
37 | 1 | 0.05 | Wget/1.12 (linux-gnu) |
38 | 1 | 0.05 | Mail.Ru/1.0 |
39 | 1 | 0.05 | CCBot/1.0 (+http://www.commoncrawl.org/b... |
40 | 1 | 0.05 | MSIE 5.01 |
41 | 1 | 0.05 | SeznamBot/3.0-test (+http://fulltext.sbl... |
42 | 1 | 0.05 | SBIder/Nutch-1.0-dev (http://www.sitesel... |
43 | 1 | 0.05 | gettor/0.1 |
44 | 1 | 0.05 | pflab ([email protected]) |