Robots |
1 | 1503 | 58.39 | msnbot/2.0b (+http://search.msn.com/msnb... |
2 | 133 | 5.17 | Baiduspider+(+http://www.baidu.com/searc... |
3 | 125 | 4.86 | compatible Mozilla/4.0 |
4 | 118 | 4.58 | Yahoo! Slurp |
5 | 114 | 4.43 | compatible Mozilla/5.0 |
6 | 80 | 3.11 | Sogou web spider/4.0(+http://www.sogou.c... |
7 | 47 | 1.83 | Sosospider+(+http://help.soso.com/webspi... |
8 | 46 | 1.79 | Googlebot/2.1 |
9 | 43 | 1.67 | msnbot-media/1.1 (+http://search.msn.com... |
10 | 38 | 1.48 | - |
11 | 31 | 1.20 | discobot/1.1 |
12 | 27 | 1.05 | Exabot/3.0 (BiggerBetter) |
13 | 26 | 1.01 | GurujiImageBot/1.0 (+http://www.guruji.c... |
14 | 25 | 0.97 | KaloogaBot |
15 | 25 | 0.97 | Googlebot-Image/1.0 |
16 | 23 | 0.89 | Ask Jeeves/Teoma |
17 | 17 | 0.66 | Speedy Spider (http://www.entireweb.com/... |
18 | 14 | 0.54 | Mediapartners-Google |
19 | 14 | 0.54 | Yahoo! Slurp China |
20 | 14 | 0.54 | XmarksFetch/1.0 |
21 | 13 | 0.51 | NaverBot/1.0 |
22 | 10 | 0.39 | Baiduspider+(+http://www.baidu.jp/spider... |
23 | 9 | 0.35 | DotBot/1.1 |
24 | 7 | 0.27 | ScoutJet |
25 | 7 | 0.27 | al_viewer ([email protected]) |
26 | 7 | 0.27 | amibot - http://www.amidalla.de - tech@a... |
27 | 7 | 0.27 | MLBot (www.metadatalabs.com/mlbot) |
28 | 6 | 0.23 | Exabot/3.0 |
29 | 6 | 0.23 | LinkWalker/2.0 |
30 | 4 | 0.16 | TurnitinBot/2.1 (http://www.turnitin.com... |
31 | 3 | 0.12 | voyager/2.0 (http://www.kosmix.com/crawl... |
32 | 3 | 0.12 | aiHitBot/1.0 |
33 | 3 | 0.12 | StackRambler/2.0 (MSIE incompatible) |
34 | 2 | 0.08 | Xionics.de v0.1.4 (http://www.openwebspi... |
35 | 2 | 0.08 | Tagoobot/3.0 |
36 | 2 | 0.08 | panscient.com |
37 | 2 | 0.08 | MJ12bot/v1.3.2 |
38 | 2 | 0.08 | Fedora/1.0.7 |
39 | 2 | 0.08 | Comodo-Certificates-Spider |
40 | 2 | 0.08 | MSIE 5.01 |
41 | 2 | 0.08 | CamontSpider/1.0 +http://epweb2.ph.bham.... |
42 | 1 | 0.04 | psbot/0.1 (+http://www.picsearch.com/bot... |
43 | 1 | 0.04 | Snapbot/1.0 (Snap Shots, +http://www.sna... |
44 | 1 | 0.04 | taptubot *** please read http://www.tapt... |
45 | 1 | 0.04 | curl/7.15.5 (x86_64-redhat-linux-gnu) li... |
46 | 1 | 0.04 | ia_archiver-web.archive.org |
47 | 1 | 0.04 | SheenBot/SheenBot-1.0.2 (Sheen web crawl... |
48 | 1 | 0.04 | Python-urllib/2.5 |
49 | 1 | 0.04 | Rexyobot/2.13 |
50 | 1 | 0.04 | MJ12bot/v1.3.1 |
51 | 1 | 0.04 | bitlybot |