Robots |
1 | 137 | 25.46 | Googlebot/2.1 |
2 | 75 | 13.94 | bingbot/2.0 |
3 | 71 | 13.20 | compatible Mozilla/5.0 |
4 | 51 | 9.48 | Yahoo! Slurp |
5 | 50 | 9.29 | YandexBot/3.0 |
6 | 28 | 5.20 | meanpathbot/1.0 |
7 | 19 | 3.53 | Linux x86_64 |
8 | 19 | 3.53 | MJ12bot/v1.4.5 |
9 | 12 | 2.23 | Baiduspider/2.0 |
10 | 10 | 1.86 | MSIE 8.0 |
11 | 9 | 1.67 | Apache-HttpClient/4.3 (java 1.5) |
12 | 8 | 1.49 | - |
13 | 6 | 1.12 | msnbot-media/1.1 (+http://search.msn.com... |
14 | 6 | 1.12 | DomainAppender /1.0 |
15 | 6 | 1.12 | AhrefsBot/5.0 |
16 | 5 | 0.93 | DotBot/1.1 |
17 | 4 | 0.74 | LSSRocketCrawler/1.0 LightspeedSystems |
18 | 4 | 0.74 | Exabot/3.0 |
19 | 2 | 0.37 | spbot/4.2.0 |
20 | 2 | 0.37 | nutch-1.4/Nutch-1.4 |
21 | 2 | 0.37 | Aboundex/0.3 (http://www.aboundex.com/cr... |
22 | 2 | 0.37 | GrapeshotCrawler/2.0 |
23 | 1 | 0.19 | Python-urllib/1.17 |
24 | 1 | 0.19 | BlackBerry9000/4.6.0.167 Profile/MIDP-2.... |
25 | 1 | 0.19 | BLEXBot/1.0 |
26 | 1 | 0.19 | Exabot/3.0 (BiggerBetter) |
27 | 1 | 0.19 | WebIndex |
28 | 1 | 0.19 | Riddler (http://riddler.io/about.html) |
29 | 1 | 0.19 | MSIE 5.01 |
30 | 1 | 0.19 | HTTrack 3.0x |
31 | 1 | 0.19 | www.osaicbt.com/Nutch-2.2.1 |
32 | 1 | 0.19 | GigablastOpenSource/1.0 |