笔记 by 车东

AWStats的补充定义:区分百度图片搜索和一些新出现的360搜索引擎蜘蛛

· 日志分析|AWStats

📌 TLDR

AWStats 的 lib 目录打包更新(2012-08-23):蜘蛛定义补上 360Spider、Soso、豆瓣、鲜果、有道、FriendFeed 以及几个国外 RSS 阅读器,并把老旧条目(qihoobot / youdao)换成新名字;搜索引擎定义区分了百度图片、有道、soso、360 搜索。附完整 diff。

更新后的AWStats最新版本lib目录打包下载(latest: 2012-08-23),蜘蛛定义部分增加了区分Yahoo!中国,Soso 豆瓣,鲜果,360蜘蛛等,其他的是几个国外的RSS阅读器;搜索引擎部分区分了百度图片,有道搜索,soso搜索,360搜索; diff附后:

cvs diff: Diffing .

Index: robots.pm

RCS file: /cvsroot/awstats/awstats/wwwroot/cgi-bin/lib/robots.pm,v retrieving revision 1.64 diff -r1.64 robots.pm 359a360,364

‘360spider’, ‘sosospider’, ‘youdaobot’, ‘doubanbot’, ‘friendfeedbot’, 850c855 < ‘qihoobot’,


‘jikespider’, 1072d1076 < ‘youdao’, 1129a1134,1138 ‘sosospider’,’Soso Spider’, ‘doubanbot’,’DoubanBot’, ‘youdaobot’,’YoudaoBot’, ‘360spider’,’360Spider’, ‘friendfeedbot’,’FriendFeedBot’, 1616c1625 < ‘qihoobot’,’QihooBot’,


‘jikespider’,’JikeSpider’, 1855d1863 < ‘youdao’, ‘youdao’, Index: search_engines.pm =================================================================== RCS file: /cvsroot/awstats/awstats/wwwroot/cgi-bin/lib/search_engines.pm,v retrieving revision 1.53 diff -r1.53 search_engines.pm 175d174 < ’live.com’, 290,298c289,295 < ‘.baidu.com’, # baidu search portal < ‘.vnet.cn’, # powered by MSN < ‘.soso.com’, # powered by Google < ‘.sogou.com’, # powered by Sohu < ‘.3721.com’, # powered by Yahoo! < ‘iask.com’, # powered by Sina < ‘.accoona.com’, # Accoona < ‘.163.com’, # powered by Google < ‘.zhongsou.com’, # zhongsou search portal


‘baidu.’, # baidu search portal ‘118114.cn’, # powered by Bing ‘vnet.cn’, # powered by Bing ‘soso.com’, # powered by TenCent ‘sogou.com’, # powered by Sohu ‘youdao.com’, # powered by NetEase ‘360.cn’, # powered by QIHU 368c365,368 < ‘yandex.’=>‘direct.yandex.’


‘yandex.’=>‘direct.yandex.’, ‘baidu.’=>‘hi.baidu.’, ‘baidu.’=>‘zhidao.baidu.’, ‘baidu.’=>‘tieba.baidu.’ 394d393 < ’live.com’,’live’, 508,516c507,513 < ‘.baidu.com’,‘baidu’, < ‘iask.com’,‘iask’, < ‘.accoona.com’,‘accoona’, < ‘.3721.com’,‘3721’, < ‘.163.com’,’netease’, < ‘.soso.com’,‘soso’, < ‘.zhongsou.com’,‘zhongsou’, < ‘.vnet.cn’,‘vnet’, < ‘.sogou.com’,‘sogou’,


‘baidu.’,‘baidu’, ‘youdao.com’,‘youdao’, ‘360.cn’,‘360’, ‘soso.com’,‘soso’, ‘118114.cn’,‘vnet’, ‘vnet.cn’,‘vnet’, ‘sogou.com’,‘sogou’, 672d668 < ’live’,‘q=’, 777,782c773,775 < ‘iask’,’(w|k)=’, < ‘accoona’,‘qt=’, < ‘3721’,’(p|name)=’, < ’netease’,‘q=’, < ‘soso’,‘q=’, < ‘zhongsou’,’(word|w)=’,


‘youdao’,‘q=’, ‘360’,‘q=’, ‘soso’,‘w=’, 903d895 < ’live’,’Microsoft Windows Live’, 1007,1015c999,1003 < ‘baidu’,’Baidu’, < ‘iask’,’Iask’, < ‘accoona’,’Accoona’, < ‘3721’,’3721’, < ’netease’, ‘NetEase’, < ‘soso’,’SoSo’, < ‘zhongsou’,’ZhongSou’, < ‘sogou’, ‘SoGou’, < ‘vnet’,’VNet’,


‘baidu’,’Baidu’, ‘youdao’, ‘YouDao’, ‘soso’,’SoSo’, ‘sogou’, ‘SoGou’, ‘vnet’,’VNet’,

💬 历史评论

以下 4 条评论从旧版 Movable Type 博客迁移而来。 原始评论时间:2002–2016 年。

Paveo · 2008-10-03 19:54

多谢车东,已经用上。


dupola · 2008-10-04 04:39

这个解压后直接上传到lib目录就好了吗?


iammecn · 2008-10-06 21:05

老大有没有研究过awstats的对于页面下载时间的分析? iis,squid中都可以定义页面下载时间这一段,如果能分析最好了.很实用.


xi2008wang · 2008-10-31 22:45

奇怪, 为什么我去下载6.8已经自带了. 可能已经更新了吧