如何判断一个ip是否为360spider的抓取ip?除在http://dwz.cn/3Tu3Wu这个帖子中@萌萌哒的小搜哥 发的蜘蛛ip段外,还有没有其它的360spider的IP,对于站长而言,应该如何判断一个ip是否为360抓取蜘蛛ip?比如判断baiduspider的时候可以使用nslookup+ip的方式进行查询,但发现这个方法查不了360spider。如下图iis日志疑似360spider的蜘蛛ip段。
180.153.187.91 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 | 180.153.185.185 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 | 180.153.186.205 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 | 180.153.187.37 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 | 180.153.187.36 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 | 180.153.185.118 | Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider | 200 | 0 | 0 |
c-ip | sc-status | sc-substatus | sc-bytes | 101.226.168.195 | 200 | 0 | 0 | 101.226.169.209 | 404 | 0 | 0 | 101.226.166.226 | 200 | 0 | 0 | 101.226.166.244 | 200 | 0 | 0 | 101.226.166.202 | 200 | 0 | 0 | 101.226.168.195 | 200 | 0 | 0 | 101.226.168.231 | 200 | 0 | 0 | 101.226.167.210 | 200 | 0 | 0 | 101.226.169.208 | 200 | 0 | 0 | 101.226.168.210 | 200 | 0 | 0 | 101.226.169.229 | 200 | 0 | 0 | 101.226.166.231 | 200 | 0 | 0 |
c-ip | sc-status | sc-substatus | sc-bytes | 182.118.20.222 | 301 | 0 | 0 | 182.118.20.222 | 200 | 0 | 0 | 182.118.25.181 | 200 | 0 | 0 | 182.118.25.176 | 200 | 0 | 0 | 182.118.25.178 | 200 | 0 | 0 | 182.118.25.173 | 200 | 0 | 0 | 182.118.20.224 | 404 | 0 | 0 | 182.118.25.210 | 404 | 0 | 0 | 182.118.25.201 | 404 | 0 | 0 | 182.118.20.224 | 200 | 0 | 0 | 182.118.25.218 | 200 | 0 | 0 | 182.118.20.168 | 200 | 0 | 0 | 182.118.21.207 | 200 | 0 | 0 | 182.118.25.213 | 200 | 0 | 0 | 182.118.22.226 | 200 | 0 | 0 | 182.118.21.245 | 404 | 0 | 0 | 182.118.21.242 | 200 | 0 | 0 | 182.118.25.226 | 200 | 0 | 0 | 182.118.20.215 | 200 | 0 | 0 | 182.118.21.223 | 200 | 0 | 0 | 182.118.22.228 | 200 | 0 | 0 | 182.118.22.228 | 200 | 0 | 0 | 182.118.25.224 | 200 | 0 | 0 | 182.118.22.141 | 200 | 0 | 0 | 182.118.20.211 | 200 | 0 | 0 | 182.118.22.212 | 200 | 0 | 0 | 182.118.22.217 | 200 | 0 | 0 | 182.118.25.208 | 200 | 0 | 0 | 182.118.25.209 | 200 | 0 | 0 | 还有每天都有360spider抓取,但是360搜索的收录真的很差,百度和搜狗已经收录几万个页面,但360现在还不收录。反馈了貌似作用也不是很大,不知道什么原因?
|
|
|
|
评论
直达楼层