wanggangname 2022-08-07 19:58 采纳率: 100%
浏览 77
已结题

网站URL被大面积扫描采集，关键是IP还多

这几天一直在观察几个网站，都出现大面积的URL扫描，唉，禁止也禁止不完，各种不同的IP都有，我看了部分IP是台州 还有丽江。请求帮助一个思路，求解决方案，受不了了，再这样网站都快被采集完了。
我尝试在服务器安全组禁止IP，但是每天的IP各种各样，心累
就像下面这些

39.173.105.217 - - [29/Jul/2022:18:51:16 +0800] "GET /e/3a1e8f5df55c8a23/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.10.57 - - [29/Jul/2022:18:52:29 +0800] "GET /e/946bc6919e035863/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.10.36 - - [29/Jul/2022:18:52:57 +0800] "GET /e/68c3a06db3158218/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.144 - - [29/Jul/2022:18:53:10 +0800] "GET /e/68c3a06db3158218/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.9.179 - - [29/Jul/2022:18:53:22 +0800] "GET /e/68c3a06db3158218/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.201 - - [29/Jul/2022:18:54:30 +0800] "GET /e/ec74b825c438d497/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.11.20 - - [29/Jul/2022:18:54:39 +0800] "GET /e/ec74b825c438d497/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.23 - - [29/Jul/2022:18:54:47 +0800] "GET /e/ec74b825c438d497/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
49.7.115.73 - - [29/Jul/2022:18:56:08 +0800] "GET /e/1c46feb6c8708eb2/ HTTP/1.1" 200 5 "-" "MQQBrowser/26 Mozilla/5.0 (Linux; U; Android 4.4.2; zh-cn; MB200 Build/GRJ22; CyanogenMod-7) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; Sogou web spider/4.0; +http://www.sogou.com/docs/help/webmasters.htm#07)"
112.13.112.113 - - [29/Jul/2022:19:15:31 +0800] "GET /e/5415e348e5f96615/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.78 - - [29/Jul/2022:19:15:38 +0800] "GET /e/5415e348e5f96615/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.192 - - [29/Jul/2022:19:15:46 +0800] "GET /e/5415e348e5f96615/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
222.186.190.230 - - [29/Jul/2022:19:17:10 +0800] "GET / HTTP/1.1" 200 5 "-" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36"
107.167.39.42 - - [29/Jul/2022:19:17:21 +0800] "GET / HTTP/1.1" 200 5 "-" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36"
60.188.10.136 - - [29/Jul/2022:19:17:29 +0800] "GET /e/1b1bb7df1ed82f41/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.11.17 - - [29/Jul/2022:19:17:41 +0800] "GET /e/1b1bb7df1ed82f41/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.11.12 - - [29/Jul/2022:19:17:53 +0800] "GET /e/1b1bb7df1ed82f41/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.26 - - [29/Jul/2022:19:18:08 +0800] "GET /e/1b1bb7df1ed82f41/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.29.135 - - [29/Jul/2022:19:18:28 +0800] "GET /e/cc436866b970aef9/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.44 - - [29/Jul/2022:19:18:36 +0800] "GET /e/cc436866b970aef9/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.9.113 - - [29/Jul/2022:19:18:49 +0800] "GET /e/cc436866b970aef9/ HTTP/1.1" 200 60243 "https://mip.english28.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
61.151.206.126 - - [29/Jul/2022:19:19:14 +0800] "GET /e/09c1c954deaf283e HTTP/1.1" 200 5 "-" "Mozilla/5.0 (Linux; U; Android 6.0.1; zh-cn; OPPO R9s Build/MMB29M) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/38.0.0.0 Mobile Safari/537.36 OppoBrowser/4.2.8"


1.192.245.247 - - [07/Aug/2022:13:56:45 +0800] "GET /jp/ebfd970136e82ea3/ HTTP/1.1" 403 31 "https://www.qcjianli.com/a/35101d56d66ba6d6/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
171.8.236.127 - - [07/Aug/2022:13:57:27 +0800] "GET /jp/3a86cb348c9d784c/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/1fa3aeeede8895b3/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
221.15.254.173 - - [07/Aug/2022:13:58:07 +0800] "GET /jp/4597b0495c033766/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/36c4056ebcd7573a/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
117.25.139.73 - - [07/Aug/2022:13:58:28 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36"
117.25.139.73 - - [07/Aug/2022:13:58:29 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36"
120.244.123.136 - - [07/Aug/2022:13:59:45 +0800] "GET /jp/fb78254dbe041287/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/d2c49c20bb6101e2/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.77.106 - - [07/Aug/2022:14:05:35 +0800] "GET /jp/d06cf038953f2f2d/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/635fabc142de9628/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
222.186.190.221 - - [07/Aug/2022:14:07:29 +0800] "GET /data/admin/allowurl.txt HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:48.0) Gecko/20100101 Firefox/48.0"
121.31.16.19 - - [07/Aug/2022:14:09:22 +0800] "GET / HTTP/1.1" 403 31 "http://www.english28.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52"
1.192.242.212 - - [07/Aug/2022:14:13:12 +0800] "GET /jp/7f5993931b24cdfd/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/a0b8e5d9be895581/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.189 - - [07/Aug/2022:14:15:19 +0800] "GET /jp/2c21dd020efb9c3a/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/dd22fe4403a62c53/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.168 - - [07/Aug/2022:14:16:53 +0800] "GET /jp/dab8d16d7f757c76/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/379671ce3355d17e/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.76.105 - - [07/Aug/2022:14:26:45 +0800] "GET /jp/52e712138c98abe3/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/6f01d37f1a73ae06/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.77.109 - - [07/Aug/2022:14:28:52 +0800] "GET /jp/f6e08012b02e0df6/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/346ad0a0d0f83730/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
1.192.247.26 - - [07/Aug/2022:14:30:18 +0800] "GET /jp/2fc69ac028d7bdf0/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/9acbb5b9f1d2416d/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.79.149 - - [07/Aug/2022:14:32:51 +0800] "GET /jp/cc3aeb95b70082bf/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/048eec0bbfca8626/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
112.13.112.92 - - [07/Aug/2022:14:35:03 +0800] "GET /jp/48568a7d324a245b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.152 - - [07/Aug/2022:14:35:16 +0800] "GET /jp/48568a7d324a245b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.10.35 - - [07/Aug/2022:14:35:29 +0800] "GET /jp/48568a7d324a245b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.10.9 - - [07/Aug/2022:14:36:04 +0800] "GET /jp/6f9d906e95d8079b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.9.75 - - [07/Aug/2022:14:36:13 +0800] "GET /jp/6f9d906e95d8079b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.79 - - [07/Aug/2022:14:36:21 +0800] "GET /jp/6f9d906e95d8079b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.67 - - [07/Aug/2022:14:36:30 +0800] "GET /jp/6f9d906e95d8079b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
120.244.123.240 - - [07/Aug/2022:14:49:50 +0800] "GET /jp/52e712138c98abe3/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/6f01d37f1a73ae06/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.187 - - [07/Aug/2022:14:51:12 +0800] "GET /jp/d72a7302dc6ce54c/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/e3d7f99c3efe1af9/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.178 - - [07/Aug/2022:14:52:50 +0800] "GET /jp/713be28558241dff/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/cb459f12f8607163/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.188 - - [07/Aug/2022:14:53:40 +0800] "GET /jp/4144c1ec0d717784/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/95c7d3429265f793/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.245.61.238 - - [07/Aug/2022:14:55:40 +0800] "GET /jp/95c7d3429265f793/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/df2cef61c243fa66/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
39.173.105.195 - - [07/Aug/2022:14:56:08 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Mobile Safari/537.36"
60.188.9.117 - - [07/Aug/2022:14:56:27 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Mobile Safari/537.36"
123.149.79.19 - - [07/Aug/2022:14:56:30 +0800] "GET /jp/2fc69ac028d7bdf0/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/9acbb5b9f1d2416d/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
101.67.49.165 - - [07/Aug/2022:14:56:49 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Mobile Safari/537.36"
121.31.16.19 - - [07/Aug/2022:14:57:21 +0800] "GET / HTTP/1.1" 403 31 "http://www.qcjianli.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52"
120.244.123.238 - - [07/Aug/2022:14:57:52 +0800] "GET /jp/d14c9841a8b3fd27/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/02a9258221deed50/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.77.109 - - [07/Aug/2022:14:59:55 +0800] "GET /jp/58902020fd50b79d/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/283c3793a35c5d3f/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
1.192.245.5 - - [07/Aug/2022:15:03:21 +0800] "GET /jp/ddb61e3ef8947d56/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/0194b9dbc7e88c2d/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.245.61.238 - - [07/Aug/2022:15:04:44 +0800] "GET /jp/e828f71550379697/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/62e30008ee767452/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.239 - - [07/Aug/2022:15:05:25 +0800] "GET /jp/dac5cf3d999c0216/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/73e3f15157f6c115/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
120.244.123.159 - - [07/Aug/2022:15:09:57 +0800] "GET /jp/ddac6a263435b302/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/c4497dd609988f76/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
1.192.242.212 - - [07/Aug/2022:15:11:36 +0800] "GET /jp/bfdf4a6f4fb3485e/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/708a77a16fba6c3d/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
114.217.36.232 - - [07/Aug/2022:15:13:21 +0800] "GET /css/album.css HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:48.0) Gecko/20100101 Firefox/48.0"
114.217.36.232 - - [07/Aug/2022:15:13:28 +0800] "GET /e/data/js/ajax.js HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:48.0) Gecko/20100101 Firefox/48.0"
121.31.16.19 - - [07/Aug/2022:15:18:33 +0800] "GET / HTTP/1.1" 403 31 "http://www.english28.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52"
20.24.81.186 - - [07/Aug/2022:15:18:40 +0800] "GET /e/data/js/ajax.js HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:48.0) Gecko/20100101 Firefox/48.0"
69.14.27.140 - - [07/Aug/2022:15:21:12 +0800] "GET / HTTP/1.1" 403 31 "http://linjian14.cn/a/about/" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
120.244.123.222 - - [07/Aug/2022:15:23:48 +0800] "GET /jp/25060f856076fa1d/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/a29d80c00e182a94/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
101.67.50.13 - - [07/Aug/2022:15:28:35 +0800] "GET /jp/cf5980305ab34f1b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "YisouSpider"
101.67.29.212 - - [07/Aug/2022:15:28:37 +0800] "GET /jp/cf5980305ab34f1b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
112.13.112.22 - - [07/Aug/2022:15:28:48 +0800] "GET /jp/cf5980305ab34f1b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.9.215 - - [07/Aug/2022:15:29:01 +0800] "GET /jp/cf5980305ab34f1b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
60.188.10.239 - - [07/Aug/2022:15:29:04 +0800] "GET /pianjiaming/be811353c1e55715/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
101.67.49.138 - - [07/Aug/2022:15:29:13 +0800] "GET /pianjiaming/be811353c1e55715/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
106.52.186.119 - - [07/Aug/2022:15:29:13 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36"
60.188.9.221 - - [07/Aug/2022:15:29:21 +0800] "GET /pianjiaming/be811353c1e55715/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
39.173.107.69 - - [07/Aug/2022:15:29:30 +0800] "GET /pianjiaming/be811353c1e55715/ HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36"
123.161.192.114 - - [07/Aug/2022:15:38:59 +0800] "GET /jp/c8a8a06f18b9b329/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/c2f87f8039048389/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.79.19 - - [07/Aug/2022:15:39:35 +0800] "GET /jp/46cbf95b7a3b7b11/ HTTP/1.1" 403 31 "https://www.qcjianli.com/001/a22.html" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.78.36 - - [07/Aug/2022:15:40:17 +0800] "GET /jp/e8aec12ca81757a6/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/f552a467194f0bd5/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.77.199 - - [07/Aug/2022:15:41:00 +0800] "GET /jp/92c0829e7e6908be/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/4a6011335891411b/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
1.192.245.228 - - [07/Aug/2022:15:41:45 +0800] "GET /jp/f5bce40c23da98b3/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/61c7810320e1ba31/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
45.120.4.50 - - [07/Aug/2022:15:41:52 +0800] "GET /e/data/js/ajax.js HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:48.0) Gecko/20100101 Firefox/48.0"
120.245.60.130 - - [07/Aug/2022:15:42:22 +0800] "GET /jp/9a7aeb0e1f1b9bf5/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/74069c784eafeb3e/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
121.31.16.19 - - [07/Aug/2022:15:43:12 +0800] "GET / HTTP/1.1" 403 31 "http://www.english28.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52"
139.9.192.21 - - [07/Aug/2022:15:45:00 +0800] "GET / HTTP/1.1" 403 31 "https://www.qcjianli.com/" "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"
139.9.192.21 - - [07/Aug/2022:15:45:08 +0800] "GET / HTTP/1.1" 403 31 " https://www.qcjianli.com/ " "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"
123.149.76.211 - - [07/Aug/2022:16:25:47 +0800] "GET /jp/f5606ea6d366b527/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/acc672cbd54f1ffd/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.79.132 - - [07/Aug/2022:16:27:03 +0800] "GET /jp/68e25ce21adfa54b/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/c0cbdeb8903add65/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
182.119.165.82 - - [07/Aug/2022:16:27:43 +0800] "GET /jp/9f854f0165b56e99/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/c004919180954b37/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
123.149.78.36 - - [07/Aug/2022:16:28:24 +0800] "GET /jp/e05be10d93a5860d/ HTTP/1.1" 403 31 "https://www.qcjianli.com/jp/aa30093e3d1863f3/" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Mobile Safari/537.36"
223.214.32.145 - - [07/Aug/2022:16:34:50 +0800] "GET / HTTP/1.1" 403 31 "http://www.english28.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52"

下面这份日志要稍微好一点，我禁止了部分IP，返回403状态码了，但是他明天别的IP又来。

  • 写回答

1条回答 默认 最新

  • kakaccys 2022-08-07 20:42
    关注

    可以根据user agent禁一下，我看里面有spider字样，然后user agent不同机器浏览器都有不同规范的，可以收集下，就知道私人电脑或手机与服务器爬取的user agent不一样，对服务器的请求可以降低loading速度，还有就是页面不要那么耿直，多异步加载，让他们爬取信息难度加大

    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题？

问题事件

  • 系统已结题 8月23日
  • 已采纳回答 8月15日
  • 创建了问题 8月7日

悬赏问题

  • ¥15 用ns3仿真出5G核心网网元
  • ¥15 matlab答疑 关于海上风电的爬坡事件检测
  • ¥88 python部署量化回测异常问题
  • ¥30 酬劳2w元求合作写文章
  • ¥15 在现有系统基础上增加功能
  • ¥15 远程桌面文档内容复制粘贴，格式会变化
  • ¥15 关于#java#的问题：找一份能快速看完mooc视频的代码
  • ¥15 这种微信登录授权 谁可以做啊
  • ¥15 请问我该如何添加自己的数据去运行蚁群算法代码
  • ¥20 用HslCommunication 连接欧姆龙 plc有时会连接失败。报异常为“未知错误”