python如何反反爬？

Question

UA，cookie,handler都用了，还是不行，该怎么办呢？
笔趣阁。

Answer 1

能让我看看你完整的请求头吗？
由于浏览器可以正常打开你的网站，所以你必须尽可能模仿浏览器的行为，如果你的请求头只写UA，Cookie，handler，怕网站不会给你通过。
firefox对于你的目标网站请求头长这样：

GET /16750/223331.html HTTP/3
Host: www.beqege.cc
User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:109.0) Gecko/20100101 Firefox/115.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8
Accept-Language: zh-CN,zh;q=0.8,zh-TW;q=0.7,zh-HK;q=0.5,en-US;q=0.3,en;q=0.2
Accept-Encoding: gzip, deflate, br
Alt-Used: www.beqege.cc
Connection: keep-alive
Cookie: cf_clearance=hFt3tqQzwm_H4dmwHWyApDPxjvILnwhVLdhz.c6gIWY-1691912651-0-1-4baf00ee.5cf7af74.20d4e7a3-0.2.1691912651; __gads=ID=7f4a8286638d52f5-220dc265d1e2002d:T=1691912651:RT=1691912651:S=ALNI_MaTdRHH9Um86XPcSv4cu95fLbR9lQ; __gpi=UID=00000c2c0157e013:T=1691912651:RT=1691912651:S=ALNI_MajKcWamQuejVOcBXC3ChKDZHww1A
Upgrade-Insecure-Requests: 1
Sec-Fetch-Dest: document
Sec-Fetch-Mode: navigate
Sec-Fetch-Site: none
Sec-Fetch-User: ?1
If-Modified-Since: Sun, 04 Dec 2022 12:29:52 GMT
TE: trailers

你可以删除没有用的部分，保留这些试试：

User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:109.0) Gecko/20100101 Firefox/115.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8
Accept-Language: zh-CN,zh;q=0.8,zh-TW;q=0.7,zh-HK;q=0.5,en-US;q=0.3,en;q=0.2
Alt-Used: www.beqege.cc
Connection: keep-alive