浏览器能正常访问的URL,使用爬虫访问(不是频繁请求,就单次运行请求)直接报错:“requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, '远程主机强迫关闭了一个现有的连接。', None, 10054, None))
”
import requests
session = requests.session()
headerss = {
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7',
'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
'Connection': 'keep-alive',
'Sec-Fetch-Dest': 'document',
'Sec-Fetch-Mode': 'navigate',
'Sec-Fetch-Site': 'none',
'Sec-Fetch-User': '?1',
'Upgrade-Insecure-Requests': '1',
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36 Edg/124.0.0.0',
'sec-ch-ua': '"Chromium";v="124", "Microsoft Edge";v="124", "Not-A.Brand";v="99"',
'sec-ch-ua-mobile': '?0',
'sec-ch-ua-platform': '"Windows"',
}
response = session.get('https://fdrfw....xyz/ui/comics/main', headers=headerss,timeout=20 ,verify=False)
print(response.status_code)
该域名下的所有get,post请求都是无响应,但是浏览器都能正常访问,试过的解决方案都不行,比如:随机User-Agent,代理IP,更换新电脑(不同网络),手机运行代码都是无响应直接报错!因为URL有些违规,所以做了删减一些字符处理,就像问下有遇到这情况的网友是有什么解决思路吗?