本地爬虫一切正常,阿里云却超时报错。
是这样,写个一个签到的python程序,使用的是requests库。
在本地pycharm和vscode都做过测试,一切正常,软件也成功显示签到成功。
因为是签到,所以想挂载云服务器进行定时操作,可所有代码都完成了,没想到卡在挂载服务器几天时间!
我用的是阿里云的服务器,目标链接是:
https://api.moguding.net:9000/
```python
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 170, in _new_conn
(self._dns_host, self.port), self.timeout, **extra_kw
File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 96, in create_connection
raise err
File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 86, in create_connection
sock.connect(sa)
OSError: [Errno 101] Network is unreachable
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 382, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 353, in connect
conn = self._new_conn()
File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 182, in _new_conn
self, "Failed to establish a new connection: %s" % e
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f3c11d8fb38>: Failed to establish a new connection: [Errno 101] Network is unreachable
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 756, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 573, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.***********.net', port=9000): Max retries exceeded with url: /session/user/v3/login (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f3c11d8fb38>: Failed to establish a new connection: [Errno 101] Network is unreachable',))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/www/wwwroot/python/mgdli/login.py", line 84, in <module>
loginGetInfo(login_url)
File "/www/wwwroot/python/mgdli/login.py", line 78, in loginGetInfo
loginResponse = requests.post(login_url, headers=login_header, data=login_data, timeout=20)
File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 117, in post
return request('post', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 516, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='api.moguding.net', port=9000): Max retries exceeded with url: /session/user/v3/login (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f3c11d8fb38>: Failed to establish a new connection: [Errno 101] Network is unreachable',))
这个是报错的信息,我一开始以为是代码的问题,但是后来只是用基础的get请求,也还是一样的超时之后报错!
1. 一开始我以为是的服务器IP原因,后来用了代理IP在服务器运行,也还是不行!!
2. 我服务器的其他定时项目都没有任何问题可以执行,链接换成别的就可以执行,就是这个链接他超时。
3. 我用朋友的阿里云服务器试了一下,也还是同样的问题。
4. 突破口:用腾讯云函数可以运行,前提是打开了“**固定公网出口 IP**”这个选项!!如果不开启,也是超时之后报错。
![img](https://img-mid.csdnimg.cn/release/static/image/mid/ask/614877502936179.png "#left")
我想过或许阿里云也有相关的设置,但是我网络这块不是很懂,所以没有找到,也不是很明白打开这个选项的作用。
**问题总结**:爬虫程序本地运行正常,阿里云运行超时之后报错,其他链接却一切正常。利用腾讯云可以运行,前提是得开启“固定公网出口IP”,请问如何解决阿里云报错的问题,有没有大佬知道问题的所在。已经研究很久了,奈何知识面不行,求解呀!