weixin_45181731 2021-11-14 14:01 采纳率: 0%
浏览 21
已结题

python 爬虫 requests ,windows本地能拿到数据,linux部署后无法拿到数据


tem_cookies = 'JSESSIONID=vKAck3xWLZZS0KULDt6iqoqPgHFbBbcXs7QLR6330LlDyVBLgufe!-1288418675; ssologinFlagCookieName=2; CASTGC=TGT-1313-FMQ7WEH4J7yXlhMr6DMQgoQsA3dB6sk4axEdLIh0iMfa4mWYzf-cas; itemList=%5B%7B%22handleItemCode%22%3A%2211650100010198604G365201400100201%22%2C%22handleItemName%22%3A%22%E4%BA%BA%E5%91%98%E5%81%9C%E4%BF%9D%22%2C%22serviceTarget%22%3A%222%5E1%22%2C%22description%22%3A%22%22%2C%22accessUrl%22%3A%22http%3A%2F%2F222.82.215.217%3A9921%2Fpc%2Ffrfw%2F11650100010198604G365201400100201.html%22%7D%2C%7B%22handleItemCode%22%3A%2211650100010198604G365201400150201%22%2C%22handleItemName%22%3A%22%E6%89%B9%E9%87%8F%E5%A2%9E%E4%BA%BA%22%2C%22serviceTarget%22%3A%222%22%2C%22description%22%3A%22%22%2C%22accessUrl%22%3A%22http%3A%2F%2F222.82.215.217%3A9921%2Fpc%2Ffrfw%2F11650100010198604G365201400150201.html%22%7D%2C%7B%22handleItemCode%22%3A%2211650000564385946A265201400150201%22%2C%22handleItemName%22%3A%22%E6%89%B9%E9%87%8F%E5%A2%9E%E4%BA%BA%22%2C%22serviceTarget%22%3A%222%22%2C%22description%22%3A%22%22%2C%22accessUrl%22%3A%22http%3A%2F%2F222.82.215.217%3A9921%2Fpc%2Ffrfw%2F11650000564385946A265201400150201.html%22%7D%5D; BIGipServerpool_ggfw_wwtydd=189516298.18207.0000; unReadMessageTotal=9; isAsync=0; taskList=%5B%5D; JSESSIONID=9OQc8zhC2VWsZCjGjendb80XA4_QsTqW3SvSwwzxeRxUiZ34v39U!-1998429003'
cookies = cookies_str_to_dict(tem_cookies)
print(cookies)
resp = requests.get(company_info_url, headers=headers,cookies=cookies,timeout=60)
print('resp.request.cookies:----', resp.request._cookies, '\n')
print(resp.cookies, '\n')
print('resp.request.headers:----', resp.request.headers,'\n')
soup = BeautifulSoup(resp.content.decode('utf-8'), 'lxml')
officeNo = soup.select('#officeNo')[0].attrs['value']  # 获取流水号
print('流水号获取成功:',officeNo)

这段请求在windows本地能获取流水号,

img

在Linux上就拿不到获取流水号 :

img

我打印了在linux上跑的cookies,发现请求都是带了我传的cookies,但是服务器响应还是会给一个新的 JSESSIONID,不知道这是什么原因,同样的代码本地都能跑,linux上就是不行

img

  • 写回答

0条回答 默认 最新

    报告相同问题?

    问题事件

    • 系统已结题 11月22日
    • 创建了问题 11月14日

    悬赏问题

    • ¥15 jetson nano
    • ¥15 :app:debugCompileClasspath'.
    • ¥15 windows c++内嵌qt出现数据转换问题。
    • ¥20 公众号如何实现点击超链接后自动发送文字
    • ¥15 用php隐藏类名和增加类名
    • ¥15 算法设计与分析课程的提问
    • ¥15 用MATLAB汇总拟合图
    • ¥15 智能除草机器人方案设计
    • ¥15 对接wps协作接口实现消息发送
    • ¥15 SQLite 出现“Database is locked” 如何解决?