python爬取百度手机号网页

Question

需要爬取的网页

https://mhaoma.baidu.com/pages/search-result/search-result?search=133289362000

每次修改手机号，获取手机号的省份和运营商。

Answer 1

可以用requests.post获取，需要将参数正确传递。代码可以这么写：

import requests
import time
num=input('input cellphone number:')
cookies = {
    'BAIDUID': 'B9E86217FB86866A0FDFC65E4CEAD295:FG=1',
    'BAIDUID_BFESS': 'B9E86217FB86866A75380F679E91D25B:FG=1',
    '__yjs_duid': '1_52cd9cce9f155e9ed858e9b94013db941632189203405',
    'Hm_lvt_45689532c5e0c7e585dbe1408c0f3526': f'{int(time.time())}',
    'Hm_lpvt_45689532c5e0c7e585dbe1408c0f3526': f'{int(time.time())}',
    'ab_sr': '1.0.1_MGYyMjI3MjczMTljNTJkZDQ2ZGM3NDgyYTg5NThkYTVlOTVmZTZjODg1ZjA2M2M0MDlkMjg2MjJmNDNlNzhmYWVhZDRiYWRiNzJjNjhhNmRkNTg5MDkxMDEwZDBmYjViY2I1NjU3NTNjZjljNWFmMjU4ZjFjNjYwYjBlNGYwZDRjODkzMGUxMGRjOGUyZjBkMTBkNjI5ZTE1N2M3ZjZjMQ==',
}

headers = {    
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36 Edg/93.0.961.52', 
    'Referer': 'https://mhaoma.baidu.com/pages/search-result/search-result?search=133289362000'}
data = '{"data":"6ce8513d9edb395d98575c3b07404466e788e5f2977a6edfbeaac56a199265d2604faeae757a140a4970526d6d414e0fc675144777f7a7433af1fd06359afd5bfee705da988431567bdb98bcc8a72d4855f221e973d3cb650e59c4d4c9e756b5","key_id":"47","sign":"a32e83fe","search":"%s"}'%num

response = requests.post('https://mhaoma.baidu.com/api/v1/search', headers=headers, cookies=cookies, data=data)
print(response.json())

如果回答对你有帮助，请点击我回答的右上方采纳按钮予以采纳。