问题遇到的现象和发生背景
豆瓣简单 初学案例
问题相关代码,请勿粘贴
import requests, bs4
引用requests库
url = 'https://movie.douban.com/top250?start=0&filter=%27
res = requests.get(url)
bs = bs4.BeautifulSoup(res.text, 'html.parser')
print(bs.text)
运行结果及报错内容
空白
豆瓣简单 初学案例
import requests, bs4
url = 'https://movie.douban.com/top250?start=0&filter=%27
res = requests.get(url)
bs = bs4.BeautifulSoup(res.text, 'html.parser')
print(bs.text)
空白
缺少请求头user-agent,被反扒了没返回内容,要加上
import requests
import bs4
url = 'https://movie.douban.com/top250?start=0&filter='
headers={'user-agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.60 Safari/537.36 Edg/100.0.1185.29'}
res = requests.get(url,headers=headers)
bs = bs4.BeautifulSoup(res.text, 'html.parser')
print(bs.text)