问题遇到的现象和发生背景
爬题库的时候,将选择题选项和内容如何横向拼接在一起
用代码块功能插入代码,请勿粘贴截图
import requests
from bs4 import BeautifulSoup
for i in range(25703, 25705):
url = "http://kjds.52jingsai.com/reviewx.php?snum={}".format(i)
# 模拟浏览器的访问
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.36',
'Cookie': 'PHPSESSID=698octtqm0auki0ol0lhnaom5u; qqopenid=63F6832C8BDB537EB8472808AA00F409; qqnick=%B6%A5%BC%B6%F2%E5%F2%EF'}
res = requests.get(url, headers=headers)
if res.status_code == 200:
# 1.获取网页源代码
raw_text = res.text
# with open('mybaidu.html', 'w', encoding="utf-8") as f:
# f.write(raw_text)
soup = BeautifulSoup(raw_text, 'lxml') # 设置解析库为
res = soup.select('div[class="subject_item"]')
for i in res:
print(i.findNext(attrs={"class": "subject_title"}).text) # 题干和正确答案
for j in i.findNext(attrs={"class": "choose_answer"}).find_all("div", {"class": {"a_1", "a_2"}}):
print(j.text)
# for x in i.find_all("div", {"class": {"a_1", "a_2"}}):
# print(x.text)
运行结果及报错内容
我的解答思路和尝试过的方法
用了findNext将数据纵向拼接在一起,想请教如何横向拼接在一起