Python爬虫保存csv文件

Question

请问如何将已经爬取出来的内容放到writer.writerows()的括号里，并将爬取出来的数据按照年份保存到对应的csv文件中。题目要求使用request库和beautifulsoup库🙏🙏🙏

Answer 1

import pandas as pd
import requests
data=pd.DataFrame()
for i in range(1994,2023):
    url=f"http://www.boxofficecn.com/boxoffice{i}"
    headers = {
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36'
    }
    dd=requests.get(url,headers=headers)
    df=pd.read_html(dd.content.decode())[0]
    df.columns=['序列','年份','电影名称','票房总额(万元)']
    data=pd.concat([data,df])
data.index = pd.RangeIndex(start=1, stop=len(data)+1, step=1)
data.to_csv('e:/1.csv',encoding='gb18030')