python webdriver如何获取网页html

Question

from selenium import webdriver
from time import sleep

driver = webdriver.Chrome("D:/chromedriver/chromedriver.exe")
driver.get("https://www.douyin.com/video/7253737735683329338")
sleep(2)
html = driver.page_source

print(html)

这是用webdriver获取的网页源代码，请问如何获取被渲染后的代码？就是这个部分

Answer 1

很多种方法，beautifulsoup或者xpath，都有调用案例的，

from selenium import webdriver
from bs4 import BeautifulSoup
from time import sleep

# 设置driver路径
driver = webdriver.Chrome("D:/chromedriver/chromedriver.exe")

# 打开网页
driver.get("https://www.douyin.com/video/7253737735683329338")
# 等待页面加载
sleep(2)

# 获取页面源代码
html = driver.page_source

# 使用BeautifulSoup解析页面
soup = BeautifulSoup(html, 'html.parser')

# 查找video标签
video_tags = soup.find_all('video')

# 遍历video标签并打印内容
for video in video_tags:
    print(video)

# 关闭浏览器
driver.quit()