python爬虫怎么获取element元素script标签里的json？

Question

python爬虫怎么获取element元素script标签里的json？
除了selenium，
直接请求的到的数据和元素里的不一样（请求到的数据有个）

这种动态json是什么生成逻辑？
该怎么用python请求到想要的数据呢？

Answer 1

望采纳！！！

import re
from bs4 import BeautifulSoup
from urllib.request import urlopen
url = "你要解析的网页URL"
html = urlopen(url).read()
soup = BeautifulSoup(html,"html.parser")
titles = soup.select("body  script") # CSS 选择器
i = 1
for title in titles:
    if i == 3:
     #print(title.get_text())# 标签体、标签属性
     str=title.get_text()
     break
    if i == 2:
        i = 3
    if i == 1:
        i = 2
 
print(str)
str1 = "\"\"\""+"<script>"+str+"</script>"+"\"\"\""
soup = BeautifulSoup(str1, "html.parser")
pattern = re.compile(r"var _url = '(.*?)';$", re.MULTILINE | re.DOTALL)
script = soup.find("script", text=pattern)
#print (pattern.search(script.text).string)
s = pattern.search(script.text).string
print (s.split('\'')[11])