python爬虫如何用beautifulsoup提取多层div标签下的内容

Question

用request提取到的HTMLdiv标签未能展开，用findall方法，传入“div”“类名”做参数，也提取不到任何内容，求教！

Answer 1

URL是要爬的网址，classname是对应的类名称

import requests 
import bs4 
import re 
url='https://www.XXXX.com'
response = requests.get(url).text
soup = bs4.BeautifulSoup(response,'html.parser')
 for i in soup.findAll(name='div',attrs = {'class':'classname'})       
    print (i)