目标是在这个天猫搜索页面上抓取与产品名配套的产品页超链接
<p class="productTitle">
<p class="productPrice">
<em title="99.00"><b>¥</b>99.00</em>
</p><a href="//detail.tmall.com/item.htm?id=538491424201&skuId=3921901643206&user_id=826813153&cat_id=55778004&is_b=1&rn=fe7996c620a7e58ef91046c7b2ef0d24" target="_blank" title="TATA木门 简约卧室门实木复合门卫生间门定制室内厨房门特权订金" data-p="1-11" atpanel="1-11,538491424201,50022358,,spu,1,spu,826813153,,,">
TATA<span class="H">木门</span> 简约卧室门实木复合门卫生间门定制室内厨房门特权订金
</a>
</p>
我写的抓取 产品名 和 价格的爬虫代码如下
import requests
import bs4
import re
import pandas as pd
url='https://list.tmall.com/search_product.htm?spm=a220m.1000858.1000724.1.171973e4CgRths&cat=55778004&q=%C4%BE%C3%C5&sort=s&style=g&from=.detail.pc_1_searchbutton&industryCatId=55778004#J_Filter'
response = requests.get(url).text
soup = bs4.BeautifulSoup(response,'html.parser')
name=[i.text.strip() for i in soup.findAll(name='p',attrs = {'class':'productTitle'})]
sale_price = [float(i.text[2:-1]) for i in soup.findAll(name='p',attrs = {'class':'productPrice'})]
jiaju = pd.DataFrame({'商品名':name,'卖价':sale_price,'
jiaju
如何用soup抓取和商品名和卖价配套的产品页超链接?