问题遇到的现象和发生背景
我想爬工商银行积存金的信息,使用xpath提取,但是从浏览器上复制的xpath打印出来是空列表,我应该怎么解决
问题相关代码,请勿粘贴截图
import requests
import logging
from lxml import etree
logging.basicConfig(level=logging.INFO,format='%(asctime)s-%(levelname)s:%(message)s')
BASE_URL='https://mybank.icbc.com.cn/icbc/newperbank/perbank3/frame/frame_index.jsp?serviceId=PBL200603'
def scrape_page(url):
logging.info('scraping %s...',url)
try:
response=requests.get(url)
if response.status_code==200:
return response.text
logging.error('get invalid status code %s while scraping %s',response.status_code,url)
except requests.RequestException:
logging.error('error occurred while scraping %s',url,exc_info=True)
yuanma=scrape_page(BASE_URL)
html=etree.HTML(yuanma)
result=html.xpath('/html/body/div/table/tbody/tr[2]/text()')
print(result)
运行结果及报错内容
[]
我的解答思路和尝试过的方法
我想要达到的结果
成功爬取积存金信息