douzhi7451 2019-04-29 06:29
浏览 51

Web-Crawler使用PHP Laravel

I need to develop a web-crawler for Aliexpress product page details. Everything is possible without shipping pop-up data. If I call it's returning null value because click event not working.

Image 01:

LINK

Image 02:

POP-UP

Like image 1 when I click the link it shows a pop-up as like image 2 and I need the pop-up data. It's possible to do with python but I need to do with PHP. If I click the link it will not change the link but it's changing the HTML contents of the page. But I can't grub after change which is possible with python.

What I have done with PYTHON:

def extract_product_info(product_url):
    time.sleep(5)
    driver.get(product_url)
    try:
        print("Got You....")
        driver.find_element_by_class_name('close-layer').click()
    except:
        print("Didn't get You....")

    time.sleep(5)
    driver.find_element_by_class_name('shipping-link').click() # Click 
    time.sleep(5)
    content = driver.page_source

    soup = BeautifulSoup(content, "html.parser")
    print("Calculating...")
    popup = soup.find('div', {'id': 'j-shipping-dialog'})
    #print(popup)
    return popup

Can anyone help me to do with PHP?

  • 写回答

0条回答 默认 最新

    报告相同问题?

    悬赏问题

    • ¥15 虚幻5 UE美术毛发渲染
    • ¥15 CVRP 图论 物流运输优化
    • ¥15 Tableau online 嵌入ppt失败
    • ¥100 支付宝网页转账系统不识别账号
    • ¥15 基于单片机的靶位控制系统
    • ¥15 真我手机蓝牙传输进度消息被关闭了,怎么打开?(关键词-消息通知)
    • ¥15 装 pytorch 的时候出了好多问题,遇到这种情况怎么处理?
    • ¥20 IOS游览器某宝手机网页版自动立即购买JavaScript脚本
    • ¥15 手机接入宽带网线,如何释放宽带全部速度
    • ¥30 关于#r语言#的问题:如何对R语言中mfgarch包中构建的garch-midas模型进行样本内长期波动率预测和样本外长期波动率预测