douzhi7451 2019-04-29 06:29
浏览 51

Web-Crawler使用PHP Laravel

I need to develop a web-crawler for Aliexpress product page details. Everything is possible without shipping pop-up data. If I call it's returning null value because click event not working.

Image 01:

LINK

Image 02:

POP-UP

Like image 1 when I click the link it shows a pop-up as like image 2 and I need the pop-up data. It's possible to do with python but I need to do with PHP. If I click the link it will not change the link but it's changing the HTML contents of the page. But I can't grub after change which is possible with python.

What I have done with PYTHON:

def extract_product_info(product_url):
    time.sleep(5)
    driver.get(product_url)
    try:
        print("Got You....")
        driver.find_element_by_class_name('close-layer').click()
    except:
        print("Didn't get You....")

    time.sleep(5)
    driver.find_element_by_class_name('shipping-link').click() # Click 
    time.sleep(5)
    content = driver.page_source

    soup = BeautifulSoup(content, "html.parser")
    print("Calculating...")
    popup = soup.find('div', {'id': 'j-shipping-dialog'})
    #print(popup)
    return popup

Can anyone help me to do with PHP?

  • 写回答

0条回答 默认 最新

    报告相同问题?

    悬赏问题

    • ¥15 一道python难题
    • ¥15 用matlab 设计一个不动点迭代法求解非线性方程组的代码
    • ¥15 牛顿斯科特系数表表示
    • ¥15 arduino 步进电机
    • ¥20 程序进入HardFault_Handler
    • ¥15 oracle集群安装出bug
    • ¥15 关于#python#的问题:自动化测试
    • ¥20 问题请教!vue项目关于Nginx配置nonce安全策略的问题
    • ¥15 教务系统账号被盗号如何追溯设备
    • ¥20 delta降尺度方法,未来数据怎么降尺度