球助：无头模式被识别

Question

I scrape website https://www.microchipdirect.com/api/Product/ProductInfo?CPN=STM8L052C6T6, it will show 'access deny' if you do not goto https://www.microchipdirect.com/ first.It was OK.

Problem: I use pyppeteer,it runs successfully, when I use headless mode, it failed.

my pyppeteer params:

await stealth(
        page=page,
        user_agent=user_agent,
        languages=['zh-CN', 'zh'],
        locale="zh-CN,zh",
        render='ANGLE (Intel(R) UHD Graphics 630 Direct3D11 vs_5_0 ps_5_0)',
        webgl_vendor="Intel Inc.",
    )

browser_args = [
        '--no-sandbox',  
        '--disable-setuid-sandbox', 
        '--disable-dev-shm-usage', 
        '--disable-accelerated-2d-canvas', 
        '--disable-gpu',  
        '--no-default-browser-check',  
    ]

Answer 1

问题不是已经说了吗。你必须先访问https://www.microchipdirect.com/ 然后在访问目标网址，请求头加一个refer应该就好了