下面代码使用selenium代理ip为什么网页百度都打不开。

Question

from selenium import webdriver
url = 'http://www.baidu.com'
ids=["47.101.44.122:80"]
for id in ids:
    opt = webdriver.ChromeOptions()
    opt.add_argument('--proxy-server=http://{}'.format(id))
    #  创建浏览器对象的时候添加配置对象
    driver = webdriver.Chrome(chrome_options=opt)
    driver.get(url)

Answer 1

声明插件的路径要和本机chrome版本一致

driver_path = r'F:\extends\chrome91\chromedriver.exe'

driver_path = r'D:\Tool\ChromeDriver\chromedriver.exe'

声明一个谷歌插件，不加载图片#不加载图片节省时间

options = webdriver.ChromeOptions()
options.add_experimental_option('prefs', {'profile.managed_default_content_settings.images': 2})
options.add_experimental_option("excludeSwitches", ["enable-logging"])

无可视化

chrome_options = Options()

chrome_options.add_argument("--headless")

chrome_options.add_argument("--disable-gpu")
chrome_options.add_argument('--ignore-certificate-errors')
chrome_options.add_argument('--proxy-server=http://47.101.44.122:80')

规避检测

option = webdriver.ChromeOptions()
option.add_experimental_option('excludeSwitches', ['enable-automation'])

url = 'http://www.baidu.com'
driver = webdriver.Chrome(executable_path=driver_path, chrome_options=chrome_options, options=options)
driver.get(url)

我可以