dragonlew9876 2019-09-02 01:26
浏览 1563
已采纳

GoColly为每个请求设置代理

I started to deal with Colly. I am trying to set a proxy for every request. But all requests do not go through a proxy

It should work https://github.com/gocolly/colly/blob/master/request.go#L52

I have added this to my code. But requests go without a proxy as before

c.OnRequest(func(r *colly.Request) { 
  r.ProxyURL = "..." 
}

Maybe I didn’t understand correctly how this should work

  • 写回答

1条回答 默认 最新

  • douxiong4892 2019-09-02 01:38
    关注

    Instead of setting ProxyURL in the callback function, have you tried setting it on the collector ?

    // SetProxy sets a proxy for the collector. This method overrides the previously
    // used http.Transport if the type of the transport is not http.RoundTripper.
    // The proxy type is determined by the URL scheme. "http"
    // and "socks5" are supported. If the scheme is empty,
    // "http" is assumed.
    func (c *Collector) SetProxy(proxyURL string) error {
        proxyParsed, err := url.Parse(proxyURL)
        if err != nil {
            return err
        }
    
        c.SetProxyFunc(http.ProxyURL(proxyParsed))
    
        return nil
    }
    
    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论
编辑
预览

报告相同问题?

悬赏问题

  • ¥15 PADS Logic 原理图
  • ¥15 PADS Logic 图标
  • ¥15 电脑和power bi环境都是英文如何将日期层次结构转换成英文
  • ¥20 气象站点数据求取中~
  • ¥15 如何获取APP内弹出的网址链接
  • ¥15 wifi 图标不见了 不知道怎么办 上不了网 变成小地球了
手机看
程序员都在用的中文IT技术交流社区

程序员都在用的中文IT技术交流社区

专业的中文 IT 技术社区,与千万技术人共成长

专业的中文 IT 技术社区,与千万技术人共成长

关注【CSDN】视频号,行业资讯、技术分享精彩不断,直播好礼送不停!

关注【CSDN】视频号,行业资讯、技术分享精彩不断,直播好礼送不停!

客服 返回
顶部