I am trying to scrape product video links (which are generated dynamically by another web service. The location is under the product images on the left side). You can check following link, https://www.tokopedia.com/chocoapple/ready-stock-bnib-iphone-128gb-7-plus-jet-black-garansi-apple-1-tahun-10?src=topads The google chrome "inspect element" shows the div tag. But The same tag is not present in the page source. How to do it? I am looking into goQuery to implement the task but not sure will it work or not. I am not a web developer so please consider giving suggestions if my question description is not specific. Thank you.
GoLang刮板机。 如何在网站上抓取动态生成的链接？
- 写回答
- 好问题 0 提建议
- 追加酬金
- 关注问题
分享- 邀请回答
-
3条回答 默认 最新
- doushi4633 2017-08-27 14:36关注
If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source using a jQuery-like API.
You need to first process the webpage with a headless WebKit like phantomjs, chromeless, or puppeteer. Each of these tools will allow you to process all the Javascript on the webpage before processing it. This way, the AJAX for rendering the video you are interest in will be processed and the source will be updated. You can then download the corresponding source which should have the div in it.
本回答被题主选为最佳回答 , 对您是否有帮助呢?解决 无用评论 打赏举报 分享
- 2017-08-27 13:39回答 3 已采纳 If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source us
- 2016-10-05 07:37回答 2 已采纳 There is no equivalent to PHP's range in the Go standard library. You have to create one yourself.
- 2019-04-18 17:19回答 2 已采纳 I have solved it by retrieving the WebSocket object from the global JavaScript object, which in my
- 2022-03-02 23:53zz_jesse的博客 作者:阅文前端团队原文:https://mp.weixin.qq.com/s/0dWfL3ChIceH6rQ8-Oh6pg一、背景在业务需求中，根据返回数据动态生成图片分享是很常见的场景。...
- 2019-09-10 00:27回答 1 已采纳 To call the method from the type, you must pass a reflect.Value instance that provides the Foo obj
- 2019-03-15 20:45回答 2 已采纳 In that blog post, Docker containers are used to simulate a remote machine. GoLand doesn't have a
- 2017-10-28 16:35回答 4 已采纳 Use https://golang.org/pkg/net/http/#ListenAndServeTLS http.HandleFunc("/", handler) log.Printf("
- 2022-02-16 08:32三雷科技的博客 go语言有很多的库,在开发c语言的时候为了快速完成某些功能,可以直接通过go语言的库进行调用.那么我们将go语言开发的程序编译成so动态库文件就可以给c或者c++程序调用. 目录 go文件编写 so编译命令 C语言测试程序...
- 2016-04-07 18:31回答 3 已采纳 This is your program from the edit with a interface type implementation: package main import (
- 2018-09-14 08:15回答 3 已采纳 So, i found the solution. Big thanks to this guy, his code fits perfectly for me, love the way it
- 2015-12-02 12:54回答 1 已采纳 Linux syscalls are used directly without loading a library, exactly how depends on which system ca
- 2021-02-26 00:021024-iot-SaltIce的博客 *Builder { return b.AddField(name, reflect.TypeOf(float64(1.2))) } // 实际生成的结构体，基类 // 结构体的类型 type Struct struct { typ reflect.Type // // 用于通过字段名称，从Builder的[]reflect....
- 2023-03-14 23:29回答 2 已采纳 不知道你这个问题是否已经解决, 如果还没有解决的话: 这有个类似的问题, 你可以参考下: https://ask.csdn.net/questions/7739247我还给你找了一篇非常好的博客，你可
- 2023-12-15 07:00The-Venus的博客 希望本文能够帮助读者了解Go语言的优势，并在项目开发中做出明智的选择。如果大家对相关文章感兴趣，可以关注公众号"架构殿堂"，会持续更新AIGC，java基础面试题, netty, spring boot, spring cloud等系列文章，一...
- 2022-05-14 08:15
golang后端动态生成图片、一文搞懂image/draw使用、一张图片粘贴到另一张图片上、根据url获取图片内容、在图片周围画线、invalidJPEGformat: missingSOImarkeyida&yueda的博客 golang image/draw 的使用 - 没有解决我的问题, 去提问
悬赏问题
- ¥15 CCF-CSP 2023 第三题 解压缩(50％)
- ¥30 comfyui openpose报错
- ¥20 Wpf Datarid单元格闪烁效果的实现
- ¥15 图像分割、图像边缘提取
- ¥15 sqlserver执行存储过程报错
- ¥100 nuxt、uniapp、ruoyi-vue 相关发布问题
- ¥15 浮窗和全屏应用同时存在，全屏应用输入法无法弹出
- ¥100 matlab2009 32位一直初始化
- ¥15 Expected type 'str | PathLike[str]…… bytes' instead
- ¥15 三极管电路求解，已知电阻电压和三级关放大倍数