I am trying to scrape product video links (which are generated dynamically by another web service. The location is under the product images on the left side). You can check following link, https://www.tokopedia.com/chocoapple/ready-stock-bnib-iphone-128gb-7-plus-jet-black-garansi-apple-1-tahun-10?src=topads The google chrome "inspect element" shows the div tag. But The same tag is not present in the page source. How to do it? I am looking into goQuery to implement the task but not sure will it work or not. I am not a web developer so please consider giving suggestions if my question description is not specific. Thank you.
GoLang刮板机。 如何在网站上抓取动态生成的链接？
- 写回答
- 好问题 0 提建议
- 追加酬金
- 关注问题
分享- 邀请回答
-
3条回答 默认 最新
- doushi4633 2017-08-27 14:36关注
If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source using a jQuery-like API.
You need to first process the webpage with a headless WebKit like phantomjs, chromeless, or puppeteer. Each of these tools will allow you to process all the Javascript on the webpage before processing it. This way, the AJAX for rendering the video you are interest in will be processed and the source will be updated. You can then download the corresponding source which should have the div in it.
本回答被题主选为最佳回答 , 对您是否有帮助呢?解决 无用评论 打赏举报 分享
- 2017-08-27 13:39回答 3 已采纳 If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source us
- 2016-10-05 07:37回答 2 已采纳 There is no equivalent to PHP's range in the Go standard library. You have to create one yourself.
- 2019-04-18 17:19回答 2 已采纳 I have solved it by retrieving the WebSocket object from the global JavaScript object, which in my
- 2022-02-16 08:32三雷科技的博客 go语言有很多的库,在开发c语言的时候为了快速完成某些功能,可以直接通过go语言的库进行调用.那么我们将go语言开发的程序编译成so动态库文件就可以给c或者c++程序调用. 目录 go文件编写 so编译命令 C语言测试程序...
- 2019-09-10 00:27回答 1 已采纳 To call the method from the type, you must pass a reflect.Value instance that provides the Foo obj
- 2019-03-15 20:45回答 2 已采纳 In that blog post, Docker containers are used to simulate a remote machine. GoLand doesn't have a
- 2017-10-28 16:35回答 4 已采纳 Use https://golang.org/pkg/net/http/#ListenAndServeTLS http.HandleFunc("/", handler) log.Printf("
- 2021-02-26 00:021024-iot-SaltIce的博客 *Builder { return b.AddField(name, reflect.TypeOf(float64(1.2))) } // 实际生成的结构体，基类 // 结构体的类型 type Struct struct { typ reflect.Type // // 用于通过字段名称，从Builder的[]reflect....
- 2016-04-07 18:31回答 3 已采纳 This is your program from the edit with a interface type implementation: package main import (
- 2018-09-14 08:15回答 3 已采纳 So, i found the solution. Big thanks to this guy, his code fits perfectly for me, love the way it
- 2023-03-14 23:29回答 2 已采纳 不知道你这个问题是否已经解决, 如果还没有解决的话: 这有个类似的问题, 你可以参考下: https://ask.csdn.net/questions/7739247我还给你找了一篇非常好的博客，你可
- 2022-02-19 16:28驭鲸·环球的博客 在 windows 系统平台上，dll 动态库没有提供 .lib 文件，又不想动态获取函数地址怎么办？ 使用 lib.exe 工具可以根据 .def 定义文件生成 .lib 文件。 例如，我这里有一个 test.dll 动态库文件，我想要生成 lib 链接...
- 2018-04-05 10:20回答 2 已采纳 This code will works package main import ( "bytes" "encoding/json" "fmt" "log" "string
- 2023-12-15 07:00The-Venus的博客 希望本文能够帮助读者了解Go语言的优势，并在项目开发中做出明智的选择。如果大家对相关文章感兴趣，可以关注公众号"架构殿堂"，会持续更新AIGC，java基础面试题, netty, spring boot, spring cloud等系列文章，一...
- 2019-07-10 20:36Grayan的博客 开发过程中难免要用到UUID，Golang标准库好像没有提供生成UUID的方法,在Github上面发现了一个不错的库. satori/go.uuid提供了五种生成UUID的方式: Version 1,基于 timestamp 和 MAC address (RFC 4122) Version 2,...
- 没有解决我的问题, 去提问
悬赏问题
- ¥15 安卓adb backup备份应用数据失败
- ¥15 eclipse运行项目时遇到的问题
- ¥15 关于#c##的问题：最近需要用CAT工具Trados进行一些开发
- ¥15 南大pa1 小游戏没有界面，并且报了如下错误，尝试过换显卡驱动，但是好像不行
- ¥15 没有证书，nginx怎么反向代理到只能接受https的公网网站
- ¥50 成都蓉城足球俱乐部小程序抢票
- ¥15 yolov7训练自己的数据集
- ¥15 esp8266与51单片机连接问题(标签-单片机|关键词-串口)（相关搜索：51单片机|单片机|测试代码）
- ¥15 电力市场出清matlab yalmip kkt 双层优化问题
- ¥30 ros小车路径规划实现不了，如何解决？(操作系统-ubuntu)