I am trying to scrape product video links (which are generated dynamically by another web service. The location is under the product images on the left side). You can check following link, https://www.tokopedia.com/chocoapple/ready-stock-bnib-iphone-128gb-7-plus-jet-black-garansi-apple-1-tahun-10?src=topads The google chrome "inspect element" shows the div tag. But The same tag is not present in the page source. How to do it? I am looking into goQuery to implement the task but not sure will it work or not. I am not a web developer so please consider giving suggestions if my question description is not specific. Thank you.
GoLang刮板机。 如何在网站上抓取动态生成的链接？
- 写回答
- 好问题 0 提建议
- 追加酬金
- 关注问题
分享- 邀请回答
-
3条回答 默认 最新
- doushi4633 2017-08-27 14:36关注
If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source using a jQuery-like API.
You need to first process the webpage with a headless WebKit like phantomjs, chromeless, or puppeteer. Each of these tools will allow you to process all the Javascript on the webpage before processing it. This way, the AJAX for rendering the video you are interest in will be processed and the source will be updated. You can then download the corresponding source which should have the div in it.
本回答被题主选为最佳回答 , 对您是否有帮助呢?解决 无用评论 打赏举报 分享
- 2017-08-27 13:39回答 3 已采纳 If the tag is not in the source, then GoQuery will not work. GoQuery is for parsing HTML source us
- 2016-10-05 07:37回答 2 已采纳 There is no equivalent to PHP's range in the Go standard library. You have to create one yourself.
- 2019-04-18 17:19回答 2 已采纳 I have solved it by retrieving the WebSocket object from the global JavaScript object, which in my
- 2022-02-16 08:32三雷科技的博客 go语言有很多的库,在开发c语言的时候为了快速完成某些功能,可以直接通过go语言的库进行调用.那么我们将go语言开发的程序编译成so动态库文件就可以给c或者c++程序调用. 目录 go文件编写 so编译命令 C语言测试程序...
- 2019-09-10 00:27回答 1 已采纳 To call the method from the type, you must pass a reflect.Value instance that provides the Foo obj
- 2019-03-15 20:45回答 2 已采纳 In that blog post, Docker containers are used to simulate a remote machine. GoLand doesn't have a
- 2017-10-28 16:35回答 4 已采纳 Use https://golang.org/pkg/net/http/#ListenAndServeTLS http.HandleFunc("/", handler) log.Printf("
- 2021-02-26 00:021024-iot-SaltIce的博客 *Builder { return b.AddField(name, reflect.TypeOf(float64(1.2))) } // 实际生成的结构体，基类 // 结构体的类型 type Struct struct { typ reflect.Type // // 用于通过字段名称，从Builder的[]reflect....
- 2016-04-07 18:31回答 3 已采纳 This is your program from the edit with a interface type implementation: package main import (
- 2018-09-14 08:15回答 3 已采纳 So, i found the solution. Big thanks to this guy, his code fits perfectly for me, love the way it
- 2023-03-14 23:29回答 2 已采纳 不知道你这个问题是否已经解决, 如果还没有解决的话: 这有个类似的问题, 你可以参考下: https://ask.csdn.net/questions/7739247我还给你找了一篇非常好的博客，你可
- 2022-02-19 16:28驭鲸·环球的博客 在 windows 系统平台上，dll 动态库没有提供 .lib 文件，又不想动态获取函数地址怎么办？ 使用 lib.exe 工具可以根据 .def 定义文件生成 .lib 文件。 例如，我这里有一个 test.dll 动态库文件，我想要生成 lib 链接...
- 2018-04-05 10:20回答 2 已采纳 This code will works package main import ( "bytes" "encoding/json" "fmt" "log" "string
- 2023-12-15 07:00The-Venus的博客 希望本文能够帮助读者了解Go语言的优势，并在项目开发中做出明智的选择。如果大家对相关文章感兴趣，可以关注公众号"架构殿堂"，会持续更新AIGC，java基础面试题, netty, spring boot, spring cloud等系列文章，一...
- 2019-07-10 20:36Grayan的博客 开发过程中难免要用到UUID，Golang标准库好像没有提供生成UUID的方法,在Github上面发现了一个不错的库. satori/go.uuid提供了五种生成UUID的方式: Version 1,基于 timestamp 和 MAC address (RFC 4122) Version 2,...
- 没有解决我的问题, 去提问
悬赏问题
- ¥20 机器学习能否像多层线性模型一样处理嵌套数据
- ¥20 西门子S7-Graph,S7-300，梯形图
- ¥50 用易语言http 访问不了网页
- ¥50 safari浏览器fetch提交数据后数据丢失问题
- ¥15 matlab不知道怎么改，求解答！！
- ¥15 永磁直线电机的电流环pi调不出来
- ¥15 用stata实现聚类的代码
- ¥15 请问paddlehub能支持移动端开发吗？在Android studio上该如何部署？
- ¥20 docker里部署springboot项目，访问不到扬声器
- ¥15 netty整合springboot之后自动重连失效