Tom20081 2017-09-18 11:11 采纳率: 100%
浏览 1186
已采纳

采集某网站 JS生成的翻页地址信息

请问怎么采集
网页:http://top.aiweibang.com/article/LsO-OMOjw67Cug~~
的翻页地址信息。
该地址是js生成的静态网页里没有地址。
图片说明

  • 写回答

3条回答

  • dl0246 2017-09-18 13:50
    关注

    那个不是js生成的静态网页。你想做采集的话发这个请求
    http://top.aiweibang.com/article/getarticles 参数是{PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}这里的PageIndex:2中的2是第几页数据。
    截取回来的数据如下:
    POST http://top.aiweibang.com/article/getarticles
    Content-Type: application/json
    {PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}
    -- response --
    200 OK
    Cache-Control: private
    Content-Type: application/json; charset=utf-8
    Server: Microsoft-IIS/8.5
    X-AspNet-Version: 4.0.30319
    X-Powered-By: ASP.NET
    Date: Mon, 18 Sep 2017 13:48:36 GMT
    Content-Length: 4762

    {"data":{"index":2,"size":20,"total":515,"data":[{"Id":"LsO-MsOhw6nCtcOiwq3DtA~~","Title":"妖次新特停后怎么办(8月24日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-24 18:10:00","ReadNum":41545,"LikeNum":804,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO-MMOgw6zCscOlwqjDvA~~","Title":"次新出现特力A式分时(8月23日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-23 17:40:00","ReadNum":50124,"LikeNum":930,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO_NsOsw6rCscOlwqzDsA~~","Title":"我是涨停板复盘(8月22日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-22 17:39:00","ReadNum":40800,"LikeNum":925,"IsDeleted":false,"IsOriginal":true},{"Id":"LsO_NcOkw63CscOpwqrDsA~~","Title":"两个重要的事情(8月21日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-21 17:57:00","ReadNum":45648,"LikeNum":851,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2OcOhw63Cu8OmwqzDvA~~","Title":"周复盘:什么是分时相对高低点?","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-20 17:46:00","ReadNum":38278,"LikeNum":1401,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2M8Ojw6nCscOlwqDDsA~~","Title":"混改爆了7条线(8月18日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-18 17:34:00","ReadNum":46043,"LikeNum":673,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2MMOnw63CsMOgwq_DsA~~","Title":"讯飞这根长上影预示着什么?(8月17日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-17 17:57:00","ReadNum":51341,"LikeNum":870,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OcOiw6fCtcOnwqzDtw~~","Title":"这几条暗线值得重点留意(8月16日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-16 17:39:00","ReadNum":44938,"LikeNum":761,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OMOgw6_CusOkwq_DsQ~~","Title":"方大最终没能搅局成功(8月15日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-15 17:36:00","ReadNum":44592,"LikeNum":779,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Oiw6nCtMOmwq7DvQ~~","Title":"创业板放量长阳站上60日线(8月14日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-14 17:35:00","ReadNum":37283,"LikeNum":621,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Okw6vCtsOjwq_DsA~~","Title":"周复盘:风水轮流转 接下来会转到哪儿?","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-13 18:41:00","ReadNum":40190,"LikeNum":1344,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NcOtw6fCusOiwqHDsw~~","Title":"愿你被世界温柔以待(8月11日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-11 17:51:00","ReadNum":36832,"LikeNum":794,"IsDeleted":false,"IsOriginal":false},{"Id":"L8O3NcOhw63CtsOkwqvDvA~~","Title":"等待的过程是最煎熬的(8月10日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-10 18:01:00","ReadNum":39092,"LikeNum":699,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCtcOiwqvDtA~~","Title":"煤飞色再舞 钢铁卖力伴唱(8月9日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-09 18:00:00","ReadNum":33421,"LikeNum":633,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCusOkwq3Dtw~~","Title":"盘面3个现象不容忽视(8月8日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-08 17:50:00","ReadNum":45798,"LikeNum":736,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3M8Oiw6fCu8OjwqrDsg~~","Title":"资源股卷土重来(8月7日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-07 17:49:00","ReadNum":38264,"LikeNum":670,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOjw6vCtMOmwqrDtw~~","Title":"周复盘:周期股看回调支撑 创业板底部放量值得留意","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-06 14:01:00","ReadNum":38127,"LikeNum":1262,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOnw6fCusOhwqzDsg~~","Title":"史上最系统的交易干货教程分享","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-05 10:45:00","ReadNum":46490,"LikeNum":1657,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsQ~~","Title":"高位剧烈分歧(8月4日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-04 17:51:00","ReadNum":33571,"LikeNum":597,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsg~~","Title":"创业板蠢蠢欲动(8月3日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-03 17:45:00","ReadNum":38038,"LikeNum":694,"IsDeleted":false,"IsOriginal":true}]},"status":true,"code":200}

    
    
    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论
查看更多回答(2条)

报告相同问题?

悬赏问题

  • ¥15 想问一下stata17中这段代码哪里有问题呀
  • ¥15 flink cdc无法实时同步mysql数据
  • ¥100 有人会搭建GPT-J-6B框架吗?有偿
  • ¥15 求差集那个函数有问题,有无佬可以解决
  • ¥15 【提问】基于Invest的水源涵养
  • ¥20 微信网友居然可以通过vx号找到我绑的手机号
  • ¥15 寻一个支付宝扫码远程授权登录的软件助手app
  • ¥15 解riccati方程组
  • ¥15 使用rabbitMQ 消息队列作为url源进行多线程爬取时,总有几个url没有处理的问题。
  • ¥15 Ubuntu在安装序列比对软件STAR时出现报错如何解决