采集某网站 JS生成的翻页地址信息

Question

请问怎么采集
网页：http://top.aiweibang.com/article/LsO-OMOjw67Cug~~
的翻页地址信息。
该地址是js生成的静态网页里没有地址。

Answer 1

那个不是js生成的静态网页。你想做采集的话发这个请求
http://top.aiweibang.com/article/getarticles 参数是{PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}这里的PageIndex:2中的2是第几页数据。
截取回来的数据如下：
POST http://top.aiweibang.com/article/getarticles
Content-Type: application/json
{PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}
-- response --
200 OK
Cache-Control: private
Content-Type: application/json; charset=utf-8
Server: Microsoft-IIS/8.5
X-AspNet-Version: 4.0.30319
X-Powered-By: ASP.NET
Date: Mon, 18 Sep 2017 13:48:36 GMT
Content-Length: 4762

{"data":{"index":2,"size":20,"total":515,"data":[{"Id":"LsO-MsOhw6nCtcOiwq3DtA~~","Title":"妖次新特停后怎么办（8月24日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-24 18:10:00","ReadNum":41545,"LikeNum":804,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO-MMOgw6zCscOlwqjDvA~~","Title":"次新出现特力A式分时（8月23日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-23 17:40:00","ReadNum":50124,"LikeNum":930,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO_NsOsw6rCscOlwqzDsA~~","Title":"我是涨停板复盘（8月22日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-22 17:39:00","ReadNum":40800,"LikeNum":925,"IsDeleted":false,"IsOriginal":true},{"Id":"LsO_NcOkw63CscOpwqrDsA~~","Title":"两个重要的事情（8月21日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-21 17:57:00","ReadNum":45648,"LikeNum":851,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2OcOhw63Cu8OmwqzDvA~~","Title":"周复盘：什么是分时相对高低点？","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-20 17:46:00","ReadNum":38278,"LikeNum":1401,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2M8Ojw6nCscOlwqDDsA~~","Title":"混改爆了7条线（8月18日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-18 17:34:00","ReadNum":46043,"LikeNum":673,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2MMOnw63CsMOgwq_DsA~~","Title":"讯飞这根长上影预示着什么？（8月17日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-17 17:57:00","ReadNum":51341,"LikeNum":870,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OcOiw6fCtcOnwqzDtw~~","Title":"这几条暗线值得重点留意（8月16日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-16 17:39:00","ReadNum":44938,"LikeNum":761,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OMOgw6_CusOkwq_DsQ~~","Title":"方大最终没能搅局成功（8月15日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-15 17:36:00","ReadNum":44592,"LikeNum":779,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Oiw6nCtMOmwq7DvQ~~","Title":"创业板放量长阳站上60日线（8月14日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-14 17:35:00","ReadNum":37283,"LikeNum":621,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Okw6vCtsOjwq_DsA~~","Title":"周复盘：风水轮流转 接下来会转到哪儿？","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-13 18:41:00","ReadNum":40190,"LikeNum":1344,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NcOtw6fCusOiwqHDsw~~","Title":"愿你被世界温柔以待（8月11日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-11 17:51:00","ReadNum":36832,"LikeNum":794,"IsDeleted":false,"IsOriginal":false},{"Id":"L8O3NcOhw63CtsOkwqvDvA~~","Title":"等待的过程是最煎熬的（8月10日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-10 18:01:00","ReadNum":39092,"LikeNum":699,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCtcOiwqvDtA~~","Title":"煤飞色再舞 钢铁卖力伴唱（8月9日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-09 18:00:00","ReadNum":33421,"LikeNum":633,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCusOkwq3Dtw~~","Title":"盘面3个现象不容忽视（8月8日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-08 17:50:00","ReadNum":45798,"LikeNum":736,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3M8Oiw6fCu8OjwqrDsg~~","Title":"资源股卷土重来（8月7日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-07 17:49:00","ReadNum":38264,"LikeNum":670,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOjw6vCtMOmwqrDtw~~","Title":"周复盘：周期股看回调支撑 创业板底部放量值得留意","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-06 14:01:00","ReadNum":38127,"LikeNum":1262,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOnw6fCusOhwqzDsg~~","Title":"史上最系统的交易干货教程分享","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-05 10:45:00","ReadNum":46490,"LikeNum":1657,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsQ~~","Title":"高位剧烈分歧（8月4日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-04 17:51:00","ReadNum":33571,"LikeNum":597,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsg~~","Title":"创业板蠢蠢欲动（8月3日涨停板复盘）","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-03 17:45:00","ReadNum":38038,"LikeNum":694,"IsDeleted":false,"IsOriginal":true}]},"status":true,"code":200}