2 wuwei2 00 8 wuwei2_00_8 于 2017.09.18 19:11 提问

采集某网站 JS生成的翻页地址信息

请问怎么采集
网页:http://top.aiweibang.com/article/LsO-OMOjw67Cug~~
的翻页地址信息。
该地址是js生成的静态网页里没有地址。
图片说明

3个回答

dl0246
dl0246   2017.09.18 21:50
已采纳

那个不是js生成的静态网页。你想做采集的话发这个请求
http://top.aiweibang.com/article/getarticles 参数是{PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}这里的PageIndex:2中的2是第几页数据。
截取回来的数据如下:
POST http://top.aiweibang.com/article/getarticles
Content-Type: application/json
{PageIndex: 2, PageSize: 20, Type: 1, Wechat: "LsO-OMOjw67Cug~~"}
-- response --
200 OK
Cache-Control: private
Content-Type: application/json; charset=utf-8
Server: Microsoft-IIS/8.5
X-AspNet-Version: 4.0.30319
X-Powered-By: ASP.NET
Date: Mon, 18 Sep 2017 13:48:36 GMT
Content-Length: 4762

{"data":{"index":2,"size":20,"total":515,"data":[{"Id":"LsO-MsOhw6nCtcOiwq3DtA~~","Title":"妖次新特停后怎么办(8月24日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-24 18:10:00","ReadNum":41545,"LikeNum":804,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO-MMOgw6zCscOlwqjDvA~~","Title":"次新出现特力A式分时(8月23日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-23 17:40:00","ReadNum":50124,"LikeNum":930,"IsDeleted":false,"IsOriginal":false},{"Id":"LsO_NsOsw6rCscOlwqzDsA~~","Title":"我是涨停板复盘(8月22日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-22 17:39:00","ReadNum":40800,"LikeNum":925,"IsDeleted":false,"IsOriginal":true},{"Id":"LsO_NcOkw63CscOpwqrDsA~~","Title":"两个重要的事情(8月21日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-21 17:57:00","ReadNum":45648,"LikeNum":851,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2OcOhw63Cu8OmwqzDvA~~","Title":"周复盘:什么是分时相对高低点?","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-20 17:46:00","ReadNum":38278,"LikeNum":1401,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2M8Ojw6nCscOlwqDDsA~~","Title":"混改爆了7条线(8月18日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-18 17:34:00","ReadNum":46043,"LikeNum":673,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O2MMOnw63CsMOgwq_DsA~~","Title":"讯飞这根长上影预示着什么?(8月17日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-17 17:57:00","ReadNum":51341,"LikeNum":870,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OcOiw6fCtcOnwqzDtw~~","Title":"这几条暗线值得重点留意(8月16日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-16 17:39:00","ReadNum":44938,"LikeNum":761,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3OMOgw6_CusOkwq_DsQ~~","Title":"方大最终没能搅局成功(8月15日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-15 17:36:00","ReadNum":44592,"LikeNum":779,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Oiw6nCtMOmwq7DvQ~~","Title":"创业板放量长阳站上60日线(8月14日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-14 17:35:00","ReadNum":37283,"LikeNum":621,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3N8Okw6vCtsOjwq_DsA~~","Title":"周复盘:风水轮流转 接下来会转到哪儿?","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-13 18:41:00","ReadNum":40190,"LikeNum":1344,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NcOtw6fCusOiwqHDsw~~","Title":"愿你被世界温柔以待(8月11日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-11 17:51:00","ReadNum":36832,"LikeNum":794,"IsDeleted":false,"IsOriginal":false},{"Id":"L8O3NcOhw63CtsOkwqvDvA~~","Title":"等待的过程是最煎熬的(8月10日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-10 18:01:00","ReadNum":39092,"LikeNum":699,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCtcOiwqvDtA~~","Title":"煤飞色再舞 钢铁卖力伴唱(8月9日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-09 18:00:00","ReadNum":33421,"LikeNum":633,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3NMOjw6zCusOkwq3Dtw~~","Title":"盘面3个现象不容忽视(8月8日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-08 17:50:00","ReadNum":45798,"LikeNum":736,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3M8Oiw6fCu8OjwqrDsg~~","Title":"资源股卷土重来(8月7日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-07 17:49:00","ReadNum":38264,"LikeNum":670,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOjw6vCtMOmwqrDtw~~","Title":"周复盘:周期股看回调支撑 创业板底部放量值得留意","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-06 14:01:00","ReadNum":38127,"LikeNum":1262,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3MsOnw6fCusOhwqzDsg~~","Title":"史上最系统的交易干货教程分享","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-05 10:45:00","ReadNum":46490,"LikeNum":1657,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsQ~~","Title":"高位剧烈分歧(8月4日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-04 17:51:00","ReadNum":33571,"LikeNum":597,"IsDeleted":false,"IsOriginal":true},{"Id":"L8O3McOjw63CscOnwqzDsg~~","Title":"创业板蠢蠢欲动(8月3日涨停板复盘)","SourceUrl":null,"ArticleIndex":1,"PostTime":"2017-08-03 17:45:00","ReadNum":38038,"LikeNum":694,"IsDeleted":false,"IsOriginal":true}]},"status":true,"code":200}


dl0246
dl0246 回复差不多先生_it: 我转行了。。it干不动了
2 个月之前 回复
insistlzh
insistlzh 哎哟,大牛你是有雨衣还是农民工
2 个月之前 回复
dl0246
dl0246   2017.09.18 21:51

补充一下要求post发送才行。别忘了给分。最近为了转分才来csdn的。哎我的时间啊。让一只大牛为了赚分来这里好无奈

wuwei2_00_8
wuwei2_00_8 测试好了就采纳你
2 个月之前 回复
insistlzh
insistlzh   2017.09.19 09:30

翻页是在后台重新请求的数据,地址和当前都是一致的,就是其中【当前页面】这一个参数不同。拿着接口去修改这个参数就能得到返回的数据

Csdn user default icon
上传中...
上传图片
插入图片