有哪位大佬指点下怎么爬这种网页的数据

Question

http://fish.haidiao.com
求大佬指点啊，眼睛都熬红了

Answer 1

用fiddler抓包看了下很简单

首先获取的html里面有

var subval2 = new Array();  //这里定义一个数组


       subval2[0] = new Array('盲鳗科','蒲氏粘盲鳗');

       subval2[1] = new Array('盲鳗科','紫粘盲鳗');

       subval2[2] = new Array('盲鳗科','福尔摩沙盲鳗');

       subval2[3] = new Array('盲鳗科','郭氏盲鳗');

       subval2[4] = new Array('盲鳗科','陈氏副盲鳗');

       subval2[5] = new Array('盲鳗科','费氏副盲鳗');

       subval2[6] = new Array('盲鳗科','纽氏副盲鳗');

       subval2[7] = new Array('盲鳗科','沈氏副盲鳗');

       subval2[8] = new Array('盲鳗科','台湾副盲鳗');

       subval2[9] = new Array('盲鳗科','怀氏副盲鳗');

       subval2[10] = new Array('盲鳗科','杨氏副盲鳗');
...

遍历这个，然后依次post发包

POST http://fish.haidiao.com/indexlist.asp HTTP/1.1
Host: fish.haidiao.com
Connection: keep-alive
Content-Length: 60
Cache-Control: max-age=0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Origin: http://fish.haidiao.com
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36
Content-Type: application/x-www-form-urlencoded
Referer: http://fish.haidiao.com/
Accept-Encoding: gzip, deflate
Accept-Language: en-US,en;q=0.8
Cookie: yunsuo_session_verify=ad5bf876c9d468da81f5f25f62c9f96d; ASPSESSIONIDCQSQQTRA=IAOPKAODOODIOCJKAPHNPACE; UM_distinctid=16991ea57ddb5-0cf04ace8af874-39475561-1aeaa0-16991ea57df4ac; CNZZDATA577583=cnzz_eid%3D771781776-1552931247-null%26ntime%3D1552931247

SelectItem=%B2%E6%B3%DD%F7%5E%BF%C6&submit.x=101&submit.y=11

SelectItem=你的这些条目中的每一个