2 wisteriapcp Wisteriapcp 于 2016.03.23 20:59 提问

如何解决爬虫网页异步

就是爬取js请求嵌入的内容,各位大神能否提供点思路
网址:http://www.tvmao.com/program/CCTV-CCTV6-w3.html
其实本意是爬取里边的时间,标题等节目信息

5个回答

qq_25970551
qq_25970551   2016.05.20 17:37
已采纳

给你推荐一个大牛的解决办法:http://blog.csdn.net/youmumzcs/article/details/51384741

caozhy
caozhy   Ds   Rxr 2016.03.23 23:24

用fiddler看下,不过我帮你看了,电视节目不是ajax异步加载的,而是首次请求这个地址就有的








<!doctype html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>
<title>中央电视台电影频道节目预告_电视猫</title>
<meta name="keywords" content="中央电视台电影频道节目预告,CCTV6节目预告">
<meta name="description" content="中央电视台电影频道最新一周节目时间表。中央电视台电影频道又名:CCTV-6电影,CCTV-6,CCTV6,央视电影,央视6套,中央6套,中央六套,央视六套,中央六台,中央6台,电影频道,CCTV电影频道,cctv6本周,cctv6电视剧,cctv6电影,cctv6频道,cctv6直播,cctv影视,央视6频道,央视6台,中央电影频道,央视电影频道,央视六台,中央6频道,中央电视台6,中央电视台6频道,中央电视台6套,中央台电影频道,中央-6,CCTV-6电影,中央电视台-6,CCTV6-电影,中央电视台-6电影,CCTV -6电影,">
<link href="http://static.tvmao.com/css/common/common_20160302.css" rel="stylesheet" type="text/css" />
<link href="http://static.tvmao.com/css/tvmao/tvmao.css" rel="stylesheet" type="text/css" />
<meta id="umeta" uid="0" sns="" r="0" status=""  />
<meta id="ometa" name="259" content="NFch" /> <link href="http://static.tvmao.com/css/tvmao/pg.css" rel="stylesheet" type="text/css"/>
<!--[if lte IE 8]>
<script src="http://static.tvmao.com/js/common/html5.js"></script>
<![endif]-->
<link rel="shortcut icon" href="http://static.tvmao.com/favicon.ico" type="image/x-icon" />
<script type="text/javascript">
var _czc = _czc || [];
_czc.push(["_setAccount", "1255238971"]);
function pushTJ(cate,action,label,val,nid){
_czc.push(['_trackEvent', cate, action, label, val, nid]);
}
</script>

<script>
var _hmt = _hmt || [];
(function() {
  var hm = document.createElement("script");
  hm.src = "//hm.baidu.com/hm.js?a27d3c53126c59f93b8f63a30262cb5e";
  var s = document.getElementsByTagName("script")[0]; 
  s.parentNode.insertBefore(hm, s);
})();
</script>

</head>
<body>
<header class="page-content header clear" style="height:70px;vertical-align: middle;">
  <div class="lt mr20  clear" style="height:70px">
    <a href="/" target="_self">
      <img src="http://static.tvmao.com/images/logo/tvmao_logo.png" width="110px" style="vertical-align: middle;margin:17px 0">
    </a>
  </div>
<div class="lt topic_menu lh70"><a href="/">首页</a><a href="/tvshow">综艺</a><a href="/drama">电视剧</a><a href="/program">节目单</a><a href="/news">星闻</a></div>
<div class="lt" style="margin:20px 20px">
  <form method="get" action="/query.jsp" name="QF" id="searchform" q="B3132702BA15FF253C1B1718769DB986F87A92F14C04F5F512CBCD771C" a="4A04455F707394441D5FC4C220CFF8497F">
    <input style= "vertical-align: middle;" type="text" id="key" name="keys" class="topic_search_input ed ui-autocomplete-input pl5" title="节目、电视剧、电影、明星一起搜!" autocomplete="off" maxlength="40" size="30" role="textbox" aria-autocomplete="list" aria-haspopup="true" >
    <input type="hidden" name="ed"/>
    <button type="submit" class="topic_button_blue" style="vertical-align: middle;" value="猫一把" id="762CB32A33CBE386A38DA6ABD8E2C3F70F4FFEC545">猫一下</button>
  </form>
</div>
<div class="rt lh70"><a href="javascript:openLogin(RW);" class="mr10">登录</a><a href="javascript:openLogin(null,'链接',true);">注册</a></div>
</header>
<div class="pgnav_wrap">
<div class="clear"><div class="epghdl lt" style="width:220px"><dl class="commtab clear"><dd class="levle1cur"><a href="/program/channels" title="查看所有频道的节目表">全部节目表</a></dd><dd><a href="/program_favorite/channels" title="查看我收藏的频道的节目表,支持自定义频道顺序">我的节目表</a></dd></dl></div><div class="epghdc lt" style="width:590px"><dl class="commtab clear"><dd class="green"><a href="/program/CCTV-CCTV6-20160316.html">上周</a></dd><dd><a href="/program/CCTV-CCTV6-w1.html">一(03-21)</a></dd><dd><a href="/program/CCTV-CCTV6-w2.html">二(03-22)</a></dd><dd class="levle1cur"><a>三(03-23)</a></dd><dd><a href="/program/CCTV-CCTV6-w4.html">四(03-24)</a></dd><dd><a href="/program/CCTV-CCTV6-w5.html">五(03-25)</a></dd><dd><a href="/program/CCTV-CCTV6-w6.html">六(03-26)</a></dd><dd><a href="/program/CCTV-CCTV6-w7.html">日(03-27)</a></dd><dd class="green"><a href="/program/CCTV-CCTV6-w8.html">下周</a></dd></dl></div><div class="epghdr lt" style="width:190px"><dl class="commtab clear"><dd><a href="/program/duration/">按时段</a></dd><dd class="levle1cur"><a href="/program/channels/">按频道</a></dd><dd><a href="/program/playing/">正在播放</a></dd></dl></div></div>
<table width="100%"  border="0" cellpadding="1" cellspacing="0" class="pgnav"><tr><td width="44" align="center">直辖市</td><td bgcolor="#EFF5FE" width="125"><a title="北京电视台" href="/program/BTV-BTV1-w3.html">北京</a><a class="ml3" title="上海电视台" href="/program/SHHAI-DONGFANG1-w3.html">上海</a><a class="ml3" title="天津电视台" href="/program/TJTV-TJTV1-w3.html">天津</a><a class="ml3" title="重庆电视台" href="/program/CCQTV-CCQTV1-w3.html">重庆</a></td><td width="44" rowspan="2" align="center">中央台</td><td width="45" align="center" rowspan="2" bgcolor="#EFF5FE"><a title="CCTV电视台" href="/program/CCTV-CCTV1-w3.html">CCTV</a></td><td rowspan="2" width="38" align="center">各省</td><td rowspan="2" width="240" bgcolor="#EFF5FE"><a title="广东电视台" href="/program/GDTV-GDTV1-w3.html">广东</a><a class="ml3" title="广西电视台" href="/program/GUANXI-GUANXI1-w3.html">广西</a><a class="ml3" title="福建电视台" href="/program/FJTV-FJTV2-w3.html">福建</a><a class="ml3" title="海南电视台" href="/program/TCTC-TCTC1-w3.html">海南</a><a class="ml3" title="浙江电视台" href="/program/ZJTV-ZJTV1-w3.html">浙江</a><a class="ml3" title="江苏电视台" href="/program/JSTV-JSTV1-w3.html">江苏</a><a class="ml3" title="江西电视台" href="/program/JXTV-JXTV1-w3.html">江西</a><a class="ml3" title="安徽电视台" href="/program/AHTV-AHTV1-w3.html">安徽</a><br/><a title="湖南电视台" href="/program/HUNANTV-HUNANTV1-w3.html">湖南</a><a class="ml3" title="湖北电视台" href="/program/HUBEI-HUBEI1-w3.html">湖北</a><a class="ml3" title="河南电视台" href="/program/HNTV-HNTV1-w3.html">河南</a><a class="ml3" title="河北电视台" href="/program/HEBEI-HEBEI1-w3.html">河北</a><a class="ml3" title="四川电视台" href="/program/SCTV-SCTV1-w3.html">四川</a><a class="ml3" title="云南电视台" href="/program/YNTV-YNTV1-w3.html">云南</a><a class="ml3" title="贵州电视台" href="/program/GUIZOUTV-GUIZOUTV1-w3.html">贵州</a></td><td rowspan="2" width="2" align="center"></td><td rowspan="2" bgcolor="#EFF5FE"><a title="山东电视台" href="/program/SDTV-SDTV1-w3.html">山东</a><a class="ml3" title="山西电视台" href="/program/SXTV-SXTV1-w3.html">山西</a><a class="ml3" title="陕西电视台" href="/program/SHXITV-SHXITV1-w3.html">陕西</a><a class="ml3" title="辽宁电视台" href="/program/LNTV-LNTV1-w3.html">辽宁</a><a class="ml3" title="吉林电视台" href="/program/JILIN-JILIN1-w3.html">吉林</a><a class="ml3" title="黑龙江电视台" href="/program/HLJTV-HLJTV1-w3.html">黑龙江</a><br/><a title="新疆电视台" href="/program/XJTV-XJTV1-w3.html">新疆</a><a class="ml3" title="西藏电视台" href="/program/XIZANGTV-XIZANGTV1-w3.html">西藏</a><a class="ml3" title="青海电视台" href="/program/QHTV-QHTV1-w3.html">青海</a><a class="ml3" title="甘肃电视台" href="/program/GSTV-GSTV1-w3.html">甘肃</a><a class="ml3" title="宁夏电视台" href="/program/NXTV-NXTV2-w3.html">宁夏</a><a class="ml3" title="内蒙古电视台" href="/program/NMGTV-NMGTV1-w3.html">内蒙古</a></td><td rowspan="2" width="38" align="center">全国<br>卫视</td><td rowspan="2" width="170" bgcolor="#EFF5FE"><a title="湖南卫视电视台" href="/program_satellite/HUNANTV1-w3.html">湖南卫视</a> <a title="江苏卫视电视台" href="/program_satellite/JSTV1-w3.html">江苏卫视</a> <a title="东方卫视电视台" href="/program_satellite/DONGFANG1-w3.html">东方卫视</a> <a title="浙江卫视电视台" href="/program_satellite/ZJTV1-w3.html">浙江卫视</a> <a title="北京卫视电视台" href="/program_satellite/BTV1-w3.html">北京卫视</a> <a title="安徽卫视电视台" href="/program_satellite/AHTV1-w3.html">安徽卫视</a> </td></tr><tr><td align="center">港澳台</td><td bgcolor="#EFF5FE"><a title="香港电视台" href="/program/TVB-TVB1-w3.html">香港</a><a class="ml3" title="澳门电视台" href="/program/AUMEN-AUMEN1-w3.html">澳门</a><a class="ml3" title="台湾电视台" href="/program/STARTV-XINGKONG1-w3.html">台湾</a><a class="ml3" title="海外电视台" href="/program/AUSTRALIANETWORK-AUSTRALIANETWORK-w3.html">海外</a></td></tr></table>
</div>
<div class="page-content clear" style="margin-top:5px">
<style>
  .live{
    background-image: url(http://static.tvmao.com/images/live/skin/play_red.png);
    background-repeat: no-repeat;
    text-indent: 25px;
    display:block
  }
</style>
<div class="chlsnav">
  <div class="btt">中央电视台频道列表</div>
  <div class="pbar"><b>中央电视台</b></div><ul class="r" ><li><a href="/program/CCTV-CCTV1-w3.html">CCTV-1综合</a><span></span></li><li><a href="/program/CCTV-CCTV2-w3.html">CCTV-2财经</a><span></span></li><li><a href="/program/CCTV-CCTV3-w3.html">CCTV-3综艺</a><span></span></li><li><a href="/program/CCTV-CCTV4-w3.html">CCTV-4国际</a><span></span></li><li><a href="/program/CCTV-CCTV5-w3.html">CCTV-5体育</a><span></span></li><li><b>CCTV-6电影</b><span></span></li><li><a href="/program/CCTV-CCTV7-w3.html">CCTV-7军事</a><span></span></li><li><a href="/program/CCTV-CCTV8-w3.html">CCTV-8电视剧</a><span></span></li><li><a href="/program/CCTV-CCTV9-w3.html">CCTV-9纪录</a><span></span></li><li><a href="/program/CCTV-CCTV10-w3.html">CCTV-10科教</a><span></span></li><li><a href="/program/CCTV-CCTV11-w3.html">CCTV-11戏曲</a><span></span></li><li><a href="/program/CCTV-CCTV12-w3.html">CCTV-12法制</a><span></span></li><li><a href="/program/CCTV-CCTV13-w3.html">CCTV-13新闻</a><span></span></li><li><a href="/program/CCTV-CCTV15-w3.html">CCTV-14少儿</a><span></span></li><li><a href="/program/CCTV-CCTV16-w3.html">CCTV-15音乐</a><span></span></li><li><a href="/program/CCTV-CCTV5-PLUS-w3.html">CCTV5加</a><span></span></li><li><a href="/program/CCTV-CCTV17-w3.html">CCTV-E西语</a><span></span></li><li><a href="/program/CCTV-CCTV18-w3.html">CCTV-纪录(英)</a><span></span></li><li><a href="/program/CCTV-CCTV18-SG-w3.html">CCTV-纪录(英)</a><span class=gray>(新加坡)</span><span></span></li><li><a href="/program/CCTV-CCTV19-w3.html">CCTV NEWS</a><span></span></li><li><a href="/program/CCTV-CCTV19-HK-w3.html">CCTV NEWS</a><span class=gray>(香港)</span><span></span></li><li><a href="/program/CCTV-CCTVEUROPE-w3.html">CCTV-4欧洲</a><span></span></li><li><a href="/program/CCTV-CCTVAMERICAS-w3.html">CCTV-4美洲</a><span></span></li><li><a href="/program/CCTV-CCTVF-w3.html">CCTV-F法语</a><span></span></li><li><a href="/program/CCTV-CCTVA-w3.html">CCTV-A阿语</a><span></span></li><li><a href="/program/CCTV-CCTVR-w3.html">CCTV-R俄语</a><span></span></li><li><a href="/program/CCTV-CHINA-MOVIE-CHANNEL-NA-w3.html">中国电影频道北美版</a><span></span></li></ul><a href="/program/CCTVPAYFEE"><div class="plst"><b>中数传媒</b></div></a><a href="/program/CETV"><div class="plst"><b>中国教育电视台</b></div></a><a href="/program/CHC"><div class="plst"><b>CHC华诚付费</b></div></a><a href="/program/BAMC"><div class="plst"><b>北广传媒集团</b></div></a><a href="/program/XHSTV"><div class="plst"><b>新华社电视台</b></div></a><a href="/program/NNMCHINA"><div class="plst"><b>北方新媒体</b></div></a><a href="/program/SZTHM"><div class="plst"><b>天华传媒</b></div></a><a href="/program/HSCM"><div class="plst"><b>华数传媒</b></div></a><a href="/program/LONGJIANG"><div class="plst"><b>黑龙江广播电视网络</b></div></a><a href="/program/XYCM"><div class="plst"><b>星元传媒</b></div></a><a href="/program/JSCM"><div class="plst"><b>吉视传媒</b></div></a><a href="/program/BESTV"><div class="plst"><b>百视通</b></div></a><a href="/program/NFCM"><div class="plst"><b>南方传媒</b></div></a><a href="/program/NOVELTV"><div class="plst"><b>永新视博</b></div></a>
  <div class="ad mt5" style="text-align:center"><!-- PG_L,BD_180*500 -->
<script type="text/javascript">
var cpro_id="u1990264";
(window["cproStyleApi"] = window["cproStyleApi"] || {})[cpro_id]={at:"3",rsi0:"180",rsi1:"600",pat:"6",tn:"baiduCustNativeAD",rss1:"#FFFFFF",conBW:"1",adp:"1",ptt:"0",titFF:"%E5%BE%AE%E8%BD%AF%E9%9B%85%E9%BB%91",titFS:"14",rss2:"#000000",titSU:"0",ptbg:"90",piw:"0",pih:"0",ptp:"0"}
</script>
<script src="http://cpro.baidustatic.com/cpro/ui/c.js" type="text/javascript"></script></div>
</div>
<div class="pgmain" id="c32">
  <h1 style="float:left"><img src="http://static.tvmao.com/channel/logo/CCTV6.jpg" alt="中央电视台电影频道" class="chnlogo"/> 中央电视台电影频道节目预告</h1>


  <div class="mt10 clear"><b>03-23 星期三 <a href="#noon" title="中午播出节目">中午</a> <a href="#night" title="晚间播出节目">晚间</a></b>
  </div>
  <div class="epg mt10 mb10">
    <ul  id="pgrow"><li><span class="am">00:33</span> <a href="/tvcolumn/LCIxZyg=" tp="12" res="2016-03-23 00:33_LCIxZyg=" >音乐电影欣赏</a>18    </li>
<li><span class="am">00:38</span> <a href="/tvcolumn/NVcg" tp="12" res="2016-03-23 00:38_NVcg" >光影星播客</a>    </li>
<li><span class="am">00:46</span> 2016-03-22<a href="/tvcolumn/aC8uIDE=" tp="12" res="2016-03-23 00:46_aC8uIDE=" >电影快讯</a>晚间    </li>
<li><span class="am">00:49</span> 电影 <a href="/movie/YmJeYXMp">万箭穿心</a> 中国  <a title=万箭穿心剧照 class="green_line" href="/movie/YmJeYXMp/pictures">剧照</a> <a title=万箭穿心演员表 class="green_line" href="/movie/YmJeYXMp/actors">演员表</a> </li>
<li><span class="am">02:37</span> 电影 <a href="/movie/Z2FqIV5q">借你俩胆</a> 中国  <a title=借你俩胆剧照 class="green_line" href="/movie/Z2FqIV5q/pictures">剧照</a> <a title=借你俩胆演员表 class="green_line" href="/movie/Z2FqIV5q/actors">演员表</a> </li>
<li><span class="am">04:03</span> 译制片 <a href="/movie/MSAtZy4=">黑金</a>(法国) 法国  <a title=黑金剧照 class="green_line" href="/movie/MSAtZy4=/pictures">剧照</a> <a title=黑金演员表 class="green_line" href="/movie/MSAtZy4=/actors">演员表</a> </li>
<li><span class="am">06:14</span> 电影 <a href="/movie/KTIfM2o=">白云山传奇</a> 中国  <a title=白云山传奇剧照 class="green_line" href="/movie/KTIfM2o=/pictures">剧照</a> <a title=白云山传奇演员表 class="green_line" href="/movie/KTIfM2o=/actors">演员表</a> </li>
<li><span class="am">07:53</span> <a href="/tvcolumn/NVcg" tp="12" res="2016-03-23 07:53_NVcg" >光影星播客</a>    </li>
<li><span class="am">08:02</span> 电影 <a href="/movie/HjBoJy0=">庐山恋</a> 中国  <a title=庐山恋剧照 class="green_line" href="/movie/HjBoJy0=/pictures">剧照</a> <a title=庐山恋演员表 class="green_line" href="/movie/HjBoJy0=/actors">演员表</a> </li>
<li><span class="am">09:31</span> <a href="/tvcolumn/NVcg" tp="12" res="2016-03-23 09:31_NVcg" >光影星播客</a>    </li>
<li><span class="am">09:43</span> 2016-03-23<a href="/tvcolumn/aC8uIDE=" tp="12" res="2016-03-23 09:43_aC8uIDE=" >电影快讯</a>白天    </li>
<li><span class="am">09:46</span> 电影 <a href="/movie/ZSgxJC8=">隔山有眼</a> 中国  <a title=隔山有眼剧照 class="green_line" href="/movie/ZSgxJC8=/pictures">剧照</a> <a title=隔山有眼演员表 class="green_line" href="/movie/ZSgxJC8=/actors">演员表</a> </li>
<li><span class="am">11:26</span> <a href="/tvcolumn/NVcg" tp="12" res="2016-03-23 11:26_NVcg" >光影星播客</a>    </li>
<li><span class="am">11:33</span> <a href="/tvcolumn/LCIxZyg=" tp="12" res="2016-03-23 11:33_LCIxZyg=" >音乐电影欣赏</a>18    </li>
<li><span class="am">11:39</span> 电影 <a href="/movie/bCFhZWFj">保持清醒</a> 中国  <a title=保持清醒剧照 class="green_line" href="/movie/bCFhZWFj/pictures">剧照</a> <a title=保持清醒演员表 class="green_line" href="/movie/bCFhZWFj/actors">演员表</a> </li>
<li id="noon">午间节目</li></ul>
  </div>
  <nav class="theweek corner green_tab clear"><span>本周:</span><a href="/program/CCTV-CCTV6-w1.html" title="中央电视台电影频道节目表"><span>一(03-21)</span></a><a href="/program/CCTV-CCTV6-w2.html" title="中央电视台电影频道节目表"><span>二(03-22)</span></a><a class="green_bg_12" title="中央电视台电影频道节目预告"><span>三(03-23)</span></a><a href="/program/CCTV-CCTV6-w4.html" title="中央电视台电影频道节目预告"><span>四(03-24)</span></a><a href="/program/CCTV-CCTV6-w5.html" title="中央电视台电影频道节目单"><span>五(03-25)</span></a><a href="/program/CCTV-CCTV6-w6.html" title="中央电视台电影频道节目单"><span>六(03-26)</span></a><a href="/program/CCTV-CCTV6-w7.html" title="中央电视台电影频道时间表"><span>日(03-27)</span></a><a href="/program/CCTV-CCTV6-20160316.html">上周节目表</a></nav><nav class="nextweek corner green_tab clear"><span>下周:</span><a href="/program/CCTV-CCTV6-w8.html" title="中央电视台电影频道节目表"><span>一(03-28)</span></a><a href="/program/CCTV-CCTV6-w9.html" title="中央电视台电影频道节目表"><span>二(03-29)</span></a><a href="/program/CCTV-CCTV6-w10.html" title="中央电视台电影频道节目表"><span>三(03-30)</span></a><a href="/program/CCTV-CCTV6-w11.html" title="中央电视台电影频道节目表"><span>四(03-31)</span></a><a href="/program/CCTV-CCTV6-w12.html" title="中央电视台电影频道节目表"><span>五(04-01)</span></a><a href="/program/CCTV-CCTV6-w13.html" title="中央电视台电影频道节目表"><span>六(04-02)</span></a><a href="/program/CCTV-CCTV6-w14.html" title="中央电视台电影频道节目表"><span>日(04-03)</span></a></nav>
  <div class="oper-link rt" style="width:200px;">
    <a href="javascript:o_bookmark(32,32);" rw="1" op="1" id="favo32" class="fav button white_btn login" rel="nofollow" title="收藏该频道后,可以直接在收藏频道列表间切换,浏览节目表更方便"><span style="padding:0 10px">收藏</span></a>
  </div>
  <p class="clear mt10"><font color="#404040">中央电视台电影频道电视节目预告数据可能在发布后有更新导致,请登录中央电视台电影频道官方网站,最终播放节目时间表以中央电视台电影频道节目预告为准。</font></p>
  <p>希望把中央电视台电影频道节目预告/节目表显示到博客(Blog)、论坛或个人网站吗?点此<a href="http://tvmao.com/help/h_tv_radio.jsp">查看使用方法</a>。</p>
</div>
<aside class="related-aside rt">

  <div class="mt10 mb10">
    <script src="http://dup.baidustatic.com/js/ds.js"></script>
    <script>
    (function() {
        var s = "_" + Math.random().toString(36).slice(2);
        document.write('<div id="' + s + '"></div>');
        (window.slotbydup=window.slotbydup || []).push({
            id: '2070452',
            container: s,
            size: '285,54',
            display: 'inlay-fix'
        });
    })();
    </script>
  </div>

  <div class="mt10 mb10"><!-- PG_R1,BD_PG_300*250 -->
<script type="text/javascript"> /*300*250_PG*/ var cpro_id = 'u260378';</script>
<script type="text/javascript" src="http://cpro.baidu.com/cpro/ui/c.js"></script></div>
  <section class="aside-section clear">
    <div class="bar">CCTV-6电影</div>
    <div class="pd10 rating2-wrap" style="width:100%">
    <div class="clear"><div class="mstar_score"><div class='star' style='width:76.60977px'></div></div>
    <span class="score"><span class="unit">8</span><span class="decimal">.5</span></span></div>
    <div class="mt10"><a href="/program/CCTV6/rateusers" itemprop="ratingCount" style="width:50%"><span itemprop="ratingCount">82</span>人评分</a> <a href="/program/CCTV6/favusers" itemprop="interactionCount" style="float:left;width:50%">16387人关注</a></div>
    <div class="myscore clear">
      <div class="lt" style="padding-top:2px">我的评价:</div><ul id="objRating" class='star-rating'><li><a href='javascript:;' title='很差' class='stars-1'>1</a></li><li><a href='javascript:;' title='差' class='stars-2'>2</a></li><li><a href='javascript:;' title='一般' class='stars-3'>3</a></li><li><a href='javascript:;' title='好' class='stars-4'>4</a></li><li><a href='javascript:;' title='非常好' class='stars-5'>5</a></li></ul>
    </div></div>
  </section>



  <section class="aside-section clear"><h2>热门频道。。<a href="/hot/channel" class="ml20">更多</a></h2><dl id="t_hot_d" class="homehot hotchns wd116 clear"><dt>央视频道<dd><a href="/program/CCTV/CCTV1">CCTV-1综合</a> <span class="font10 gray">8.2分/15719粉</span></dd><dd><a href="/program/CCTV/CCTV2">CCTV-2财经</a> <span class="font10 gray">7.8分/14077粉</span></dd><dd><a href="/program/CCTV/CCTV3">CCTV-3综艺</a> <span class="font10 gray">7.9分/13988粉</span></dd><dd><a href="/program/CCTV/CCTV5">CCTV-5体育</a> <span class="font10 gray">8.8分/17038粉</span></dd><dd><a href="/program/CCTV/CCTV6">CCTV-6电影</a> <span class="font10 gray">8.5分/16387粉</span></dd><dd><a href="/program/CCTV/CCTV8">CCTV-8电视剧</a> <span class="font10 gray">8.3分/13486粉</span></dd><dd><a href="/program/CCTV/CCTV10">CCTV-10科教</a> <span class="font10 gray">9.1分/14318粉</span></dd></dt><dt>卫视频道<dd><a href="/program/HUNANTV/HUNANTV1">湖南卫视</a> <span class="font10 gray">9.2分/17856粉</span></dd><dd><a href="/program/AHTV/AHTV1">安徽卫视</a> <span class="font10 gray">8.4分/14343粉</span></dd><dd><a href="/program/SZTV/SZTV1">深圳卫视</a> <span class="font10 gray">7.0分/13899粉</span></dd><dd><a href="/program/SHHAI/DONGFANG1">东方卫视</a> <span class="font10 gray">7.8分/15444粉</span></dd><dd><a href="/program/JSTV/JSTV1">江苏卫视</a> <span class="font10 gray">7.4分/15708粉</span></dd><dd><a href="/program/BTV/BTV1">北京卫视</a> <span class="font10 gray">6.4分/14619粉</span></dd><dd><a href="/program/CETV/CETV1">教育1台</a> <span class="font10 gray">8.4分/6725粉</span></dd><dd><a href="/program/GDTV/GDTV1">广东卫视</a> <span class="font10 gray">6.2分/13977粉</span></dd><dd><a href="/program/HNTV/HNTV1">河南卫视</a> <span class="font10 gray">7.9分/13329粉</span></dd><dd><a href="/program/ZJTV/ZJTV1">浙江卫视</a> <span class="font10 gray">7.7分/15920粉</span></dd></dt><dt>本地热门频道<dd><a href="/program/TVB/TVB1">翡翠台</a> <span class="font10 gray">9.4分/1577粉</span></dd></dt></dl></section>
  <div class="mt10 mb10 fixed"><!-- PG_R2,AL_300*250_PG -->
<script type="text/javascript">
        document.write('<a style="display:none!important" id="tanx-a-mm_10080488_166483_48370005"></a>');
        tanx_s = document.createElement("script");
        tanx_s.type = "text/javascript";
        tanx_s.charset = "gbk";
        tanx_s.id = "tanx-s-mm_10080488_166483_48370005";
        tanx_s.async = true;
        tanx_s.src = "http://p.tanx.com/ex?i=mm_10080488_166483_48370005";
        tanx_h = document.getElementsByTagName("head")[0];
        if(tanx_h)tanx_h.insertBefore(tanx_s,tanx_h.firstChild);
</script></div>
  </aside>

</div>

<div class="topic_footer mt20 gray_border">
  <dl class="lt lh25 alignlt" style="width: 20%;">
    <dt class="bold font14 mb10" >电视节目指南</dt>
    <dd><a href="/program">正在播出</a></dd>
    <dd><a href="/hot">热门节目</a></dd>
    <dd><a href="/tv_genre.jsp">分类预告</a></dd>
    <dd><a href="/program/CCTV">一周节目指南</a></dd>
  </dl>
  <dl class="lt lh25 alignlt" style="width: 20%;">
    <dt class="bold font14 mb10">产品与服务</dt>
    <dd><a href="http://www.deepepg.com/" target="_blank" title="EPG数据服务">EPG数据</a></dd>
    <dd><a href="http://m.tvmao.com/" target="_blank" title="电视猫WAP版">电视猫手机版</a></dd>
    <dd><a href="http://www.kookong.com" target="_blank" title="酷控App">酷控App下载</a></dd>
    <dd><a href="http://www.kookong.com/hongwaimaku" target="_blank" title="红外码库">红外码库</a></dd>
  </dl>
</div>

<div class="lh40 font14 page-content alignct mt40 topic_footer_link">
  <a href="/help/about.jsp">关于我们</a> <span class="gray ml3 mr5">|</span>
  <a href="#">免责声明</a> <span class="gray ml3 mr5">|</span>
  <a href="/help/corperation.jsp">合作伙伴</a> <span class="gray ml3 mr5">|</span>
  <a href="#">诚聘英才</a> <span class="gray ml3 mr5">|</span>
  <a href="/help/contact.jsp">联系我们</a> <span class="gray ml3 mr5">|</span>
  <a href="/links.jsp">友情链接</a> <span class="gray ml3 mr5">|</span>
  <a href="/tvmao_ad.jsp">广告合作</a>
  <p class="gray">© 2005-2014 电视猫 版权所有 [京ICP备05085530号] [京公网安备110106000608号]</p>
</div>


<script type="text/javascript">var cnzz_protocol = (("https:" == document.location.protocol) ? " https://" : " http://");document.write(unescape("%3Cspan id='cnzz_stat_icon_1255238971'%3E%3C/span%3E%3Cscript src='" + cnzz_protocol + "s11.cnzz.com/z_stat.php%3Fid%3D1255238971' type='text/javascript'%3E%3C/script%3E"));</script>

</body>
<script type="text/javascript" src="http://static.tvmao.com/js/common/jquery/jquery.min_1.6.4.js"></script>
<script type="text/javascript" src="http://static.tvmao.com/js/common/jquery.ui_20150908.js"></script>
<script type="text/javascript" src="http://static.tvmao.com/js/common/base_20160310.js"></script>

<script type="text/javascript">
var tmp_pic_site = "http://tmp.tvmao.com";
var static_site = "http://static.tvmao.com";

$(function () {
  var $messageSpanObj = $("a[href='/message'] span[class*='messagbg']");
  if ($messageSpanObj.length > 0) {
    pushTJ( '消息', '提醒', '', '', '');
      $("a[href='/message']").click(function () {
        pushTJ( '消息', '点红圈', '', '', '');
      });
  }
});
</script>
<script type="text/javascript" src="http://static.tvmao.com/js/tvmao/obj_20160113.js"></script>
<script type="text/javascript" src="http://static.tvmao.com/js/common/acheck_20160322.js"></script>

<script type="text/javascript">
$(function(){
  pushTJ( 'PV', 'PG', '', '', '');
});
eval(function(p,a,c,k,e,r){e=function(c){return c.toString(a)};if(!''.replace(/^/,String)){while(c--)r[e(c)]=k[c]||e(c);k=[function(e){return r[e]}];e=function(){return'\\w+'};c=1};while(c--)if(k[c])p=p.replace(new RegExp('\\b'+e(c)+'\\b','g'),k[c]);return p}('$(2(){3 b="4";3 d=c.d("a",b);$.5("/g/7",{8:d},2(a){9(a[0]==1){$("#e").f(a[1])}},"6")});',17,17,'||function|var|src|get|json|pg|p|if|||A||noon|after|api'.split('|'),0,{}))
</script>

<script>
  (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
  })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
  ga('create', 'UA-270816-1', 'auto');
  ga('send', 'pageview');
</script>
</html>
Wisteriapcp
Wisteriapcp 回复Wisteriapcp: 第四行
一年多之前 回复
Wisteriapcp
Wisteriapcp 回复caozhy: 那是什么?我用firebug查看的时候显示http://static.tvmao.com/js/common/jquery/jquery.min_1.6.4.js4行
一年多之前 回复
caozhy
caozhy 回复Wisteriapcp: 不是js
一年多之前 回复
Wisteriapcp
Wisteriapcp 我是想获取了页面内容之后进行分割的
一年多之前 回复
Wisteriapcp
Wisteriapcp 它不是通过js进行加载的吗?如果想获取该怎么做,请指教下O(∩_∩)O~~
一年多之前 回复
Wisteriapcp
Wisteriapcp   2016.03.25 16:32

这个怎么配置,找不到~(≧▽≦)/~

qixinbruce
qixinbruce   2017.01.12 23:58

你是想说不是每个频道里面的内容都在源码中展示出来吧?其实它是用获取请求的方式在你点击频道之后才去进行加载。
具体方法可以使用用谷歌或者火狐浏览器按F12调试进入开发者模式,然后在你点击某个你要切换的频道是,请求中会给你显示一条type为xhr格式的
信息,这就是该次请求要加载的信息,找到这条信息之后,直接抓取这里面的内容就可以了
图片说明
框住的那条就是你要抓取的请求,
图片说明
这个是该请求的具体内容,也就是网页异步加载的真正的内容

oyljerry
oyljerry   Ds   Rxr 2016.03.23 22:02

用webdriver等来获取

Wisteriapcp
Wisteriapcp 回复Wisteriapcp: 这个怎么配置,找不到~\(≧▽≦)/~
一年多之前 回复
Wisteriapcp
Wisteriapcp 如果用它会每次都打开页面,还有其他的办法吗?
一年多之前 回复
Csdn user default icon
上传中...
上传图片
插入图片
准确详细的回答,更有利于被提问者采纳,从而获得C币。复制、灌水、广告等回答会被删除,是时候展现真正的技术了!