dscojuxf69080 2017-04-09 11:39
浏览 44
已采纳

PHP dom解析代码echos每个语句三次而不是一次

I have this code to extract statements from a multiple pages of a forum site. it works great except it prints each statement thrice instead of once. I checked each and every line still i don't understand why.

My code goes as:

<?php
    set_time_limit(3600);
    $i = 0;

    while($i < 100)
    {
        $e = 839303 - $i;

        require_once('dom/simple_html_dom.php'); 
        $html =file_get_html('http://www.usmleforum.com/files/forum/2017/1/'.$e.'.php');

        foreach ($html->find("tr") as $row)
        {
            $element = $row->find('td.Text2',0);

            if ($element == null) { continue; }

            $textNode = array_filter($element->nodes, function ($n)
            {
                 return $n->nodetype == 3;        //Text node type, like in jQuery     
            });

            if (!empty($textNode))
            {
                $text = current($textNode);
                echo $text."<br>"; 
            }
        }

        $i++;
    }
?>

In other hand, if the site that we are extracting contains more than on statements of the hidden somewhere, can we only ask the parser to echo once?

Any help is appreciated..

Trying to parse user details...but not working,, kinda skipping..

//User
    $element = $html->find('td.FootNotes2',0);
    if ($element == null) { continue; }
    $textNode = array_filter($element->nodes, function ($n) {
    return $n->nodetype == 3;        
    });
    if (!empty($textNode)) {
    $text = current($textNode);
    echo $text."<br><hr><hr>"; 
    }
  • 写回答

1条回答 默认 最新

  • douyong1908 2017-04-09 13:04
    关注

    The reason you are getting 3 outputs of the same text is because of the selection being made and the HTML structure of the page. The entire site is made up of nested tables, and so what is happening is the used query is finding all <tr>...</tr> tags on the entire page. Then looping through every tr tag and looking for the first td.Text2 which also shows up in the HTML multiple times on the pages, example.

    This is going to be a tricky crawl given the structure of the HTML and you may be better off searching for only td.Text2 and grabbing the first one on the page instead. Below is an example of this solution.

    Something like seems to work, but the pages are not the same throughout the loop so the results are a little weird:

    <?php
    require_once('dom/simple_html_dom.php');
    set_time_limit(3600);
    $i = 0;
    
    while ($i < 100) {
        $e = 839303 - $i;
        $html = file_get_html('http://www.usmleforum.com/files/forum/2017/1/'.$e.'.php');
        $i++;
    
        $element = $html->find('td.Text2',0);
    
        if ($element == null ) { continue; }
    
        $textNode = array_filter($element->nodes, function ($n) {
             return $n->nodetype == 3;        //Text node type, like in jQuery
        });
    
        if (!empty($textNode)) {
            $text = current($textNode);
            echo $text."<br>";
        }
    
        // Getting User/Author
        $parent = $element->parent()->parent();
        $element = $parent->find('td.FootNotes2',1);
        if ($element == null) { continue; }
        $textNode = array_filter($element->nodes, function ($n) {
          return $n->nodetype == 3;
        });
        if (!empty($textNode)) {
          $text = current($textNode);
          echo $text."<br><hr><hr>";
        }
    }
    
    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题?

悬赏问题

  • ¥15 素材场景中光线烘焙后灯光失效
  • ¥15 请教一下各位,为什么我这个没有实现模拟点击
  • ¥15 执行 virtuoso 命令后,界面没有,cadence 启动不起来
  • ¥50 comfyui下连接animatediff节点生成视频质量非常差的原因
  • ¥20 有关区间dp的问题求解
  • ¥15 多电路系统共用电源的串扰问题
  • ¥15 slam rangenet++配置
  • ¥15 有没有研究水声通信方面的帮我改俩matlab代码
  • ¥15 ubuntu子系统密码忘记
  • ¥15 保护模式-系统加载-段寄存器