从 html 文档中的多个 <table> 标记中刮取相关的文本对答案

【问题标题】：Scrape related pairs of text from multiple <table> tags in an html document从 html 文档中的多个 <table> 标记中刮取相关的文本对
【发布时间】：2021-05-20 14:09:18
【问题描述】：

我在数据库字段中有这个 html 源代码。我想分析这段代码，特别是一些表格的字段，并将它们打印在屏幕上。代码超过3000行，无法发布所有代码，这是代码的开始：

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" id="mainLayout">
    <head>
        <title>Anglosphere x3</title>
<meta http-equiv="cache-control" content="max-age=0" />
<meta http-equiv="pragma" content="no-cache" />
<meta http-equiv="expires" content="0" />
<meta http-equiv="imagetoolbar" content="no" />
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
<meta name="content-language" content="en-US" />
<meta name="viewport" content="width=device-width">
    <script data-cmp-ab="1">window.cmp_block_ignoredomains = ['recaptcha.net']</script>
    <script data-cmp-ab="1" src="https://cdn.consentmanager.mgr.consensu.org/delivery/cookieblock.min.js" ></script>
    <link rel="stylesheet" href="https://cdn.consentmanager.mgr.consensu.org/delivery/cmp.min.css" />

这是关于我感兴趣的表格的代码：

<table cellspacing="1" cellpadding="1" class="troop_details inReturn"
    >
        <thead>
            <tr>
                <td class="role">
                                            <a href="/karte.php?d=91628">01] #WorkInProgress</a>
                                    </td>
                <td colspan="11" class="troopHeadline">
                                                                <a href="/karte.php?d=91611">Return from 01-soldier</a>
                                    </td>
            </tr>
        </thead>
        <tbody class="units">
            <tr>
                <th class="coords">
                                            &#x202d;<span class="coordinates coordinatesWrapper coordinatesAligned coordinatesltr"><span class="coordinateX">(&#x202d;&minus;&#x202d;1&#x202c;&#x202c;</span><span class="coordinatePipe">|</span><span class="coordinateY">&#x202d;&minus;&#x202d;28&#x202c;&#x202c;)</span></span>&#x202c;                                    </th>
                                    <td class="uniticon">
                        <img class="unit u21" title="Phalanx: 1:12:51" alt="Phalanx" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u22" title="Swordsman: 1:25:00" alt="Swordsman" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u23" title="Pathfinder: 0:30:00" alt="Pathfinder" src="/img/x.gif" />                  </td>
                                    <td class="uniticon">
                        <img class="unit u24" title="Theutates Thunder: 0:26:51" alt="Theutates Thunder" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u25" title="Druidrider: 0:31:53" alt="Druidrider" src="/img/x.gif" />                  </td>
                                    <td class="uniticon">
                        <img class="unit u26" title="Haeduan: 0:39:14" alt="Haeduan" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u27" title="Ram: 2:07:30" alt="Ram" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u28" title="Trebuchet: 2:50:00" alt="Trebuchet" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u29" title="Chieftain: 1:42:00" alt="Chieftain" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u30" title="Settler: 1:42:00" alt="Settler" src="/img/x.gif" />                    </td>
                                                    <td class="uniticon last">
                        <img class="unit uhero" title="Hero" alt="Hero" src="/img/x.gif" />                 </td>
                            </tr>
        </tbody>

        <tbody class="units last">
            <tr>
                <th>Troops</th>
                                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit">
                                                    500                                         </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none last">
                                                    0                                           </td>
                            </tr>
        </tbody>

                    <tbody class="infos">
                <tr>
                    <th>Bounty</th>
                    <td colspan="11">
                        <div class="res">
                            <div class="inlineIconList resourceWrapper"><div class="inlineIcon resources" title="Lumber"><i class="r1"></i><span class="value ">6758</span></div><div class="inlineIcon resources" title="Clay"><i class="r2"></i><span class="value ">8093</span></div><div class="inlineIcon resources" title="Iron"><i class="r3"></i><span class="value ">6908</span></div><div class="inlineIcon resources" title="Crop"><i class="r4"></i><span class="value ">15741</span></div></div>                       </div>
                        <div class="carry">
                            <img class="carry full" title="carry"
                                 alt="carry"
                                 src="/img/x.gif"/> &#x202d;&#x202d;37500&#x202c;&nbsp;/&nbsp;&#x202d;37500&#x202c;&#x202c;                     </div>
                    </td>
                </tr>
            </tbody>
        
        <tbody class="infos">
            <tr>
                <th>Arrival</th>
                <td colspan="11">
                    <div class="in">in&nbsp;<span  class="timer" counting="down" value="85">0:01:25</span>&nbsp;hrs.</div>
                    <div class="at"><span>at&nbsp;00:43:10</span><span> </span></div>
                </td>
            </tr>
        </tbody>
    </table>
            <a name="at"></a>
    <table cellspacing="1" cellpadding="1" class="troop_details inReturn"
    >
        <thead>
            <tr>
                <td class="role">
                                            <a href="/karte.php?d=91628">01] #WorkInProgress</a>
                                    </td>
                <td colspan="11" class="troopHeadline">
                                                                <a href="/karte.php?d=94829">Return from 0-New Hulk</a>
                                    </td>
            </tr>
        </thead>
        <tbody class="units">
            <tr>
                <th class="coords">
                                            &#x202d;<span class="coordinates coordinatesWrapper coordinatesAligned coordinatesltr"><span class="coordinateX">(&#x202d;&minus;&#x202d;1&#x202c;&#x202c;</span><span class="coordinatePipe">|</span><span class="coordinateY">&#x202d;&minus;&#x202d;28&#x202c;&#x202c;)</span></span>&#x202c;                                    </th>
                                    <td class="uniticon">
                        <img class="unit u21" title="Phalanx: 0:45:33" alt="Phalanx" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u22" title="Swordsman: 0:53:09" alt="Swordsman" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u23" title="Pathfinder: 0:18:46" alt="Pathfinder" src="/img/x.gif" />                  </td>
                                    <td class="uniticon">
                        <img class="unit u24" title="Theutates Thunder: 0:16:47" alt="Theutates Thunder" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u25" title="Druidrider: 0:19:56" alt="Druidrider" src="/img/x.gif" />                  </td>
                                    <td class="uniticon">
                        <img class="unit u26" title="Haeduan: 0:24:32" alt="Haeduan" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u27" title="Ram: 1:19:44" alt="Ram" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u28" title="Trebuchet: 1:46:18" alt="Trebuchet" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u29" title="Chieftain: 1:03:47" alt="Chieftain" src="/img/x.gif" />                    </td>
                                    <td class="uniticon">
                        <img class="unit u30" title="Settler: 1:03:47" alt="Settler" src="/img/x.gif" />                    </td>
                                                    <td class="uniticon last">
                        <img class="unit uhero" title="Hero" alt="Hero" src="/img/x.gif" />                 </td>
                            </tr>
        </tbody>

        <tbody class="units last">
            <tr>
                <th>Troops</th>
                                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit">
                                                    400                                         </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none">
                                                    0                                           </td>
                                    <td class="unit none last">
                                                    0                                           </td>
                            </tr>
        </tbody>

                    <tbody class="infos">
                <tr>
                    <th>Bounty</th>
                    <td colspan="11">
                        <div class="res">
                            <div class="inlineIconList resourceWrapper"><div class="inlineIcon resources" title="Lumber"><i class="r1"></i><span class="value ">6130</span></div><div class="inlineIcon resources" title="Clay"><i class="r2"></i><span class="value ">5835</span></div><div class="inlineIcon resources" title="Iron"><i class="r3"></i><span class="value ">5638</span></div><div class="inlineIcon resources" title="Crop"><i class="r4"></i><span class="value ">12397</span></div></div>                       </div>
                        <div class="carry">
                            <img class="carry full" title="carry"
                                 alt="carry"
                                 src="/img/x.gif"/> &#x202d;&#x202d;30000&#x202c;&nbsp;/&nbsp;&#x202d;30000&#x202c;&#x202c;                     </div>
                    </td>
                </tr>
            </tbody>
        
        <tbody class="infos">
            <tr>
                <th>Arrival</th>
                <td colspan="11">
                    <div class="in">in&nbsp;<span  class="timer" counting="down" value="920">0:15:20</span>&nbsp;hrs.</div>
                    <div class="at"><span>at&nbsp;00:57:05</span><span> </span></div>
                </td>
            </tr>
        </tbody>
    </table>

我感兴趣的数据如下：

01-士兵归来00:43:10
0-新绿巨人归来00:57:05

这是我的代码，但它提供了一个空的 array ( );

<?php
    include_once('simple_html_dom.php');
    $caserma = $_SESSION["caserma"];
    
    $dom = new DOMDocument;
    libxml_use_internal_errors(true);
    $dom->loadHTML($_SESSION["caserma"]);
    $xpath = new DOMXPath($dom);
    $texts = [];
    foreach ($xpath->query("//table[contains(@class, 'troop_details') and contains(@class, 'inReturn')]//td[@class='troopHeadline']//a[@href]/text()") as $textNode) {
        $texts[] = $textNode->nodeValue;
    }        
    var_export($texts);
     ?>

我认为我的输入不是有效的 xml/html，所以我尝试查找如下错误：

 $object = simplexml_load_string($_SESSION["caserma"]);

 if ($object === false) {
     $errors = libxml_get_errors();
     print_r($errors)
 }

这是我的输出：

Array ( [0] => LibXMLError Object ( [level] => 3 [code] => 4 [column] => 1 [message] => 需要开始标签，' [line] => 1 ) )

我该如何解决？

【问题讨论】：

标签： php html dom xpath domdocument

【解决方案1】：

您似乎想要访问与先前匹配的文本相同的<table> 中存在的<div class="at"> 文本。

通常，我只是将 $table 变量输入到嵌套的 xpath query() 调用中，但我认为您的 html 格式错误太多，以至于不可靠（这是我在测试时发现的，除非我只是搞砸了我的演示）。

另一种可行的方法是获取节点路径并将其添加到嵌套的 xpath 路径字符串中。见：https://stackoverflow.com/a/37679621/2943403

代码：(Demo)

$dom = new DOMDocument;
libxml_use_internal_errors(true);
$dom->loadHTML($_SESSION["caserma"]);
$xpath = new DOMXPath($dom);
$texts = [];
foreach ($xpath->query("//table[contains(@class, 'troop_details') and contains(@class, 'inReturn')]") as $table) {
    $tablePath = $table->getNodePath();
    $texts[] = [
        'troopHeadline' => $xpath->query($tablePath . "//td[@class='troopHeadline']//a[@href]/text()")[0]->nodeValue,
        'atTime' => substr($xpath->query($tablePath . "//div[@class='at']/span[starts-with(text(), 'at')]/text()")[0]->nodeValue, -8)
    ];
}
var_export($texts);

输出：

array (
  0 => 
  array (
    'troopHeadline' => 'Return from 01-soldier',
    'atTime' => '00:43:10',
  ),
  1 => 
  array (
    'troopHeadline' => 'Return from 0-New Hulk',
    'atTime' => '00:57:05',
  ),
)

【讨论】：

首先感谢您的宝贵时间。没有什么我的输出总是一样的，空数组。
我正在使用您的输入来成功演示。您的数据或您对我的建议的实施一定有问题。
$caserma = $_SESSION["caserma"]; $_SESSION["caserma"] = <<<HTML $caserma; HTML; 正确吗？
难道问题出在变量中包含的文本上？基本上我是通过一个textarea获取源代码，把所有东西都放到数据库里，保存在会话变量$_SESSION["caserma"]中，这样我大概只有文本没有对象吧？
没错。如果$_SESSION["caserma"] 包含html 文档的文本，则将该字符串加载到DOMDocument 中。我只使用“HEREDOC”语法（<<<SOMETHING ... SOMETHING;），因为我无权访问您的会话数组。如果文本已经在您的会话数组中，则直接使用该值。请注意，我的回答绝不使用simplexml_load_string。