找不到 GET 请求答案

【问题标题】：Can't locate the GET request找不到 GET 请求
【发布时间】：2017-02-19 02:44:07
【问题描述】：

这是我正在查看的页面：http://beta.fortune.com/fortune500/walmart-1

我在 Chrome 开发工具网络选项卡下看到的唯一相关 XHR 是：http://fortune.com/api/v2/company/wmt/expand/1

但是对此的响应并不包含页面的所有数据，仅包含定价数据。我一直在尝试找到针对您在页面顶部看到的黑色背景数据的请求（以前的排名、收入 ($M)、Rev Change 等）。对此数据的 GET 请求是什么？还是以其他方式填充这些字段？

【问题讨论】：

标签： web-scraping get xmlhttprequest httprequest google-chrome-devtools

【解决方案1】：

仔细查看网页源代码（来自http://beta.fortune.com/fortune500/walmart-1的XHR响应），您将看到以下HTML片段（我只是将其美化以使其更清晰）：

<div data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0">
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Previous Rank" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Previous Rank.0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Previous Rank.0.0">Previous Rank</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Previous Rank.0.1">1</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Revenues ($M)" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Revenues ($M).0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Revenues ($M).0.0">Revenues ($M)</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Revenues ($M).0.1">$482,130</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Rev Change" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Rev Change.0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Rev Change.0.0">Rev Change</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Rev Change.0.1">-0.7%</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profits ($M)" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profits ($M).0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profits ($M).0.0">Profits ($M)</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profits ($M).0.1">$14,694</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profit Change" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profit Change.0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profit Change.0.0">Profit Change</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Profit Change.0.1">-10.2%</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Assets ($M)" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Assets ($M).0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Assets ($M).0.0">Assets ($M)</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Assets ($M).0.1">$199,581</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Employees" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Employees.0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Employees.0.0">Employees</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Employees.0.1">2,300,000</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Mkt Value as of 3/31/16 ($M)" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Mkt Value as of 3/31/16 ($M).0"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Mkt Value as of 3/31/16 ($M).0.0">Mkt Value as of 3/31/16 ($M)</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Mkt Value as of 3/31/16 ($M).0.1">$215,356</span></a>
    </div>
    <div class="ranking-slide brand-revenue-slide" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index" style="transform:translateX(0px);-webkit-transform:translateX(0px);">
        <a class="ranking-caption" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.0" href="https://morningconsultintelligence.com/examine?v=YnJhbmRzX3RyZW5kX3dhbG1hcnQ&amp;d=dHNkYXQ&amp;s=bW9ybmluZyBjb25zdWx0&amp;ref=Zm9ydHVuZQ"><span class="title" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.0.0">Morning Consult Brand Index</span><span class="data" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.0.1">A-</span></a><a class="morning-consultant" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.1" href="javascript:void(0)"><svg data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.1.0" height="19" viewbox="0 0 19 19" width="19">
        <path d="M17.153 9.368c0 4.293-3.492 7.785-7.785 7.785-4.292 0-7.785-3.492-7.785-7.785 0-4.292 3.493-7.785 7.785-7.785 4.293 0 7.785 3.493 7.785 7.785M19 9.5C19 4.262 14.738 0 9.5 0S0 4.262 0 9.5 4.262 19 9.5 19 19 14.738 19 9.5m-7.96-4.005c.195-.196.307-.468.307-.745 0-.28-.112-.55-.308-.747-.197-.197-.47-.31-.748-.31-.277 0-.55.113-.746.31-.198.196-.31.468-.31.747 0 .277.112.55.31.745.197.197.467.31.746.31.278 0 .55-.113.747-.31m-2.044 9.81c-.164 0-.326-.054-.458-.16-.21-.17-.31-.44-.26-.705l1.03-5.184-.567.317c-.35.196-.796.072-.993-.277-.198-.35-.074-.79.277-.988l1.947-1.09c.25-.14.556-.12.787.045.23.166.343.45.288.728L9.98 13.363l.873-.378c.37-.16.8.008.96.375.162.367-.007.794-.377.954l-2.15.93c-.093.042-.192.062-.29.062" data-reactid=".16d1cbmhnfi.1.0.4.1:1.3.1.0.0.0.$slide-Morning Consult Brand Index.1.0.0" fill="#1BAAE1"></path></svg></a>
    </div>
</div>

该数据完全代表您所询问的网页内容：

【讨论】：

@ba_ul 你检查了吗？