WebRequest 上不允许使用错误 405 方法

Question

我正在尝试从以下页面获取页面代码。它给了我一个 405 错误。如果我尝试从主页获取页面代码，它可以正常工作，但从这个特定页面我得到 Method not allowed，想法？

        WebRequest request = WebRequest.Create("https://www.realtor.com/realestateandhomes-search/California/counties");
        request.UseDefaultCredentials = true;
        request.Credentials = CredentialCache.DefaultCredentials;
        HttpWebResponse response = (HttpWebResponse)request.GetResponse();
        Stream dataStream = response.GetResponseStream();
        StreamReader reader = new StreamReader(dataStream);
        string responseFromServer = reader.ReadToEnd();

        Console.WriteLine(responseFromServer);

Answer 1

网站认为你是机器人。

详情：

我用HttpClient 进行了尝试（推荐：在收到非 200 响应代码时不会抛出异常），并检查了响应 HTML。这是重要的片段：

      <p>
        As you were browsing, something about your browser made us think you might be a bot. There are a few reasons this might happen, including:
      </p>
      <ul>
        <li>You're a power user moving through this website with super-human speed</li>
        <li>You've disabled JavaScript and/or cookies in your web browser</li>
        <li>A third-party browser plugin is preventing JavaScript from running. Additional information is available in this
          <a title='Third party browser plugins that block javascript' href='http://ds.tl/help-third-party-plugins' target='_blank'>
            support article
          </a>.
        </li>
      </ul>

如果您想要完整的响应，请尝试运行：

async void LogResponse()
{
    using System.Net.Http.HttpClient client = new System.Net.Http.HttpClient();
    var response = await client.GetAsync("https://www.realtor.com/realestateandhomes-search/California/counties");
    Console.WriteLine(await response.Content.ReadAsStringAsync());
}

对 realtor.com 的侧面投诉，405（Request-Line 中指定的方法是不允许的）是一个相当糟糕的响应代码； 403（服务器理解请求，但拒绝满足它。）似乎更适合。