使用 selenium 选择单个表时遇到问题

Question

我尝试使用 selenium 从网页中抓取表格数据。但是，它会解析该页面中的所有表，但我需要一个。我找不到关于如何选择单个表格的任何想法。这是我尝试过的：

Sub table_data()
    Dim driver As New WebDriver
    Dim tabl As Object, rdata As Object, cdata As Object

    Set driver = New WebDriver
    driver.Start "Phantomjs", "https://fantasy.premierleague.com"
    driver.get "/player-list/"
    For Each tabl In driver.FindElementsByXPath("//table[@class='ism-table']")
        For Each rdata In tabl.FindElementsByXPath(".//tr")
            For Each cdata In rdata.FindElementsByXPath(".//td")
            y = y + 1
            Cells(x, y) = cdata.Text
            Next cdata
            x = x + 1
            y = 0
        Next rdata
    Next tabl
End Sub

不过，我是用 XHR 做到的！

Sub TableData()
Dim xmlpage As New XMLHTTP60
Dim htmldoc As New MSHTML.HTMLDocument
Dim htmlas As Object, tRow As Object, tCel As Object

x = 1
With xmlpage
    .Open "GET", "https://fantasy.premierleague.com/player-list/", False
    .send
    htmldoc.body.innerHTML = .responseText
End With
Set htmlas = htmldoc.getElementsByTagName("table")(2)
For Each tRow In htmlas.Rows
    For Each tCel In tRow.Cells
        c = c + 1
        Cells(x, c) = tCel.innerText
    Next tCel
    c = 0
    x = x + 1
Next tRow
End Sub

Answer 1

一旦第一个表的行完成，您就可以简单地打破 ForEach 循环

Sub table_data()
    Dim driver As New WebDriver
    Dim tabl As Object, rdata As Object, cdata As Object

    Set driver = New WebDriver
    driver.Start "Phantomjs", "https://fantasy.premierleague.com"
    driver.get "/player-list/"
    For Each tabl In driver.FindElementsByXPath("//table[@class='ism-table']")
        For Each rdata In tabl.FindElementsByXPath(".//tr")
            For Each cdata In rdata.FindElementsByXPath(".//td")
            y = y + 1
            Cells(x, y) = cdata.Text
            Next cdata
            x = x + 1
            y = 0
        Next rdata
        Goto end_of_for
    Next tabl
    end_of_for:
End Sub

或者只是获取FindElementsByXPath 的第一个元素，因为driver.FindElementsByXpath(....)(0) 应该返回第一个元素。

--（编辑）

根据this docs，您应该能够通过Items 获得正确的值，因此它将是driver.FindElementsByXpath(....).Item(4)。

Answer 2

实际上你可以通过 XHR 和 Split 做到这一点，不需要使用 Selenium。看看下面的代码：

Option Explicit

Sub Scrape_premierleague_com()

    Dim sResponse, j, i, aRows, aCells

    With CreateObject("MSXML2.XMLHTTP")
        .Open "GET", "https://fantasy.premierleague.com/player-list/", False
        .Send
        sResponse = .responseText
    End With
    ThisWorkbook.Sheets(1).Cells.Delete
    sResponse = Split(Split(sResponse, "<tbody>")(1), "</tbody>", 2)(0) ' 1 - number of the table
    aRows = Split(sResponse, "<tr>")
    For j = 1 To UBound(aRows)
        aCells = Split(aRows(j), "<td>")
        For i = 1 To UBound(aCells)
            ThisWorkbook.Sheets(1).Cells(j, i).Value = Split(aCells(i), "</td>", 2)(0)
        Next
    Next
    ThisWorkbook.Sheets(1).Columns.AutoFit

End Sub

这是我的输出：