从通过 BeautifulSoup 获取的 Web 表创建 CSV 电子表格

Question

我正在尝试从该网站 (https://blog.prepscholar.com/act-to-sat-conversion) 解析第二个表并将其输出为 CSV 文件。我无法将输出写入 CSV，因此我尝试为每一行创建字符串，然后将其列出以写入 CSV，但我失败了。你可以帮帮我吗？非常感谢！

这是我目前的代码：

import csv
from urllib.request import urlopen
from bs4 import BeautifulSoup
tpage1 = 'https://blog.prepscholar.com/act-to-sat-conversion'
hpage = urlopen(tpage1)
bs = BeautifulSoup(hpage, 'html.parser')

for h1 in bs.find_all('h1'):
    print(h1.get_text())
table = bs.find_all('table')[1]
rows = table.find_all('tr')
headers = table.find_all('th')
rownum = 0

for row in rows:
    rownum += 1
    cellnum = 0

    new_row = ''
    for cell in row.find_all(['td','th']):
        cellnum += 1

        print(rownum, cellnum, cell.get_text())

这段代码给了我一个输出（下面是一个sn-p）

SAT / ACT Prep Online Guides and Tips
1 1 ACT Composite Score
1 2 Estimated SAT Composite
1 3 Estimated SAT Composite Range
2 1 36
2 2 2390
2 3 2320-2400
3 1 35
3 2 2260
3 3 2320-2310
4 1 34
4 2 2170
4 3 2140-2220

如何修改它以输出到 CSV？

Answer 1

使用pandas

import pandas as pd

all_tables = pd.read_html('https://blog.prepscholar.com/act-to-sat-conversion')
all_tables[0].to_csv("output1.csv")
all_tables[1].to_csv("output2.csv") 

BeautifulSoup 需要更多的工作。

import csv
from urllib.request import urlopen
from bs4 import BeautifulSoup

url = 'https://blog.prepscholar.com/act-to-sat-conversion'

html = urlopen(url)
soup = BeautifulSoup(html, 'html.parser')

table = soup.find_all('table')[1]

fh = open('output.csv', 'w')
cvs_writer = csv.writer(fh)

all_data = []
rows = table.find_all('tr')
for row in rows:
    cells = row.find_all(['td','th'])
    row_data = []
    for cell in cells:
        row_data.append(cell.get_text())
    all_data.append(row_data)
    cvs_writer.writerow(row_data)

print(all_data)
fh.close()

列表理解和不将数据保存在 all_data 中的时间稍短

import csv
from urllib.request import urlopen
from bs4 import BeautifulSoup

url = 'https://blog.prepscholar.com/act-to-sat-conversion'

html = urlopen(url)
soup = BeautifulSoup(html, 'html.parser')

table = soup.find_all('table')[1]

fh = open('output.csv', 'w')
cvs_writer = csv.writer(fh)

for row in table.find_all('tr'):
    row_data = [cell.get_text() for cell in row.find_all(['td','th'])]
    cvs_writer.writerow(row_data)

fh.close()