将beautifulsoup数据输出到csv

Question

我想将我的 beautifulsoup 数据输出到包含 2 列的 csv 中：1. 标题，2. 描述

所以标题列应该有soup.Title，然后描述应该是循环中以for x in courselinks开头的打印语句......

**#This is what I tried:**
with open('newcsv.csv','wb') as f:
    writer = csv.writer(f, delimiter='\t')
    writer.writerow('Title')

for x in courselinks[0:3]:
    data = requests.get(("http:"+x)
    soup = bs(data.text)
    print soup.title #This I want in the Title column
    for header in soup.find_all(text='Description'):
        nextNode = header.parent
        while True:
            nextNode = nextNode.nextSibling
            if nextNode is None:
                break
            if isinstance(nextNode, Tag):
                print (nextNode.get_text(strip=True).strip().encode('utf-8')) **#This I want in the Description column**
            if isinstance(nextNode, NavigableString):
                print (nextNode.strip().encode('utf-8')) **#This I want in the Description column**
            if isinstance(nextNode, Tag):
                if nextNode.name == "h2":
                    break

这就是我想要的...

Answer 1

将行写入 csv 时，您只是将数组或列表写入文件。列表或数组中的每个值都是行中的一个值。如果您想要第一列中数组中的第一项，则将其放在第一位，即 0 索引。该行中的每个后续项目都是数组/列表中的后续索引。

for x in courselinks[0:3]:
    data = requests.get(("http:"+x)
    soup = bs(data.text)
    current_row = [soup.title,''] #This I want in the Title column
    for header in soup.find_all(text='Description'):
        current_row[1] = ''
        nextNode = header.parent
        while True:
            nextNode = nextNode.nextSibling
            if nextNode is None:
                writer.writerow(current_row)
                break
            if isinstance(nextNode, Tag):
                current_row[1] += nextNode.get_text(strip=True).strip().encode('utf-8') **#This I want in the Description column**
            if isinstance(nextNode, NavigableString):
                current_row[1] += nextNode.strip().encode('utf-8') **#This I want in the Description column**
            if isinstance(nextNode, Tag):
                if nextNode.name == "h2":
                    writer.writerow(current_row)
                    break