用漂亮的汤解析 span

Question

我正在尝试解析某个网站，试图找到 div 标签和 class_ 中的“span”。 Span 在特定类中，如果等于字符串，例如“line”，则返回网站的实际链接。

我收到的错误消息：

第 28 行，在 soup = BeautifulSoup(url_html,"html.parser") 第 245 行，在 init 中 elif len(markup)

import csv
from bs4 import BeautifulSoup
import requests

contents = []

def condition_check():
    for sp in soup.find("div",class_='-vDIg'):
        check = sp.span
        if check in ['Line','LINE ID',]:
            return link


filename = 'link_business_filter.csv'

with(open(filename,'rt')) as f:
    data = csv.reader(f)

    for row in data:
        links = row[0]
        contents.append(links)



for link in contents:
    url_html = requests.get(link)
    soup = BeautifulSoup(url_html,"html.parser")
    con_fltr = condition_check()
    print(con_fltr)

Answer 1

您将 Request 对象传递给 Beautiful Soup，您需要像这样传递 html 内容：

for link in contents:
    url_html = requests.get(link)
    soup = BeautifulSoup(url_html.content,"html.parser")
    con_fltr = condition_check()
    print(con_fltr)

url_html --> url_html.content