Web Scraping (Python 3) 的代码中有语法错误？答案

【问题标题】：Having a Syntax error in the code of Web Scraping (Python 3)?Web Scraping (Python 3) 的代码中有语法错误？
【发布时间】：2020-12-11 04:44:12
【问题描述】：

from bs4 import BeautifulSoup as soup
from urllib.request import urlopen as uReq

my_url = 'https://www.flipkart.com/search?q=iphone+12&sid=tyy%2C4io&as=on&as-show=on&otracker=AS_QueryStore_OrganicAutoSuggest_1_6_na_na_na&otracker1=AS_QueryStore_OrganicAutoSuggest_1_6_na_na_na&as-pos=1&as-type=HISTORY&suggestionId=iphone+12%7CMobiles&requestId=71ed5a8e-4348-4fef-9af8-43b7be8c4d83'

uClient = uReq(my_url)
page_html = uClient.read()
uClient.close()
page_soup = soup(page_html, "html.parser")

containers = page_soup.findAll("div", {"class": "_13oc-S"})
#print(len(containers)) "will tell number of products on the respected page"
#print(len(containers))

#print(soup.prettify(containers[0])) "will bring the page in the organised manner"
#print(soup.prettify(containers[0]))

container=containers[0]
#print(container.div.img["alt"]) "will display the name of the respected product"
#print(container.div.img["alt"])

#price=container.findAll("div",{"class":"col col-5-12 nlI3QM"}) "will tell the price of the respect project"
price=container.findAll("div",{"class":"col col-5-12 nlI3QM"})
#print(price[0].text)

ratings=container.findAll("div",{"class":"gUuXy-"})
#print(ratings[0].text)

#Making a file
filename="products.csv"
f= open(filename, "w")

#Naming the headers
headers="Product_Name,Pricing,Ratings\n"
f.write(headers)

for container in containers:
    product_name = container.div.img["alt"]

    price_container = container.findAll("div", {"class": "col col-5-12 nlI3QM"})
    price = price_container[0].text.strip()

    rating_container = container.findAll("div", {"class":"gUuXy-"})
    rating = rating_container[0].text 

    #print("product_name:" + product_name)
    #print("price:" + price)
    #print("ratings:" + rating)

    #string parsing
    trim_price = ''.join(price.split(','))
    rm_rupee = trim_price.split("&#8377")
    add_rs_price = "Rs." + rm_rupee[0]
    split_price = add_rs_price.split('E')
    final_price = split_price[0]

    split_rating = rating.split(" ")
    final_rating = split_rating[0]

    print(product_name.replace(",", "|") + "," + final_price + "," + final_rating + "\n")
    f.write(product_name.replace(",", "|") + "," + final_price + "," + final_rating + "\n")

f.close()

f.write(product_name.replace(",", "|") + "," + final_price + "," + final_rating + "\n")

在此特定行中有语法错误，我想制作一个 .CSV 文件，但产品没有出现在受尊重的文件中。语法错误是-：发生了异常：UnicodeEncodeError 'charmap' 编解码器无法对位置 35 中的字符 '\u20b9' 进行编码：字符映射到文件“D:\Visual Code Folder\Python\Scraping_Flipkart.py”，第 61 行，在 f.write(product_name.replace(",", "|") + "," + final_price + "," + final_rating + "\n")

【问题讨论】：

向我们展示完整的原始错误消息！
请提供预期的minimal, reproducible example。我们需要 minimal 代码，而不是 50 行的程序转储。包含整个错误消息。
不接受站外链接和文字图片；我们需要您的问题是独立的，以符合本网站的目的。请从intro tour 重复on topic 和how to ask。

标签： python html css

【解决方案1】：

替换这个

f= open(filename, "w")

有了这个

import io
f = io.open(filename, "w", encoding="utf-8")

使用 io 可以向后兼容 Python 2。

如果你只需要支持 Python 3，你可以使用内置的 open 函数来代替：

with open(fname, "w", encoding="utf-8") as f:
    f.write(html)

【讨论】：

这将如何修复 SyntaxError？
打开文件时，您必须使用 encoding="utf-8" 对其进行编码。 Linux 平台不需要，Windows 平台必须使用。