UnicodeDecodeError：“ascii”编解码器无法解码位置 1286 中的字节 0xc3：序数不在范围内（128）

Question

Traceback (most recent call last):
File "AutomationTool.py", line 2, in <module>
import MultiProcessController, RedisUtil, ADUtils, json, time
File "/var/www/html/ARB-Automation/MultiProcessController.py", line 2, in <module>
import AdTitleExtraction, ADUtils, AdwordsClient, RedisUtil, FinalURLRetrieval, ClusterStrategy, \
File "/var/www/html/ARB-Automation/AdTitleExtraction.py", line 2, in <module>
import Config, ADUtils, re, wordsegment as WS, queue, threading, time
File "/var/www/html/ARB-Automation/ADUtils.py", line 3, in <module>
import pymssql, pymysql, wordsegment as WS, gc
File "/usr/local/lib/python3.4/site-packages/wordsegment.py", line 49, in <module>
bigram_counts = parse_file(join(basepath, 'bigrams.txt'))
File "/usr/local/lib/python3.4/site-packages/wordsegment.py", line 45, in parse_file
return dict((word, float(number)) for word, number in lines)
File "/usr/local/lib/python3.4/site-packages/wordsegment.py", line 45, in <genexpr>
return dict((word, float(number)) for word, number in lines)
File "/usr/local/lib/python3.4/site-packages/wordsegment.py", line 44, in <genexpr>
lines = (line.split('\t') for line in fptr)
File "/usr/local/lib/python3.4/encodings/ascii.py", line 26, in decode
return codecs.ascii_decode(input, self.errors)[0]


UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 1286: ordinal not in range(128)

我正在尝试在我的 python 代码中使用 wordsegment，我使用 python3.4.4，它曾经在我的本地机器上工作。我部署在生产服务器上，我得到了这个错误，我不知道为什么会这样。 有人可以帮帮我吗？

Answer 1

如果一切都失败了，Python 3 会尝试从语言环境设置中推断出正确的输入/输出字符集。大概您的生产服务器上的语言环境不是 UTF-8 语言环境，这就是 Python 出错的原因。

您可以通过使用PYTHONIOENCODING 环境变量来强制进行某种编码；例如

PYTHONIOENCODING=UTF-8 python myprogram.py

或通过设置适当的 UTF-8 语言环境，例如 C.UTF-8 或 en_US.UTF-8。