【发布时间】:2015-09-09 13:43:53
【问题描述】:
我的输入是一个大的 csv 文件,其中的行如下:
"7807371008","Sat Jan 16 00:07:46 +0000 2010","@bigg_robb welcome to the party life of politics","T 33.417474,-86.705343","al","23845121","1381","502","Wed Mar 11 22:38:27 +0000 2009","2468"
我想要的输出是一个新文件,其中第一列和第三列仅删除了所有特殊字符:
7807371008, bigg robb welcome to the party life of politics
但是在文本之间有一些换行符的行,即使它在技术上不是该行的末尾。在这种情况下,我收到错误:
IndexError: list index out of range
这样的行的一个例子是:
"7807376607","Sat Jan 16 00:07:57 +0000 2010","RT @CBS8News:The commander of Gov. Riley's task
force on illegal gambling resigns after winning $2,300 at a MS casino.
gt;#conflictofinterest","Montgomery, Alabama","al","33358058","84","164","Mon Apr 20 00:48:37 +0000 2009","4509"
我的代码是:
import csv
import sys
import re
with open('al.csv') as f:
for line in f:
j = next(csv.reader([line]))
id1 = j[0]
id2 = re.sub('[^A-Za-z0-9\.]+',' ',id1)
tt1 = j[2]
tt2 = re.sub('[^A-Za-z0-9\.]+',' ',tt1)
print id2.strip()+", "+tt2.lower()
我该如何解决这个问题?请帮忙。
【问题讨论】:
标签: python regex string parsing csv