如何比较 2 个不同的 csv 文件并输出差异

Question

我有 2 个 CSV，它们是 New.csv 和 Old.csv，它们有大约 1K 行和 10 列，其结构如下：

如果 new.csv 中的 longName（第一列）不在 old.csv 中，我希望将整个 new.csv 行附加到 changes.csv。

我一开始是这样做的，但它根本不起作用：

def deltaFileMaker():
    with open('Old.csv', 'r', encoding='utf-8') as t1, open('New.csv', 'r', encoding='utf-8') as t2:
        fileone = t1.readlines()
        filetwo = t2.readlines()

    with open('changes.csv', 'w', encoding='utf-8') as outFile:
        for line in filetwo:
            if line not in fileone:
                outFile.write(line)



deltaFileMaker()

我也尝试使用 csv-diff，但找不到将其输出转换为 csv 文件的方法

更新

def deltaFileMaker():
    from csv_diff import load_csv, compare
    diff = compare(
        load_csv(open("old.csv",encoding="utf8"), key="longName"),
        load_csv(open("new.csv",encoding="utf8"), key="longName")
    )

        with open('changes.csv', 'w',encoding="utf8") as f:  
        w = csv.DictWriter(f, diff.keys())
        w.writeheader()
        w.writerow(diff)


deltaFileMaker()

这样做：

Answer 1

你看过csv-diff吗？他们的website 有一个可能适合的例子：

from csv_diff import load_csv, compare
diff = compare(
    load_csv(open("one.csv"), key="id"),
    load_csv(open("two.csv"), key="id")
)

这应该返回一个 dict 对象，您可以将其解析为 CSV 文件。要将 that dict 解析为行，这是一个示例。 注意：正确编写更改很困难，但这更像是一个概念验证 - 随意修改

from csv_diff import load_csv, compare
fro csv import DictWriter

# Get all the row headers across all the changes
headers = set({'change type'})
for key, vals in diff.items():
    for val in vals: # Multiple of the same difference 'type'
        headers = headers.union(set(val.keys()))

# Write changes to file
with open('changes.csv', 'w', encoding='utf-8') as fh:
    w = DictWriter(fh, headers)
    w.writeheader()
    for key, changes in diff.items():
        for val in changes: # Add each instance of this type of change
            val.update({'change type': key}) # Add 'change type' data
            w.writerow(val)

对于文件one.csv：

id,     name, age
 1,     Cleo,   4
 2, Pancakes,   2

和two.csv:

id,   name, age
 1,   Cleo,   5
 3, Bailey,   1
4,  Elliot,  10

运行它会产生：

change type,     name, id,               changes, age, key
      added,   Bailey,  3,                      ,   1,
      added,   Elliot,  4,                      ,  10,
    removed, Pancakes,  2,                      ,   2,
    changed,         ,   , "{'age': ['4', '5']}",    ,   1

所以不是对所有更改都很好，但对添加/删除的行非常有效。