一个数据集中多列的模糊连接字符串答案

【问题标题】：Fuzzy join strings on multiple columns in one dataset一个数据集中多列的模糊连接字符串
【发布时间】：2019-10-09 05:50:57
【问题描述】：

我想将一列 (df2$brands) 模糊匹配到包含相同字符串但有一些小的拼写错误的许多其他列 (df1$F6_1:f6_12)。

我有两个数据集：

df1:

df1 <- structure(list(F6_1 = c("Braand1", "Brand2", "Brand3", "Brand4", "Brand4", 
"Brand5", "Brand6", "Brand7", "Brand6", "Brand8"), F6_2 = c("Brand9", 
"", "Brand4", "Brando6", "Brand6", "Brand8", "Brannd4", "Brandd8", 
"Brand6", "Brand6"), F6_3 = c("Brand6", "", "Brand6", 
"Brand10", "Brand10", "", "Brand8", "Brand10", "Brand8", "Brand3"
), F6_4 = c("", "", "Brand10", "", "Brand3", "", "Brand6", "Brand6", 
"Bramd3", "BPand3"), F6_5 = c("", "", "", "", "Brand6", 
"", "Brand1", "Brand1", "", "Brand1"), F6_6 = c("", 
"", "", "", "Brand6", "", "Brand3", "", "", "Brand1"), F6_7 = c("", 
"", "", "", "Brand1", "", "Brand1", "", "", "Brand1"), F6_8 = c("", 
"", "", "", "Brand1", "", "", "", "", "Brand6"
), F6_9 = c("", "", "", "", "Brrandu3", "", "", "", "", ""), F6_10 = c("", 
"", "", "", "Brand6", "", "", "", "", ""), F6_11 = c("", 
"", "", "", "Brand6", "", "", "", "", ""), F6_12 = c("", "", 
"", "", "Brand6", "", "", "", "", "")), row.names = c(NA, -10L), class = c("tbl_df", 
"tbl", "data.frame"))

df2:

df2 <- structure(list(brands = c("Brand1", "Brand2", "Brand3", "Brand4", "Brand5", 
"Brand6")), row.names = c(NA, -6L), class = c("tbl_df", "tbl", 
"data.frame"))

我尝试使用来自fuzzyjoin 库的stringdist_left_join() 函数，该函数运行良好。

library(tidyverse)
library(fuzzyjoin)

df1_F6_1 <- df1 %>% select(F6_1)
df2_F6_1 <- df2 %>% select(F6_1 = brands)

df_joined_F6_1 <- stringdist_left_join(df_F6_1, df2_F6_1, by = "F6_1", method = "soundex")

这仅适用于一列。但是，我想在完整的 df1 数据集上执行此操作。这可以通过模糊连接每一列并最终将它们加在一起来解决。但是应该有一种更简单更方便的方法来做到这一点。

我的输出应该是这样的：

df3 <- structure(list(F6_1 = c("Braand1", "Brand2", "Brand3", "Brand4", 
"Brand4", "Brand5", "Brand6", "Brand7", "Brand6", "Brand8"), 
    F6_1_a = c("Brand1", "Brand2", "Brand3", "Brand4", "Brand4", 
    "Brand5", "Brand6", "Brand7", "Brand6", "Brand8"), F6_2 = c("Brand9", 
    NA, "Brand4", "Brando6", "Brand6", "Brand8", "Brannd4", "Brandd8", 
    "Brand6", "Brand6"), F6_2_a = c("Brand9", NA, "Brand4", "Brand6", 
    "Brand6", "Brand8", "Brand4", "Brand8", "Brand6", "Brand6"
    ), F6_3 = c("Brand6", NA, "Brand6", "Brand10", "Brand10", 
    "Brand8", "Brand8", "Brand10", "Brand8", "Brand3"), F6_3_a = c("Brand6", 
    NA, "Brand6", "Brand10", "Brand10", "Brand8", "Brand8", "Brand10", 
    "Brand8", "Brand3"), F6_4 = c(NA, NA, "Brand10", NA, "Brand3", 
    NA, "Brand6", "Brand6", "Bramd3", "BPand3"), F6_4_a = c(NA, 
    NA, "Brand10", NA, "Brand3", NA, "Brand6", "Brand6", "Brand3", 
    "Brand3"), F6_5 = c(NA, NA, NA, NA, "Brand6", NA, "Brand1", 
    "Brand1", NA, "Brand1"), F6_5_a = c(NA, NA, NA, NA, "Brand6", 
    NA, "Brand1", "Brand1", NA, "Brand1"), F6_6 = c(NA, NA, NA, 
    NA, "Brand6", NA, "Brand3", NA, NA, "Brand1"), F6_6_a = c(NA, 
    NA, NA, NA, "Brand6", NA, "Brand3", NA, NA, "Brand1"), F6_7 = c(NA, 
    NA, NA, NA, "Brand1", NA, "Brand1", NA, NA, "Brand1"), F6_7_a = c(NA, 
    NA, NA, NA, "Brand1", NA, "Brand1", NA, NA, "Brand1"), F6_8 = c(NA, 
    NA, NA, NA, "Brand1", NA, NA, NA, NA, "Brand6"), F6_8_a = c(NA, 
    NA, NA, NA, "Brand1", NA, NA, NA, NA, NA), F6_9 = c(NA, NA, 
    NA, NA, "Brrandu3", NA, NA, NA, NA, NA), F6_9_a = c(NA, NA, 
    NA, NA, "Brand3", NA, NA, NA, NA, NA), F6_10 = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA), F6_10_a = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA), F6_11 = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA), F6_11_a = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA), F6_12 = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA), F6_12_a = c(NA, NA, 
    NA, NA, "Brand6", NA, NA, NA, NA, NA)), row.names = c(NA, 
-10L), class = c("tbl_df", "tbl", "data.frame"))

【问题讨论】：

我认为您粘贴了不完整的 dput 预期输出。
从 stringdist-metrics 的帮助中，我了解到 soundex 方法无法区分数字，因此您的 df_joined_F6_1 示例的匹配项比您预期的要多得多，因为 Braand1 与 Brand1 和 Brand2 匹配和 Brand3... 你希望多场比赛发生什么？
是的，这是真的，但匹配的方法不是我的问题的一部分。在原始数据中，品牌名称不包含任何数字。我尝试了包中提供的所有方法，并且使用“soundex”获得了最好的结果。

标签： r fuzzyjoin

【解决方案1】：

这是一种使用 tidyr 使数据更长的方法，然后进行连接，然后再次使其变宽。

df1 %>%
  rowid_to_column() %>%
  pivot_longer(-rowid, "col", values_to =  "brands") %>%
  stringdist_left_join(df2, method = "soundex") %>%

  # just keep first match, since real data won't have multiples
  group_by(rowid, col) %>%
  slice(1) %>%

  # tidying steps to make clean column titles
  rename("orig" = brands.x,
         "a" = brands.y) %>%
  gather(col2, val, c(orig, a)) %>%
  unite(col, c(col,col2))  %>%

  # make data wide again
  pivot_wider(names_from = col, values_from = val)

【讨论】：

谢谢，这很好用。我只需要使用 select() 对最后的列进行排序，就像我的输出表一样。