BigQuery - 查找最近的区域

Question

我有两张表，对于 A 中的每个区域，我想找到 B 中最近的区域。

A:
------------------------
ID | Start | End | Color 
------------------------
 1 |  400  | 500 | White
------------------------
 1 |  10   | 20  | Red 
------------------------
 2 |   2   |  10 | Blue 
------------------------
 4 |   88  |  90 | Color 
------------------------

B:
------------------------
ID | Start | End | Name 
------------------------
 1 |  1    | 2   | XYZ1 
------------------------
 1 |  50   | 60  | XYZ4 
------------------------
 2 |  150  | 160 | ABC1 
------------------------
 2 |  50   | 60  | ABC2 
------------------------
 4 |  100  | 120 | EFG 
------------------------

RS:
---------------------------------------
ID | Start | End | Color | Closest Name
---------------------------------------
 1 |  400  | 500 | White |   XYZ4
---------------------------------------
 1 |  10   | 20  | Red   |   XYZ1
---------------------------------------
 2 |   2   |  10 | Blue  |   ABC2
---------------------------------------
 4 |   88  |  90 | Color |   EFG
---------------------------------------

目前，我首先通过连接两个表来找到最小距离：

MinDist 表：

SELECT   A.ID,   A.Start,  A.End,   
MIN(CASE  
WHEN (ABS(A.End-B.Start)>=ABS(A.Start - B.End)) 
THEN ABS(A.Start-B.End)     
ELSE ABS(A.End - B.Start) 
END) AS distance 
FROM ( Select A ... ) 
Join B On A.ID=B.ID) 
Group By A.ID,   A.Start,  A.End

然后通过再次连接表 A 和 B 重新计算距离， GlobDist 表（注意，本例中查询检索 B.Name）：

SELECT   A.ID,   A.Start,  A.End,   
CASE  
WHEN (ABS(A.End-B.Start)>=ABS(A.Start - B.End)) 
THEN ABS(A.Start-B.End)     
ELSE ABS(A.End - B.Start) 
END AS distance,
B.Name 
FROM ( Select A ... ) 
Join B On A.ID=B.ID) 

最后把这两个表MinDist和GlobDist表连接在上

GlobDist.ID= MinDist.ID, 
GlobDist.Start=MinDist.Start, 
GlobDist.End= MinDist.End, 
GlobDist.distance= MinDist.distance.

我在（ID、开始、结束）上测试了 ROW_NUMBER() 和 PARTITION BY，但花费的时间要长得多。那么，解决这个问题的最快和最有效的方法是什么？如何减少重复计算？

谢谢！

Answer 1

以下解决方案适用于 BigQuery 标准 SQL，如下所示简单而简短

#standardSQL
SELECT a_id, a_start, a_end, color,  
  ARRAY_AGG(name ORDER BY POW(ABS(a_start - b_start), 2) + POW(ABS(a_end - b_end), 2) LIMIT 1)[SAFE_OFFSET(0)] name
FROM A JOIN B ON a_id = b_id
GROUP BY a_id, a_start, a_end, color
-- ORDER BY a_id

您可以在问题中使用虚拟数据测试/玩上述内容

#standardSQL
WITH A AS (
  SELECT 1 a_id, 400 a_start, 500 a_end, 'White' color UNION ALL
  SELECT 1, 10,  20  , 'Red' UNION ALL
  SELECT 2, 2,   10, 'Blue' UNION ALL
  SELECT 4, 88,  90, 'Color'
), B AS (
  SELECT 1 b_id, 1 b_start, 2 b_end, 'XYZ1' name UNION ALL
  SELECT 1, 50, 60,  'XYZ4' UNION ALL
  SELECT 2, 150, 160,'ABC1' UNION ALL
  SELECT 2, 50, 60,  'ABC2' UNION ALL
  SELECT 4, 100, 120,'EFG'
)
SELECT a_id, a_start, a_end, color,  
  ARRAY_AGG(name ORDER BY POW(ABS(a_start - b_start), 2) + POW(ABS(a_end - b_end), 2) LIMIT 1)[SAFE_OFFSET(0)] name
FROM A JOIN B ON a_id = b_id
GROUP BY a_id, a_start, a_end, color
ORDER BY a_id  

结果如下

Row a_id    a_start a_end   color   name     
1   1       400     500     White   XYZ4     
2   1       10      20      Red     XYZ1     
3   2       2       10      Blue    ABC2     
4   4       88      90      Color   EFG