如果同一组给出相同的号码

Question

我有这样的数据框 名称状态

+----+------+                      
|name|value |                                                  
+----+------+                                   
|  x |  down|                                             
|  y |normal|                               
|  z |  down|                                                
|  x |normal|                                  
|  y |  down|                       
+----+------+ 

如果名称相同，我想像这样输入数字 1,2,3，新列必须是这样的

+----+------+------+   
|name|value |newCol|   
+----+------+------+   
|   x|down  |     1|   
|   y|normal|     2|   
|   z|down  |     3|   
|   x|normal|     1|    
|   y|down  |     2|   
+----+------+------+

win = Window.partitionBy("name").orderBy("name")
print("value")
dp_df_classification_agg_join = dp_df_classification_agg_join.withColumn("newCol",count("name").over(win))

Answer 1

首先，将count("name") 函数替换为dense_rank() 函数。

然后，将 win = Window.partitionBy("name").orderBy("name") 替换为 win = Window.partitionBy().orderBy("name")