【发布时间】:2020-04-10 22:49:42
【问题描述】:
我正在使用已转换为 json 格式的表。目前,格式如下:
[
{
"Reg-Data": [
{
"con_id": 50,
"con_name": "Blueberry",
"fruit_con_id": 60,
"end_date": 1361923200000,
"start_date": 1349049600000,
"fruit_count": 6
},
{
"con_id": 13,
"con_name": "Banana",
"fruit_con_id": 145,
"end_date": 1376352000000,
"start_date": 1376352000000,
"fruit_count": 1
},
{
"con_id": 135,
"con_name": "Watermelon",
"fruit_con_id": 150,
"end_date": 1370649600000,
"start_date": 1370563200000,
"fruit_count": 1
}
],
"crop_number": 1,
"farmer_id": 1
} ]
目标是将 python 中的嵌套 json 扁平化为数据框中的单独列,同时保持一列为 json 格式。
预期结果:
Farmer_id | Crop_number | Crop_info
1 | 1 | {
| | "con_id": 50,
| | "con_name": "Blueberry",
| | "fruit_con_id": 60,
| | "end_date": 1361923200000,
| | "start_date": 1349049600000,
| | "fruit_count": 6
},
{
"con_id": 13,
"con_name": "Banana",
"fruit_con_id": 145,
"end_date": 1376352000000,
"start_date": 1376352000000,
"fruit_count": 1
},
{
"con_id": 135,
"con_name": "Watermelon",
"fruit_con_id": 150,
"end_date": 1370649600000,
"start_date": 1370563200000,
"fruit_count": 1
}
【问题讨论】:
-
你在这里使用 pyspark 吗?您可以发布您已经尝试过的代码吗?