【发布时间】：2021-07-14 02:23:44
【问题描述】：
我是数据工程的新手，我很难尝试将以下 JSON 展开并转换为 CSV 文件。我曾尝试使用 Pandas、Python、JQ 来做到这一点，但似乎我没有取得任何进展。我尝试了几种解决方案删除它们并重试，但我无法使其工作。我可以得到任何建议吗？我尝试在 pandas 中爆炸数组，但没有成功。
{
"recipes": [
{
"vegetarian": true,
"vegan": true,
"glutenFree": true,
"dairyFree": true,
"veryHealthy": false,
"cheap": false,
"veryPopular": false,
"sustainable": false,
"weightWatcherSmartPoints": 4,
"gaps": "no",
"lowFodmap": false,
"aggregateLikes": 224,
"spoonacularScore": 55.0,
"healthScore": 7.0,
"creditsText": "Full Belly Sisters",
"license": "CC BY-SA 3.0",
"sourceName": "Full Belly Sisters",
"pricePerServing": 138.79,
"extendedIngredients": [
{
"id": 2069,
"aisle": "Oil, Vinegar, Salad Dressing",
"image": "balsamic-vinegar.jpg",
"consistency": "liquid",
"name": "balsamic vinegar",
"nameClean": "balsamic vinegar",
"original": "2T balsamic vinegar",
"originalString": "2T balsamic vinegar",
"originalName": "balsamic vinegar",
"amount": 2.0,
"unit": "T",
"meta": [],
"metaInformation": [],
"measures": {
"us": {
"amount": 2.0,
"unitShort": "Tbsps",
"unitLong": "Tbsps"
},
"metric": {
"amount": 2.0,
"unitShort": "Tbsps",
"unitLong": "Tbsps"
}
}
},
{
"id": 1034053,
"aisle": "Oil, Vinegar, Salad Dressing",
"image": "olive-oil.jpg",
"consistency": "liquid",
"name": "extra virgin olive oil",
"nameClean": "extra virgin olive oil",
"original": "4T extra virgin olive oil",
"originalString": "4T extra virgin olive oil",
"originalName": "extra virgin olive oil",
"amount": 4.0,
"unit": "T",
"meta": [],
"metaInformation": [],
"measures": {
"us": {
"amount": 4.0,
"unitShort": "Tbsps",
"unitLong": "Tbsps"
},
"metric": {
"amount": 4.0,
"unitShort": "Tbsps",
"unitLong": "Tbsps"
}
}
},
{
"id": 2044,
"aisle": "Produce;Spices and Seasonings",
"image": "basil.jpg",
"consistency": "solid",
"name": "fresh basil",
"nameClean": "basil",
"original": "1/4c chopped fresh basil",
"originalString": "1/4c chopped fresh basil",
"originalName": "chopped fresh basil",
"amount": 0.25,
"unit": "c",
"meta": [
"fresh",
"chopped"
],
"metaInformation": [
"fresh",
"chopped"
],
"measures": {
"us": {
"amount": 0.25,
"unitShort": "cups",
"unitLong": "cups"
},
"metric": {
"amount": 59.147,
"unitShort": "ml",
"unitLong": "milliliters"
}
}
},
{
"id": 11215,
"aisle": "Produce",
"image": "garlic.png",
"consistency": "solid",
"name": "garlic",
"nameClean": "garlic",
"original": "3 cloves garlic",
"originalString": "3 cloves garlic",
"originalName": "garlic",
"amount": 3.0,
"unit": "cloves",
"meta": [],
"metaInformation": [],
"measures": {
"us": {
"amount": 3.0,
"unitShort": "cloves",
"unitLong": "cloves"
},
"metric": {
"amount": 3.0,
"unitShort": "cloves",
"unitLong": "cloves"
}
}
},
{
"id": 10111529,
"aisle": "Produce",
"image": "cherry-tomatoes.png",
"consistency": "solid",
"name": "grape tomatoes",
"nameClean": "grape tomato",
"original": "2-3 cups grape tomatoes, halved",
"originalString": "2-3 cups grape tomatoes, halved",
"originalName": "grape tomatoes, halved",
"amount": 2.0,
"unit": "cups",
"meta": [
"halved"
],
"metaInformation": [
"halved"
],
"measures": {
"us": {
"amount": 2.0,
"unitShort": "cups",
"unitLong": "cups"
},
"metric": {
"amount": 473.176,
"unitShort": "ml",
"unitLong": "milliliters"
}
}
},
{
"id": 11282,
"aisle": "Produce",
"image": "brown-onion.png",
"consistency": "solid",
"name": "onion",
"nameClean": "onion",
"original": "1/2 onion, sliced",
"originalString": "1/2 onion, sliced",
"originalName": "onion, sliced",
"amount": 0.5,
"unit": "",
"meta": [
"sliced"
],
"metaInformation": [
"sliced"
],
"measures": {
"us": {
"amount": 0.5,
"unitShort": "",
"unitLong": ""
},
"metric": {
"amount": 0.5,
"unitShort": "",
"unitLong": ""
}
}
},
{
"id": 1032009,
"aisle": "Spices and Seasonings",
"image": "red-pepper-flakes.jpg",
"consistency": "solid",
"name": "red pepper flakes",
"nameClean": "red pepper flakes",
"original": "couple of pinches of red pepper flakes",
"originalString": "couple of pinches of red pepper flakes",
"originalName": "couple of of red pepper flakes",
"amount": 2.0,
"unit": "pinches",
"meta": [
"red"
],
"metaInformation": [
"red"
],
"measures": {
"us": {
"amount": 2.0,
"unitShort": "pinches",
"unitLong": "pinches"
},
"metric": {
"amount": 2.0,
"unitShort": "pinches",
"unitLong": "pinches"
}
}
},
{
"id": 1102047,
"aisle": "Spices and Seasonings",
"image": "salt-and-pepper.jpg",
"consistency": "solid",
"name": "salt and pepper",
"nameClean": "salt and pepper",
"original": "salt and freshly-ground pepper, to taste",
"originalString": "salt and freshly-ground pepper, to taste",
"originalName": "salt and freshly-ground pepper, to taste",
"amount": 4.0,
"unit": "servings",
"meta": [
"freshly-ground",
"to taste"
],
"metaInformation": [
"freshly-ground",
"to taste"
],
"measures": {
"us": {
"amount": 4.0,
"unitShort": "servings",
"unitLong": "servings"
},
"metric": {
"amount": 4.0,
"unitShort": "servings",
"unitLong": "servings"
}
}
}
],
"id": 716413,
"title": "Oven Roasted Tomato Sauce",
"readyInMinutes": 45,
"servings": 4,
"sourceUrl": "http://fullbellysisters.blogspot.com/2011/10/oven-roasted-tomato-sauce.html",
"image": "https://spoonacular.com/recipeImages/716413-556x370.jpg",
"imageType": "jpg",
"summary": "Oven Roasted Tomato Sauce might be just the sauce you are searching for. Watching your figure? This caveman, gluten free, primal, and whole 30 recipe has <b>155 calories</b>, <b>1g of protein</b>, and <b>14g of fat</b> per serving. For <b>$1.41 per serving</b>, this recipe <b>covers 5%</b> of your daily requirements of vitamins and minerals. Plenty of people made this recipe, and 224 would say it hit the spot. Head to the store and pick up balsamic vinegar, garlic, grape tomatoes, and a few other things to make it today. From preparation to the plate, this recipe takes approximately <b>45 minutes</b>. All things considered, we decided this recipe <b>deserves a spoonacular score of 61%</b>. This score is pretty good. Try <a href=\"https://spoonacular.com/recipes/oven-roasted-tomato-sauce-617765\">Oven Roasted Tomato Sauce</a>, <a href=\"https://spoonacular.com/recipes/chicken-parmesan-with-oven-roasted-tomato-sauce-360158\">Chicken Parmesan with Oven-Roasted Tomato Sauce</a>, and <a href=\"https://spoonacular.com/recipes/oven-roasted-tomato-basil-marinara-sauce-800148\">Oven-Roasted Tomato Basil Marinara Sauce</a> for similar recipes.",
"cuisines": [],
"dishTypes": [
"sauce"
],
"diets": [
"gluten free",
"dairy free",
"paleolithic",
"lacto ovo vegetarian",
"primal",
"vegan"
],
"occasions": [],
"instructions": "",
"analyzedInstructions": [],
"originalId": null,
"spoonacularSourceUrl": "https://spoonacular.com/oven-roasted-tomato-sauce-716413"
}
]
}
我试过这段代码：
d.apply(lambda x: x.explode() if x.name in ['cuisines' 'dishTypes', 'diets', 'occasions','analyzedInstructions'] else x)
数据来自 Spoonacular API：
import json
import pandas as pd
import requests # get connection
import json
from pandas.io.json import json_normalize #package for flattening json in pandas df
YOUR_API_KEY='XXXXXXX'
base_url = 'https://api.spoonacular.com/recipes/random?limitLicense=false&tags=vegan&number=1&apiKey='+YOUR_API_KEY
json_text = requests.get(base_url).json()
json_text = json.loads(raw)
json_text = json_normalize(json_text['recipes'])
json_text.head(3)
我期待一个可以转换为 CSV 的 JSON：
并获得以下标题：
"vegetarian"
"vegan"
"glutenFree"
"dairyFree"
"veryHealthy"
"cheap"
"veryPopular"
"sustainable"
"weightWatcherSmartPoints"
"gaps"
"lowFodmap"
"aggregateLikes"
"spoonacularScore"
"healthScore"
"pricePerServing"
"extendedIngredients"
"id"
"image"
"name"
"original"
"amount"
"unit"
"measures"
"metric"
"amount"
"unitShort"
"unitLong"
"id"
"title":
"readyInMinutes"
"servings"
"sourceUrl"
"image"
"summary"
"cuisines"
"dishTypes"
"diets"
"occasions"
"instructions"
"analyzedInstructions":
"name"
"steps"
"number"
"step"
感谢我能得到的任何帮助
【问题讨论】：
-
会很好地解释你在 "flatten" 下是什么意思并添加输出样本。
-
是的，抱歉，我用更多细节更新了我的问题@OlvinRoght
-
您的预期输出仍不清楚。在链接的 CSV 中，您仅包含未嵌套的数据。如果这就是您要寻找的，那么您根本不需要“扁平化”。
-
假设您确实想获得其中一些嵌套值，您希望如何接收这些信息？例如，“extendedIngredients”中有 7 个项目，每个项目有 19 个元素。您是否希望 7 行具有其他列的重复值，或者您是否希望添加 133 个新列以展平为单行？请包含其中 1 个配方的完整示例输出，或指定您希望保留哪些键。
-
嗨@HenryEcker 我已经更新了信息，JSON 只包含一个配方所以是巨大的
标签： python json pandas export-to-csv jq