解析包含 unicode 字符的 JSON 数据

Question

我有 UTF8 编码 一个 json 文件，其中包含存储在 AWS S3 存储中的 unicode 字符。为了能够从我的 React 项目下载该文件，我创建了 AWS Gateway API 和 Lambda 函数。在项目中，我使用 Axios 库来下载该文件，并且似乎下载正确（我使用 console.log 检查内容）。但是，当我使用 JSON.parse 解析文件时，出现“字符串文字中的控制字符错误”错误。使用 JSON 验证器检查内容返回肯定结果，并且来自 API Gateway 的 http-response 标头已正确设置为“content-type:application/json”和“charset:utf-8”。 JSON.parse 仅在我从文件中删除所有 UTF8 unicode 字符时才有效。当我删除包含 unicode 字符的部分时，我什至不需要使用 JSON 解析。我可以从我的脚本中将它作为对象访问。这是我的json文件的内容

{
  "en": [
    {
      "Question": "Question 1",
      "Choice": [ "Strongly  Agree", "Agree", "Neither Agree Nor Disagree", "Disagree", "Strongly Disagree" ]
    },
    {
      "Question": "Question 2",
      "Choice": [ "Strongly  Agree", "Agree", "Neither Agree Nor Disagree", "Disagree", "Strongly Disagree" ]
    },
    {
      "Question": "Question 3",
      "Choice": [ "Strongly  Agree", "Agree", "Neither Agree Nor Disagree", "Disagree", "Strongly Disagree" ]
    },
    {
      "Question": "Question 4",
      "Choice": [ "Strongly  Agree", "Agree", "Neither Agree Nor Disagree", "Disagree", "Strongly Disagree" ]
    }
  ],
  "fr": [
    {
      "Question": "Question 1",
      "Choice": [ "Tout À Fait d'Accord", "d'Accord", "Ni En Désaccord Ni d'Accord", "Pas d'Accord", "Pas Du Tout d'Accord"]
    },
    {
      "Question": "Question 2",
      "Choice": [ "Tout À Fait d'Accord", "d'Accord", "Ni En Désaccord Ni d'Accord", "Pas d'Accord", "Pas Du Tout d'Accord"]
    },
    {
      "Question": "Question 3",
      "Choice": [ "Tout À Fait d'Accord", "d'Accord", "Ni En Désaccord Ni d'Accord", "Pas d'Accord", "Pas Du Tout d'Accord"]
    },
    {
      "Question": "Question 4",
      "Choice": [ "Tout À Fait d'Accord", "d'Accord", "Ni En Désaccord Ni d'Accord", "Pas d'Accord", "Pas Du Tout d'Accord"]
    }
  ],
  "pt": [
    {
      "Question": "Questão 1",
      "Choice": [ "Concordo Plenamente", "Aceita", "Não Concordo Nem Discordo", "Discordar", "Discordo Fortemente" ]
    },
    {
      "Question": "Questão 2",
      "Choice": [ "Concordo Plenamente", "Aceita", "Não Concordo Nem Discordo", "Discordar", "Discordo Fortemente" ]
    },
    {
      "Question": "Questão 3",
      "Choice": [ "Concordo Plenamente", "Aceita", "Não Concordo Nem Discordo", "Discordar", "Discordo Fortemente" ]
    },
    {
      "Question": "Questão 4",
      "Choice": [ "Concordo Plenamente", "Aceita", "Não Concordo Nem Discordo", "Discordar", "Discordo Fortemente" ]
    }
  ],
  "my": [
    {
      "Question": "မေးခွန်း ၁",
      "Choice": [ "အပြည့်အ၀ထောက်ခံတယ်", "ထောက်ခံတယ်", "ထောက်ခံတယ်လည်းမဟုတ်ဘူး မထောက်ခံတယ်လည်းမဟုတ်ဘူး", "မထောက်ခံဘူး", "အပြည့်အ၀မထောက်ခံဘူး" ]
    },
    {
      "Question": "မေးခွန်း ၂",
      "Choice": [ "Strongly  Disagree", "Somewhat Disagree", "Agree", "Somewhat Agree", "Strongly Agree" ]
    },
    {
      "Question": "မေးခွန်း ၃",
      "Choice": [ "Strongly  Disagree", "Somewhat Disagree", "Agree", "Somewhat Agree", "Strongly Agree" ]
    },
    {
      "Question": "မေးခွန်း ၄",
      "Choice": [ "Strongly  Disagree", "Somewhat Disagree", "Agree", "Somewhat Agree", "Strongly Agree" ]
    }
  ]
}

编辑 这是负责下载和解析该文件的代码：

    let request = {
        host: process.env.AWS_HOST,
        method: 'GET',
        url: process.env.AWS_URL,
        path: process.env.AWS_PATH
    }

    let signedRequest = aws4.sign(request, {
        secretAccessKey: process.env.AWS_SECRET_KEY,
        accessKeyId: process.env.AWS_ACCESS_KEY
     });


    axios(signedRequest)
        .then(response => {

            console.log(response.data); 

            JSON.parse(response.data); // Error!

        })
        .catch((error) => {
            console.log("error",error);
        });

编辑 我更正了标题以反映我要问的问题。

Answer 1

我刚刚发现是我的 lambda 函数导致了这个问题。该函数从 s3 存储桶中读取文件并将数据编码为 ascii，然后作为响应返回。将其修复为 utf-8 可解决此问题。感谢@Tomalak 抽出宝贵时间。

const done = (err, res) => callback(null, {
    statusCode: err ? '400' : '200',
    body: err ? err.message :  res.Body.toString('utf-8'), // <<-- this line 
    headers: {
        'Content-Type': 'application/json',
        'Charset': 'utf-8',
        "'Access-Control-Allow-Methods": "GET, POST, OPTIONS"
    },
});