【问题标题】:Load JSON file to Elasticsearch将 JSON 文件加载到 Elasticsearch
【发布时间】:2021-11-22 22:03:11
【问题描述】:

我有一个 json 文件,我想将它们加载到 elasticsearch,我尝试了几种方法但都没有成功,你能帮帮我吗?

【问题讨论】:

  • 请用您已经尝试过的内容更新您的帖子

标签: json elasticsearch


【解决方案1】:

如果你使用 Python 编程可以试试我的方法https://github.com/trannguyenhan/tiki-data-analysis/blob/master/load_json_to_elasticsearch.ipynb

pip install Elasticsearch

import requests, json, os
from elasticsearch import Elasticsearch

directory = '/home/trannguyenhan/json-tiki-data'
res = requests.get('http://localhost:9200')
print (res.content)
es = Elasticsearch([{'host': 'localhost', 'port': '9200'}])


for filename in os.listdir(directory):
    if filename.endswith(".json"):
        f = open(directory + "/" + filename)
        list_data = f.read().replace("}\n", "}||").split("||")
        
        # Send the data into es
        for data in list_data : 
            if "{" in data and "}" in data or data != "":
                try : 
                    es.index(index='tiki-data-json', ignore=400, doc_type='data', id=i, body=json.loads(data))
                except: 
                    continue
                i = i + 1

参考:https://github.com/trannguyenhan

【讨论】:

    猜你喜欢
    • 2016-12-01
    • 2016-12-10
    • 2020-12-06
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2021-10-17
    相关资源
    最近更新 更多