【发布时间】:2016-05-11 14:27:28
【问题描述】:
我正在尝试创建一个执行以下操作的 python 脚本:
- 解析 CSV 文件
- 通过 REST API 将 CSV 文件发送到远程服务器
我的代码正在解析 CSV 文件并将其转换为 JSON 对象。
但是,当它导入到远程服务器时,只写入第一行。
问题:我是否需要循环并为每一行发送一个单独的 http 请求?我觉得那样太麻烦了。我的 CSV 文件有超过 10,000 行,这将在每日 cron 上运行。
问题:如何将其设置为在单个请求中导入所有行?
#Requests package for python import requests
import csv
import json
import requests
#Parse CSV file and convert to JSON
f = open('example_import_csv.csv', 'rU')
reader = csv.DictReader(f, fieldnames = ("u_date","u_product","u_serial_number"))
out = json.dumps([row for row in reader])
#Print output confirms that the JSON is formatted properly
print(">JSON" , out)
#Set request parameters
url = 'xxxxx'
user = 'xxxxxx'
pwd = 'xxxxxx'
#Set proper headers
headers = {"Content-Type":"application/json","Accept":"application/json"}
#data=out contains the JSON object
#Problem is only the first row is imported
response = requests.post(url, auth=(user, pwd), headers=headers ,data=out)
#Check for HTTP codes other than 200
if response.status_code != 200:
print('Status:', response.status_code, 'Headers:', response.headers)
exit()
#Decode the JSON response into a dictionary and use the data
print('Status:',response.status_code,'Headers:',response.headers,'Response:',response.json())
### OUTPUT
# >JSON [{"u_serial_number": "11", "u_product": "Apples", "u_date": "1/12/15"}, {"u_serial_number": "12", "u_product": "Pears", "u_date": "1/29/15"}, {"u_serial_number": "13", "u_product": "Oranges", "u_date": "1/12/15"}, {"u_serial_number": "14", "u_product": "Blackberries", "u_date": "1/29/15"}, {"u_serial_number": "15", "u_product": "Blueberries", "u_date": "2/5/15"}, {"u_serial_number": "16", "u_product": "Bananas", "u_date": "2/7/15"}, {"u_serial_number": "17", "u_product": "Strawberries", "u_date": "2/7/15"}]
# Status: 201 Headers: {'Content-Encoding': 'gzip', 'Transfer-Encoding': 'chunked', 'Content-Type': 'application/json'}
编辑:我将数据发送到我们的 ServiceNow 实例。这是一篇描述 python 脚本模板的 wiki 文章。
http://wiki.servicenow.com/index.php?title=Table_API_Python_Examples#gsc.tab=0
这是我用作模板的基本代码块。请注意,这适用于示例中的单行数据,但在导入多行数据时不起作用。
#Need to install requests package for python
#sudo easy_install requests
import requests
# Set the request parameters
url = 'https://myinstance.service-now.com/api/now/table/incident'
user = 'xxxxxxx'
pwd = 'xxxxxxx'
# Set proper headers
headers = {"Content-Type":"application/json","Accept":"application/json"}
# Do the HTTP request
response = requests.post(url, auth=(user, pwd), headers=headers ,data='{"short_description":"Test"}')
# Check for HTTP codes other than 200
if response.status_code != 201:
print('Status:', response.status_code, 'Headers:', response.headers, 'Error Response:',response.json())
exit()
【问题讨论】:
-
问题出在远程服务器上正在处理的帖子上吗?
-
谢谢丹尼尔。我认为你在这里有所作为。我使用 ServiceNow 中的 REST API Explorer(用于生成请求的图形 UI)对此进行了测试。果然,只有一条记录通过了。我认为 ServiceNow 可能存在一个限制,即每个请求只能接受一条记录。我将在供应商特定部分发布。