如何更快地从 API 获得回报？我需要尽快从 400 多个 API 端点获得回报

Question

我正在尝试从 Premiere League 获取每位球员的统计数据，但是，每位球员都有不同的 API 端点，我需要获取超过 470 名球员的信息。反正有没有让这更快？最好只有几秒钟。

import requests

response1 = requests.get("https://fantasy.premierleague.com/api/bootstrap-static/")
json_general = response1.json()

def get_json_element(element_id):
    response = requests.get("https://fantasy.premierleague.com/api/element-summary/" + str(element_id) + "/")
    return response.json()

def get_fdr(element_id):
    element_id = 1
    points_sum = 0
    fixtures_remaining = len(get_json_element(element_id)["fixtures"])
    ratio = []

    for i in range(fixtures_remaining):
        ratio.append(2 ** i)

    points = 1000 / sum(ratio)

    for i in range(fixtures_remaining):
        output = ((5 - (get_json_element(element_id)["fixtures"][i]["difficulty"])) * (points * ratio[(len(ratio) - 1 - i)] / 5))
        points_sum = points_sum + output
    return points_sum

fdr_dict = {}

for i in range(len(json_general["elements"])):
    fdr_dict.update({json_general["elements"][i]["id"]: get_fdr(json_general["elements"][i]["id"])})

for key, value in fdr_dict.items():
    print(value, key)

尝试2：

导入请求 导入 aiohttp 导入异步

response1 = requests.get("https://fantasy.premierleague.com/api/bootstrap-static/")
json_general = response1.json()


def id_list():
    id_list = []
    for i in range(len(json_general["elements"])):
        id_list.append(json_general["elements"][i]["id"])
    return id_list


async def main():
    async with aiohttp.ClientSession() as session:
        tasks = []
        for element_id in id_list():
            task = asyncio.ensure_future(get_json_element(session, element_id))
            tasks.append(task)

        fdr_list = await asyncio.gather(*tasks)

    print(dict(fdr_list))


async def get_json_element(session, element_id):
    url = "https://fantasy.premierleague.com/api/element-summary/" + str(element_id) + "/"

    async with session.get(url) as response:
        json_element = await response.json()
        fixtures = json_element["fixtures"]
        return element_id, fixtures

asyncio.run(main())

Answer 1

通过使用单个 session object 来重用 http 连接。

否则，瓶颈可能是 API，所以除了检查它们是否为您的用例提供批量/批量之外，您在客户端无能为力。