从芝加哥商品交易所网站抓取数据

Question

我正在尝试从 CME 网站的表格中抓取数据。具体来说，我想提取每种未来货币的未平仓合约数据。但是当我尝试解析表格时，它什么也没给我。

下面给出的链接from which I am trying to scrape the data 是我正在尝试执行的代码。

from bs4 import BeautifulSoup
import requests

url="https://www.cmegroup.com/market-data/volume-open-interest/fx-volume.html"

# Make a GET request to fetch the raw HTML content
html_content = requests.get(url).text

# Parse the html content
soup = BeautifulSoup(html_content)
table = soup.find("table", attrs={"class": "cmeData voiDataset"})
print(table)

Answer 1

表格数据来自另一个您可以使用的 HTML 文档

from bs4 import BeautifulSoup
import requests

url = 'https://www.cmegroup.com/CmeWS/mvc/xsltTransformer.do?xlstDoc=/XSLT/md/voi/voi_asset_class_final.xsl&url=/da/VOI/V2/Totals/TradeDate/20201116/AssetClassId/3/ReportType/F?excluded=CEE,CEU,KCB&hidelinks=false&html='

# Make a GET request to fetch the raw HTML content
html_content = requests.get(url).text

# Parse the html content
soup = BeautifulSoup(html_content)
table = soup.find("table", attrs={"class": "cmeData voiDataset"})
print(table)

要获取特定日期的数据，您可以更改 URL，如下所示

# Date for 2020 November 12
date = '20201112'
url = 'https://www.cmegroup.com/CmeWS/mvc/xsltTransformer.do?xlstDoc=/XSLT/md/voi/voi_asset_class_final.xsl&url=/da/VOI/V2/Totals/TradeDate/{}/AssetClassId/3/ReportType/F?excluded=CEE,CEU,KCB&hidelinks=false&html='.format(date)