【发布时间】:2022-08-26 13:31:18
【问题描述】:
我正在学习关于 udemy 的 azure ml 课程,但无法解决以下错误:
数据集的操作“to_pandas_dataframe”执行失败(id='id',name='Loan Applications Using SDK',版本=1,error_code=None,exception_type=PandasImportError)
这是提交脚本的代码:
from azureml.core import Workspace, Experiment, ScriptRunConfig,
Environment
ws = Workspace.from_config(path="./config")
new_experiment = Experiment(workspace=ws,
name="Loan_Script")
script_config = ScriptRunConfig(source_directory=".",
script="180 - Script to Run.py")
script_config.framework = "python"
script_config.environment = Environment("conda_env")
new_run = new_experiment.submit(config=script_config)
这是正在运行的脚本:
from azureml.core import Workspace, Datastore, Dataset,
Experiment
from azureml.core import Run
ws = Workspace.from_config(path="./config")
az_store = Datastore.get(ws, "bencouser_sdk_blob01")
az_dataset = Dataset.get_by_name(ws, name='Loan Applications Using SDK')
az_default_store = ws.get_default_datastore()
#%%----------------------------------------------------
# Get context of the run
#------------------------------------------------------
new_run = Run.get_context()
#%%----------------------------------------------------
# Stuff that will be logged
#------------------------------------------------------
df = az_dataset.to_pandas_dataframe()
total_observations = len(df)
nulldf = df.isnull().sum()
#%%----------------------------------------------------
# Complete the Experiment
#------------------------------------------------------
new_run.log("Total Observations:", total_observations)
for columns in df.columns:
new_run.log(columns, nulldf[columns])
new_run.complete()
我已经在实验之外运行了 .to_pandas_dataframe() 部分,它没有错误地工作。我还尝试了以下方法(在驱动程序日志中推荐):
InnerException 无法导入熊猫。通过运行确保安装了兼容版本: pip install azureml-dataprep[pandas]
我以前见过人们遇到过这种情况,但我找不到解决方案,不胜感激。
【问题讨论】:
-
感谢 Freddy 的提示,刚刚将其添加为代码,希望这对您更有帮助
-
谢谢 Ben,它只是让重现问题变得更容易
标签: python pandas azure machine-learning azure-machine-learning-service