从 Lambda 函数或 Sagemaker 生命周期配置运行 .ipynb 文件答案

【问题标题】：Running an .ipynb file from Lambda function or Sagemaker Lifecycle Config从 Lambda 函数或 Sagemaker 生命周期配置运行 .ipynb 文件
【发布时间】：2019-02-16 15:15:38
【问题描述】：

启动 Sagemaker 实例时的 ipynb 文件。目前的状态是： Cloudwatch（成功）-> Lambda（成功）-> Sagemaker 实例（成功）-> 运行特定笔记本（失败）

1.我尝试在代码中使用“Sagemaker Lifecycle”配置

jupyter nbconvert --execute prediction-12hr.ipynb --ExecutePreprocessor.kernel_name=conda_tensorflow_p36

但出现错误

[NbConvertApp] Converting notebook prediction-12hr.ipynb to html [NbConvertApp] Executing notebook with kernel: conda_tensorflow_p36
...
raise NoSuchKernel(kernel_name) jupyter_client.kernelspec.NoSuchKernel: No such kernel named conda_tensorflow_p36

正在运行

`!conda env list'
conda environments:

base * /home/ec2-user/anaconda3
JupyterSystemEnv /home/ec2-user/anaconda3/envs/JupyterSystemEnv
chainer_p27 /home/ec2-user/anaconda3/envs/chainer_p27
chainer_p36 /home/ec2-user/anaconda3/envs/chainer_p36
mxnet_p27 /home/ec2-user/anaconda3/envs/mxnet_p27
mxnet_p36 /home/ec2-user/anaconda3/envs/mxnet_p36
python2 /home/ec2-user/anaconda3/envs/python2
python3 /home/ec2-user/anaconda3/envs/python3
pytorch_p27 /home/ec2-user/anaconda3/envs/pytorch_p27
pytorch_p36 /home/ec2-user/anaconda3/envs/pytorch_p36
tensorflow_p27 /home/ec2-user/anaconda3/envs/tensorflow_p27
tensorflow_p36 /home/ec2-user/anaconda3/envs/tensorflow_p36

Also tried injecting a python/bash code to run the instance startup, pausing the start-up code to wait untill conda instance is setup by sagemaker.
Still no luck

有人可以建议一个计划以无论如何运行 .ipynb 文件。

【问题讨论】：

标签： jupyter-notebook amazon-sagemaker

【解决方案1】：

尝试激活笔记本所依赖的相关 Python virtualenv。

source /home/ec2-user/anaconda3/envs/tensorflow_p36/bin/activate
jupyter nbconvert --execute ...

了解更多How to activate virtualenv?

【讨论】：

/home/ec2-user/anaconda3/envs/tensorflow_p36/bin/activate：没有这样的文件或目录 /home/ec2-user/SageMaker/start_script.sh：第 9 行：源：激活：找不到文件

【解决方案2】：

您可以尝试激活 tensorflow_p36 环境并在该环境中执行笔记本文件吗？这样您就不必指定内核。

source activate tensorflow_p36
jupyter nbconvert --execute prediction-12hr.ipynb

【讨论】：