无法使用 streamParse “thriftpy.thrift.TApplicationException：内部错误处理 beginFileUpload”提交拓扑答案

【问题标题】：Unable to submit Topology using streamParse "thriftpy.thrift.TApplicationException: Internal error processing beginFileUpload"无法使用 streamParse “thriftpy.thrift.TApplicationException：内部错误处理 beginFileUpload”提交拓扑
【发布时间】：2019-08-21 18:33:35
【问题描述】：

我正在尝试使用

向远程 ubuntu 机器提交拓扑

sparse submit 命令

并得到以下错误

  File "...../bin/sparse", line 11, in <module>
    load_entry_point('streamparse==4.0.0', 'console_scripts', 'sparse')()
  File ".../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/sparse.py", line 85, in main
    args.func(args)
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 391, in main
    active=args.active,
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 295, in submit_topology
    remote_jar_path = _upload_jar(nimbus_client, local_jar_path)
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 158, in _upload_jar
    upload_location = nimbus_client.beginFileUpload()
  File "../lib/python3.6/site-packages/thriftpy-0.3.9-py3.6-macosx-10.9-x86_64.egg/thriftpy/thrift.py", line 198, in _req
    return self._recv(_api)
  File "../lib/python3.6/site-packages/thriftpy-0.3.9-py3.6-macosx-10.9-x86_64.egg/thriftpy/thrift.py", line 215, in _recv
    raise x
thriftpy.thrift.TApplicationException: Internal error processing beginFileUpload

我也尝试过授予远程机器上安装的storm的root访问权限

这是我的配置

{
    "serializer": "json",
    "topology_specs": "topologies/",
    "virtualenv_specs": "virtualenvs/",
    "envs": {
        "prod": {
            "user": "abc",
            "ssh_password": "abc",
            "nimbus": "ip.ip.ip.ip",
            "workers": ["ip.ip.ip.ip"],
            "log": {
                "path": "",
                "max_bytes": 1000000,
                "backup_count": 10,
                "level": "debug"
            },
            "options": {
                "virtualenv_flags": "-p /usr/bin/python3.6",
                "supervisor.worker.timeout.secs" : 1800

            },
            "virtualenv_root": "/home/abc/virtualenvs",
            "use_ssh_for_nimbus": true

            }
        }
}

【问题讨论】：

标签： python apache-storm

【解决方案1】：

这里的问题是要提交拓扑的 ip 是非领导主管。 Storm只接受Leader Supervisor节点上的拓扑提交

【讨论】：

领导不是主管
在所有的supervisor中，选出一个为leader，提交topology的必须是那个node，streamparse内部不识别