【发布时间】:2020-01-31 03:33:34
【问题描述】:
Gevent 似乎在当前未访问网络的 greenlet 中引发与网络相关的错误。这是一个示例回溯,为简洁起见省略了一些细节:
Traceback (most recent call last):
...
File ".../asyncforms.py", line 95, in _try_to_process_form
self.pool.spawn(self._async_migrate_form, wrapped_form, case_ids)
File ".../lib/python3.6/site-packages/gevent/pool.py", line 391, in spawn
self.start(greenlet)
File ".../lib/python3.6/site-packages/gevent/pool.py", line 601, in start
self.add(greenlet, *args, **kwargs)
File ".../lib/python3.6/site-packages/gevent/pool.py", line 634, in add
if not self._semaphore.acquire(blocking=blocking, timeout=timeout):
File "src/gevent/_semaphore.py", line 100, in gevent.__semaphore.Semaphore.acquire
File "src/gevent/_semaphore.py", line 128, in gevent.__semaphore.Semaphore.acquire
File "src/gevent/_abstract_linkable.py", line 192, in gevent.__abstract_linkable.AbstractLinkable._wait
File "src/gevent/_abstract_linkable.py", line 165, in gevent.__abstract_linkable.AbstractLinkable._wait_core
File "src/gevent/_abstract_linkable.py", line 169, in gevent.__abstract_linkable.AbstractLinkable._wait_core
File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
File "src/gevent/_greenlet_primitives.py", line 64, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
File "src/gevent/__greenlet_primitives.pxd", line 35, in gevent.__greenlet_primitives._greenlet_switch
socket.gaierror: [Errno -9] Address family for hostname not supported
如您所见,当前线程是gevent.pool.Pool 中的spawning a new greenlet,据我所知,它不应该进入网络。我的意思是生成greenlet的行为不应该影响网络,虽然最终将在那个greenlet中运行的功能可能会影响网络,但我认为我不需要担心这一点在这里,因为在回溯中没有证据。
为什么 gevent 会在代码的这个位置引发这个看似无关的网络错误?我怀疑错误来自另一个正在访问网络的greenlet。有没有办法获取此错误的真实回溯上下文?
不确定以下是否相关,但与上下文有关:
在启动时,该进程会修补一些东西。这个有点简化(实际代码here):
from gevent import monkey
from psycogreen.gevent import patch_psycopg
monkey.patch_all(subprocess=True)
patch_psycopg()
编辑:a bit later 它设置gevent.get_hub().SYSTEM_ERROR = BaseException 使程序在任何greenlet 崩溃时立即退出。也许这还有其他意想不到的副作用,例如这些令人困惑的回溯?
系统和库版本:
- Linux djangomanage1-production 4.15.0-1041-aws #43-Ubuntu SMP Thu Jun 6 13:39:11 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
- Python 3.6.8
- gevent 1.4.0
- greenlet 0.4.15
【问题讨论】: