【问题标题】:Celery status stuck in pending status芹菜状态卡在待处理状态
【发布时间】:2018-04-08 09:44:35
【问题描述】:

我在original code example 找到了一个使用 mongodb 作为后端结果运行 celery 的示例。在他的例子中,他有 CELERYBEAT_SCHEDULE 和一些参数,每分钟运行一次,在我的例子中,我只是注释掉了这段代码。就我而言,我只想在收到任务后立即运行。从工作日志中,我什至看不到任务已收到,并且 result.status 的输出为 PENDING。为什么这停留在待处理状态并且没有完成任务。这是一个简单的添加任务,所以我无法想象它需要很长时间。

另一件事是我有虚拟环境,所以告诉我的是我应该像这样运行 celery “celery multi start worker --loglevel=info

我是芹菜新手,这让我有点困惑。提前感谢您的帮助。

celeryconfig.py 文件

# from celery.schedules import crontab

CELERY_RESULT_BACKEND = "mongodb"
CELERY_MONGODB_BACKEND_SETTINGS = {
    "host": "127.0.0.1",
    "port": 27017,
    "database": "jobs", 
    "taskmeta_collection": "stock_taskmeta_collection",
}

# this was part of the original code but i commented out in hopes 
# it would run the task right away and not delay.
#
#used to schedule tasks periodically and passing optional arguments 
#Can be very useful. Celery does not seem to support scheduled task but only periodic
# CELERYBEAT_SCHEDULE = {
#     'every-minute': {
#         'task': 'tasks.add',
#         'schedule': crontab(minute='*/1'),
#         'args': (1,2),
#     },
# }

tasks.py 文件

from celery import Celery
import time 

#Specify mongodb host and datababse to connect to
BROKER_URL = 'mongodb://localhost:27017/jobs'

celery = Celery('EOD_TASKS',broker=BROKER_URL)

#Loads settings for Backend to store results of jobs 
celery.config_from_object('celeryconfig')

@celery.task
def add(x, y):
    time.sleep(5)
    return x + y



# starting celery
celery multi start worker --loglevel=info
celery multi v4.1.0 (latentcall)
> Starting nodes...
    > worker@lnx-v2: OK

运行 celery 任务

lnx-v2:171> python
Python 3.4.1 (default, Nov 12 2014, 13:34:48) 
[GCC 4.4.6 20120305 (Red Hat 4.4.6-4)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from tasks import add
>>> result = add.delay(1,1)
>>> result
<AsyncResult: 8e6ee263-d8a4-4b17-8d7a-9873b6c98473>
>>> result.status
'PENDING'

工人日志

lnx-v2:208> tail -f worker.log
[2017-10-26 13:41:15,658: INFO/MainProcess] mingle: all alone
[2017-10-26 13:41:15,683: INFO/MainProcess] worker@lnx-v2 ready.
[2017-10-26 13:45:50,465: INFO/MainProcess] Connected to amqp://guest:**@127.0.0.1:5672//
[2017-10-26 13:45:50,487: INFO/MainProcess] mingle: searching for neighbors
[2017-10-26 13:45:51,522: INFO/MainProcess] mingle: all alone
[2017-10-26 13:45:51,540: INFO/MainProcess] worker@lnx-v2 ready.
[2017-10-26 13:47:13,169: INFO/MainProcess] Connected to amqp://guest:**@127.0.0.1:5672//
[2017-10-26 13:47:13,191: INFO/MainProcess] mingle: searching for neighbors
[2017-10-26 13:47:14,228: INFO/MainProcess] mingle: all alone
[2017-10-26 13:47:14,254: INFO/MainProcess] worker@lnx-v2 ready.


# Celery process
lnx-v2:209> ps -ef | grep celery
15096     1  0 13:47 ?        00:00:00 [celeryd: worker@lnx-v2:MainProcess] -active- (worker --loglevel=info --logfile=worker%I.log --pidfile=worker.pid --hostname=worker@lnx-v2)
15157 15096  0 13:47 ?        00:00:00 [celeryd: worker@lnx-v2:ForkPoolWorker-1]

【问题讨论】:

  • 你解决了吗?

标签: celery django-celery celery-task celerybeat celeryd


【解决方案1】:

从下面的代码中查看 celery 任务中是否列出了 add 方法

celery.tasks.keys()

我认为你必须用括号结束装饰器

@celery.task()
def add(x, y):
    time.sleep(5)
    return x + y

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 2020-12-14
    • 2016-12-28
    • 2021-11-18
    • 1970-01-01
    • 1970-01-01
    • 2023-03-27
    相关资源
    最近更新 更多