【发布时间】:2017-07-10 15:13:24
【问题描述】:
我正在处理一个令人沮丧的错误 - 有时 sidekiq 不会开始处理作业。这是令人讨厌的断断续续的。
当它发生时,sidekiq.log 没有显示任何变化(并且它正在运行)。队列大小保持为 0。我猜它在 Redis 中丢失了。
万一这很重要,我已经在同一台机器上运行了同一个应用程序的三个环境(不同的环境),我刚刚放入(但问题在它们之前)。默认端口上只运行一个 Redis。
我知道redis-cli MONITOR,但它吐出的东西太快了,而且内容太多,我很难弄清楚发生了什么。
1491479154.190069 [0 127.0.0.1:38763] "brpop" "queue:default" "2"
1491479154.289507 [0 127.0.0.1:38753] "brpop" "queue:default" "2"
1491479154.289544 [0 127.0.0.1:38752] "brpop" "queue:default" "2"
/// snip... many lines of these
1491479154.364985 [0 127.0.0.1:38772] "multi"
1491479154.365090 [0 127.0.0.1:38772] "incrby" "stat:processed" "0"
1491479154.365107 [0 127.0.0.1:38772] "incrby" "stat:processed:2017-04-06" "0"
1491479154.365128 [0 127.0.0.1:38772] "incrby" "stat:failed" "0"
1491479154.365133 [0 127.0.0.1:38772] "incrby" "stat:failed:2017-04-06" "0"
1491479154.365139 [0 127.0.0.1:38772] "del" "server.name:32533:6befea0f66c0:workers"
1491479154.365149 [0 127.0.0.1:38772] "expire" "server.name:32533:6befea0f66c0:workers" "60"
1491479154.365160 [0 127.0.0.1:38772] "exec"
1491479154.365896 [0 127.0.0.1:38772] "multi"
1491479154.365962 [0 127.0.0.1:38772] "sadd" "processes" "server.name:32533:6befea0f66c0"
1491479154.365977 [0 127.0.0.1:38772] "exists" "server.name:32533:6befea0f66c0"
1491479154.365987 [0 127.0.0.1:38772] "hmset" "server.name:32533:6befea0f66c0" "info" "{\"hostname\":\"server.name\",\"started_at\":1491373877.8700902,\"pid\":2217,\"tag\":\"demo\",\"concurrency\":25,\"queues\":[\"default\"],\"labels\":[],\"identity\":\"server.name:32533:6befea0f66c0\"}" "busy" "0" "beat" "1491479154.3655496" "quiet" "false"
1491479154.366035 [0 127.0.0.1:38772] "expire" "server.name:32533:6befea0f66c0" "60"
1491479154.366046 [0 127.0.0.1:38772] "rpop" "server.name:32533:6befea0f66c0-signals"
1491479154.366058 [0 127.0.0.1:38772] "exec"
1491479154.389484 [0 127.0.0.1:38751] "brpop" "queue:default" "2"
如何调试 Redis 和 Sidekiq 来解决这个问题?我想用grep 进行管道传输,但我无法在redis-cli 交互式shell 中执行此操作...
想法?
【问题讨论】:
-
看来是内存问题!!不回答,因为它感觉不像是“答案”,更像是“线索”。很想知道当内存不足时,是否有其他人看到 Sidekiq/Redis 以这种方式(默默地)失败。
标签: ruby-on-rails redis sidekiq