【问题标题】:Why logstash-forwarder is not sending more than 100 events per lumberjack request?为什么 logstash-forwarder 每个伐木工人请求发送的事件不超过 100 个?
【发布时间】:2015-01-23 11:34:14
【问题描述】:

我已经看到是 flush_size 控制在伐木工人(logstash-forwarder)中每个请求发送的事件,但我已将其设置为 150 默认值,如下所示

config :flush_size, :validate => :number, :default => 150

文件:/opt/logstash/lib/logstash/outputs/elasticsearch_http.rb

但我仍然没有看到伐木工人每个请求发送超过 100 个事件。

Jan 23 16:59:01 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:01.496540 Connecting to [127.0.0.1]:5000 (127.0.0.1) 
Jan 23 16:59:01 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:01.828968 Connected to 127.0.0.1
Jan 23 16:59:08 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:08.146238 Registrar received 100 events
Jan 23 16:59:13 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:13.500840 Registrar received 100 events
Jan 23 16:59:16 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:16.938172 Registrar received 100 events
Jan 23 16:59:18 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:18.330341 Registrar received 100 events
Jan 23 16:59:19 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:19.347694 Registrar received 100 events
Jan 23 16:59:20 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:20.341879 Registrar received 100 events
Jan 23 16:59:21 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:21.339127 Registrar received 100 events
Jan 23 16:59:23 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:23.060140 Registrar received 100 events
Jan 23 16:59:24 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:24.680771 Registrar received 100 events
Jan 23 16:59:26 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:26.196146 Registrar received 100 events
Jan 23 16:59:27 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:27.043658 Registrar received 100 events
Jan 23 16:59:28 197nodnb13846 logstash-forwarder[30342]: 2015/01/23 16:59:28.203279 Registrar received 100 events

在此之后我已经重新启动了 logstash 和 logstash-forwarder,但它仍然无法正常工作。

【问题讨论】:

  • /opt/logstash/lib/logstash/outputs/elasticsearch_http.rb 是 Logstash 的 Elasticsearch 客户端库,但 logstash-forwarder 日志是针对 logstash-forwarder 的。你在比较苹果和橘子。

标签: elasticsearch logstash kibana logstash-forwarder


【解决方案1】:

编辑初始化脚本并更改-spool-size的值:

grep DAEMON_ARGS /etc/init.d/logstash-forwarder

DAEMON_ARGS="-config /etc/logstash-forwarder -spool-size 100 -log-to-syslog"

/etc/init.d/logstash-forwarder 重启

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 2015-10-02
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2017-10-25
    相关资源
    最近更新 更多