【问题标题】:Logstash: Value too large to outputLogstash:值太大而无法输出
【发布时间】:2016-11-15 19:54:54
【问题描述】:

最近使用版本 5.0.0-1 构建的 ELK 堆栈

使用 1 个多行过滤器处理 jboss 日志时,我看到以下错误:

[2016-11-14T19:48:48,802][ERROR][logstash.filters.grok    ] Error while attempting to check/cancel excessively long grok patterns {:message=>"Mutex relocking by same thread", :class=>"ThreadError", :backtrace=>["org/jruby/ext/thread/Mutex.java:90:in `lock'", "org/jruby/ext/thread/Mutex.java:147:in `synchronize'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-3.2.3/lib/logstash/filters/grok/timeout_enforcer.rb:38:in `stop_thread_groking'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-3.2.3/lib/logstash/filters/grok/timeout_enforcer.rb:53:in `cancel_timed_out!'", "org/jruby/RubyHash.java:1342:in `each'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-3.2.3/lib/logstash/filters/grok/timeout_enforcer.rb:45:in `cancel_timed_out!'", "org/jruby/ext/thread/Mutex.java:149:in `synchronize'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-3.2.3/lib/logstash/filters/grok/timeout_enforcer.rb:44:in `cancel_timed_out!'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-3.2.3/lib/logstash/filters/grok/timeout_enforcer.rb:63:in `start!'"]}
[2016-11-14T19:48:48,802][WARN ][logstash.filters.grok    ] Timeout executing grok '%{DATA:prefixofMessage}<tXML>%{DATA:orderXML}</tXML>' against field 'message' with value 'Value too large to output (27191 bytes)! First 255 chars are: 2016-10-30 23:28:02,193 INFO  [nucleusNamespace.com.NAMESPACEREDACTED.NAMESPACEREDACTED.NAMESPACEREDACTED] (ajp-IPADDRESSREDACTED-PORTREDACTED-325) DEBUG  NAMEREDACTED | order xml ----------- <?xml version="1.0" encoding="UTF-8" standalone="yes"?>

同样的过滤器在 2.4 上工作得很好,但现在在 5.0.0-1 上运行同样的过滤器我看到了。

有人在这个版本的 ELK 堆栈中看到过这个吗?

【问题讨论】:

标签: elasticsearch jboss logstash elastic-stack logstash-grok


【解决方案1】:

这已在 https://github.com/logstash-plugins/logstash-filter-grok/pull/98 中修复。可以现在升级插件,也可以等 Logstash 5.0.1

【讨论】:

  • 我正在使用 Logstash 5.0.1 并且仍然收到 grok timeout / value too large 错误。
  • @ZianyD 这可能是因为您的正则表达式错误。这个错误应该发生在 ReDoS 正则表达式中。在上面的案例中,这是一个实际的错误,但您没有提供足够的上下文来确定这一点。
猜你喜欢
  • 1970-01-01
  • 1970-01-01
  • 2011-09-16
  • 1970-01-01
  • 1970-01-01
  • 2021-06-16
  • 2017-05-07
  • 1970-01-01
  • 1970-01-01
相关资源
最近更新 更多