【问题标题】:apache flume log directoryapache水槽日志目录
【发布时间】:2016-04-19 03:28:28
【问题描述】:

刚开始学习 Apache Flume。我按照 Flume 官方入门网站上的说明进行操作:

https://cwiki.apache.org/confluence/display/FLUME/Getting+Started

按照上面链接上的说明进行操作后,几乎一切都很好。但后来我找不到任何日志文件。我想日志文件在 {flume.directory}/logs 下。任何想法找到水槽日志文件?

我的 log4j.properties 来了:

flume.root.logger=INFO,LOGFILE
flume.log.dir=./logs
flume.log.file=flume.log

log4j.logger.org.apache.flume.lifecycle = INFO
log4j.logger.org.jboss = WARN
log4j.logger.org.mortbay = INFO
log4j.logger.org.apache.avro.ipc.NettyTransceiver = WARN
log4j.logger.org.apache.hadoop = INFO
log4j.logger.org.apache.hadoop.hive = ERROR

# Define the root logger to the system property "flume.root.logger".
log4j.rootLogger=${flume.root.logger}


# Stock log4j rolling file appender
# Default log rotation configuration
log4j.appender.LOGFILE=org.apache.log4j.RollingFileAppender
log4j.appender.LOGFILE.MaxFileSize=100MB
log4j.appender.LOGFILE.MaxBackupIndex=10
log4j.appender.LOGFILE.File=${flume.log.dir}/${flume.log.file}
log4j.appender.LOGFILE.layout=org.apache.log4j.PatternLayout
log4j.appender.LOGFILE.layout.ConversionPattern=%d{dd MMM yyyy HH:mm:ss,SSS} %-5p [%t] (%C.%M:%L) %x - %m%n


# Warning: If you enable the following appender it will fill up your disk if you don't have a cleanup job!
# This uses the updated rolling file appender from log4j-extras that supports a reliable time-based rolling policy.
# See http://logging.apache.org/log4j/companions/extras/apidocs/org/apache/log4j/rolling/TimeBasedRollingPolicy.html
# Add "DAILY" to flume.root.logger above if you want to use this
log4j.appender.DAILY=org.apache.log4j.rolling.RollingFileAppender
log4j.appender.DAILY.rollingPolicy=org.apache.log4j.rolling.TimeBasedRollingPolicy
log4j.appender.DAILY.rollingPolicy.ActiveFileName=${flume.log.dir}/${flume.log.file}
log4j.appender.DAILY.rollingPolicy.FileNamePattern=${flume.log.dir}/${flume.log.file}.%d{yyyy-MM-dd}
log4j.appender.DAILY.layout=org.apache.log4j.PatternLayout
log4j.appender.DAILY.layout.ConversionPattern=%d{dd MMM yyyy HH:mm:ss,SSS} %-5p [%t] (%C.%M:%L) %x - %m%n


# console
# Add "console" to flume.root.logger above if you want to use this
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d (%t) [%p - %l] %m%n

【问题讨论】:

    标签: flume flume-ng


    【解决方案1】:

    因为您的配置使用相对路径:

    flume.log.dir=./logs
    log4j.appender.LOGFILE.File=${flume.log.dir}/${flume.log.file}
    

    Flume 使用您当前的目录进行日志记录。
    (你启动flume时所在的目录)

    如果你想强制flume登录该路径,无论你在哪里启动它,你都可以使用flume.log.dir的绝对路径。

    【讨论】:

      【解决方案2】:

      根据您的log4j.properties,它将位于您启动flume-agent 的同一目录中,这就是./ 的作用。

      所以,如果你从/home 目录运行,它会是

      /home/logs/flume.log

      另外,您可以随时使用 linux 命令找出答案,

      find / -name flume.log ##search in whole disk

      find . -name flume.log ##search in current directory

      【讨论】:

        猜你喜欢
        • 1970-01-01
        • 1970-01-01
        • 1970-01-01
        • 1970-01-01
        • 2019-06-02
        • 2013-12-11
        • 2021-11-01
        • 1970-01-01
        • 1970-01-01
        相关资源
        最近更新 更多