【问题标题】:Flume - Could not configure sink - No channel configured for sinkFlume - 无法配置接收器 - 没有为接收器配置通道
【发布时间】:2015-08-04 00:42:47
【问题描述】:

我已将 Flume 配置为读取日志文件并写入 HDFS。当我启动水槽时,会读取日志文件,但不会将其写入 HDFS。 flume.log 有警告消息 - could not configure sink - no channel configured for sink 但我已经在 conf 文件中分配了一个通道来接收。

下面是配置文件和错误信息:

File: spool-to-hdfs.properties
# List all components.
agent1.sources = source1
agent1.sinks = sink1
agent1.channels = channel1

# Describe source.
agent1.sources.source1.type = spooldir
agent1.sources.source1.spoolDir =/Suriya/flume/input_files

# Describe channel
#agent1.channels.channel1.type = file
#agent1.channels.channel1.checkpointDir = /Suriya/flume/checkpointDir
#agent1.channels.channel1.dataDirs =/Suriya/flume/dataDirs
agent1.channels.channel1.type = memory

# Describe sink
agent1.sinks.sink1.type = hdfs
#agent1.sinks.sink1.hdfs.path = hdfs://sandbox.hortonworks.com:8020/hdfs/Suriya/flume
agent1.sinks.sink1.hdfs.path = hdfs://localhost/hdfs/Suriya/flume
agent1.sinks.sink1.hdfs.fileType= DataStream
agent1.sinks.sink1.hdfs.writeFormat = Text

# Bind source and sink to channel
agent1.sources.source1.channels = channel1
agent1.sinks.sink1.channels = channel1

**-- starting the agent**
flume-ng agent --conf-file spool-to-hdfs.properties --conf /etc/flume/conf --name agent1;

flume.log

03 Aug 2015 23:37:16,699 WARN  [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateSinks:697)  - Could not configure sink  sink1 due to: No channel configured for sink: sink1
org.apache.flume.conf.ConfigurationException: No channel configured for sink: sink1 at org.apache.flume.conf.sink.SinkConfiguration.configure(SinkConfiguration.java:51)

【问题讨论】:

    标签: hadoop flume-ng


    【解决方案1】:
    Replace the bind part with.
    
    # Bind source and sink to channel
    agent1.sources.source1.channels = channel1
    agent1.sinks.sink1.channels = channel1
    
    This bind config
    # Bind source and sink to channel
    agent1.sources.source1.channels = channel1
    agent1.sinks.sink1.channel = channel1
    
    
    agent1.sources.source1.channels = channel1 
    Looks okay
    
    BUT
    agent1.sinks.sink1.channels = channel1
    Should be 
    agent1.sinks.sink1.channel = channel1
    

    告诉我们进展如何。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 2021-08-17
      • 1970-01-01
      • 2019-11-15
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2019-11-26
      相关资源
      最近更新 更多