【发布时间】:2021-04-07 21:25:13
【问题描述】:
哪个camel kafka连接器组件可以从远程服务器读取文件并将记录发布到kafka主题?我尝试了camel-sftp-kafka-connector,但它将整个文件移动到主题。任何可以直接读取远程服务器上的文件的连接器?
【问题讨论】:
标签: apache-kafka apache-camel apache-kafka-connect
哪个camel kafka连接器组件可以从远程服务器读取文件并将记录发布到kafka主题?我尝试了camel-sftp-kafka-connector,但它将整个文件移动到主题。任何可以直接读取远程服务器上的文件的连接器?
【问题讨论】:
标签: apache-kafka apache-camel apache-kafka-connect
使用此依赖项
<dependency>
<groupId>org.apache.camel</groupId>
<artifactId>camel-core</artifactId>
<version>2.13.0</version>
</dependency>
<dependency>
<groupId>org.apache.camel</groupId>
<artifactId>camel-kafka</artifactId>
<version>2.16.3</version>
</dependency>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-library</artifactId>
<version>2.11.0</version>
</dependency>
【讨论】:
公共类 SimpleRouteBuilder 扩展 RouteBuilder {
@Override
public void configure() throws Exception {
String topicName = "topic=javainuse-topic";
String kafkaServer = "kafka:localhost:9092";
String zooKeeperHost = "zookeeperHost=localhost&zookeeperPort=2181";
String serializerClass = "serializerClass=kafka.serializer.StringEncoder";
String toKafka = new StringBuilder().append(kafkaServer).append("?").append(topicName).append("&")
.append(zooKeeperHost).append("&").append(serializerClass).toString();
from("file:C:/publicUpload?noop=true").split().tokenize("\n").to(toKafka);
}
}
【讨论】: