【问题标题】:what would cause this debezium kafka connector error?什么会导致这个 debezium kafka 连接器错误?
【发布时间】:2021-09-08 10:07:35
【问题描述】:

我正在寻找连接 mysql --> debezium --> kafka (confluent cloud)。我想知道是否有人可以帮助我解决此错误消息:

找不到任何实现 Connector 且名称与 io.debezium.connector.mysql.MySqlConnector 匹配的类。

我的 kafka worker 文件中有 debezium 的 jar 文件:

plugin.path=/home/ec2-user/kafka/plugins

插件文件夹的内容如下:

-antlr4-runtime-4.7.2.jar

-debezium-api-1.5.3.Final.jar

-debezium-connector-mysql-1.5.3.Final.jar

-debezium-core-1.5.3.Final.jar

-debezium-ddl-parser-1.5.3.Final.jar

-failureaccess-1.0.1.jar

-guava-30.0-jre.jar

-mysql-binlog-connector-java-0.25.1.jar

-mysql-connector-java-8.0.21.jar

当我启动分发器时,我看到插件已添加:

[2021-06-24 23:01:54,680] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-api-1.5.3.Final.jar}
[2021-06-24 23:01:54,684] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-connector-mysql-1.5.3.Final.jar
[2021-06-24 23:01:54,744] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-connector-mysql-
[2021-06-24 23:01:54,745] INFO Added plugin 'io.debezium.connector.mysql.transforms.ReadToInsertEvent'
[2021-06-24 23:01:54,745] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-core-1.5.3.Final.jar
[2021-06-24 23:01:54,866] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-core-1.5.3.Final.jar} 
[2021-06-24 23:01:54,867] INFO Added plugin 'io.debezium.converters.CloudEventsConverter'
[2021-06-24 23:01:54,871] INFO Added plugin 'io.debezium.transforms.outbox.EventRouter'
[2021-06-24 23:01:54,872] INFO Added plugin 'io.debezium.transforms.ExtractNewRecordState'
[2021-06-24 23:01:54,872] INFO Added plugin 'io.debezium.transforms.ByLogicalTableRouter'
[2021-06-24 23:01:54,873] INFO Added plugin 'io.debezium.transforms.tracing.ActivateTracingSpan'
[2021-06-24 23:01:54,873] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-ddl-parser-1.5.3.Final.jar
[2021-06-24 23:01:55,060] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-ddl-parser-1.5.3.Final.jar}
[2021-06-24 23:01:55,061] INFO Loading plugin from: /home/ec2-user/kafka/plugins/failureaccess-1.0.1.jar
[2021-06-24 23:01:55,069] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/failureaccess-1.0.1.jar}
[2021-06-24 23:01:55,070] INFO Loading plugin from: /home/ec2-user/kafka/plugins/guava-30.0-jre.jar
[2021-06-24 23:01:55,307] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/guava-30.0-jre.jar}

但是,当我运行 curl 命令时:

curl -s -X POST -H 'Content-Type: application/json' --data @debe-connector.json http://localhost:8083/connectors -v

我得到错误:

找不到任何实现 Connector 且名称与 io.debezium.connector.mysql.MySqlConnector 匹配的类。

知道我可能缺少什么吗?

谢谢,

【问题讨论】:

  • 您的 plugin.path 目录中是否有 /home/ec2-user/kafka/plugins 中名为“debezium-connector-mysql”的目录?
  • 请分享debe-connector.json文件的配置。此外,您可以使用GET /connector-plugins REST 调用检查已安装的插件。
  • @Ran Lupovich,这是我昨天从 debezium 的聊天室得到的修复。我不得不将所有 jar 文件放在 /home/ec2-user/kafka/plugins/debezium-connector-mysql 而不是 /home/ec2-user/kafka/plugins 下。
  • 是的,我是这么想的????

标签: apache-kafka-connect debezium


【解决方案1】:

需要将debezium mysql connector的所有jar文件放到一个目录中

/home/ec2-user/kafka/plugins/debezium-connector-mysql

而不是略低于

/home/ec2-user/kafka/plugins

【讨论】:

    猜你喜欢
    • 2019-07-22
    • 2020-04-27
    • 1970-01-01
    • 1970-01-01
    • 2020-04-26
    • 2012-05-04
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多