【问题标题】:Unable to create kafka connector using REST API无法使用 REST API 创建 kafka 连接器
【发布时间】:2020-01-26 08:52:13
【问题描述】:

我正在尝试以分布式模式运行 Kafka 工作人员。与独立模式不同,我们不能在分布式模式下启动 worker 时传递连接器属性文件。在分布式模式下,worker 是单独启动的,我们使用 REST API 在这些worker 上部署和管理连接器

参考链接 - https://docs.confluent.io/current/connect/managing/configuring.html#connect-managing-distributed-mode

我尝试通过在 curl 命令中传递以下值来构建连接器并执行它

curl -X POST -H "Content-Type: application/json" --data '{"name":"sailpointdb","connector.class":"io.confluent.connect.jdbc.JdbcSourceConnector","tasks.max":"1","connection.password " : " abc","connection.url " : "jdbc:mysql://localhost:3306/db","connection.user " : "abc" ,"query" : " SELECT * FROM (SELECT NAME, FROM_UNIXTIME(completed/1000) AS 
TASKFAILEDON FROM abc WHERE COMPLETION_STATUS = 'Error') as A","mode" : " timestamp","timestamp.column.name" : "TASKFAILEDON","topic.prefix" : "dbevents","validate.non.null" : "false" }}' http://localhost:8089/connectors/

我遇到以下错误 - curl:(3) URL 使用错误/非法格式或缺少 URL

请让我知道上面的 curl 语句有什么问题,我这里有什么遗漏吗

【问题讨论】:

    标签: apache-kafka apache-kafka-connect


    【解决方案1】:
    1. 您的 JSON 中有一个额外的右花括号,这无济于事
    2. 如果您是POST/connectors,则需要nameconfig 根级元素。但是,我建议使用PUT /config,因为如果需要,您可以重新运行它来更新配置

    试试这个:

    curl -X PUT -H  "Content-Type:application/json" \
          http://localhost:8089/connectors/source-jdbc-sailpointdb-00/config \
          -d '{
            "connector.class": "io.confluent.connect.jdbc.JdbcSourceConnector",
            "tasks.max": "1",
            "connection.password ": " abc",
            "connection.url ": "jdbc:mysql://localhost:3306/db",
            "connection.user ": "abc",
            "query": " SELECT * FROM (SELECT NAME, FROM_UNIXTIME(completed/1000) AS TASKFAILEDON FROM abc WHERE COMPLETION_STATUS = 'Error') as A",
            "mode": " timestamp",
            "timestamp.column.name": "TASKFAILEDON",
            "topic.prefix": "dbevents",
            "validate.non.null": "false"
        }'
    

    【讨论】:

      猜你喜欢
      • 2020-01-30
      • 1970-01-01
      • 2015-04-23
      • 2018-10-25
      • 2019-08-22
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2021-07-21
      相关资源
      最近更新 更多