Kafka Connect REST API 使用手册

Kafka Connect 作为service提供了 REST API 服务,用来:

  • 获取 Kafka Connect 状态

  • 管理 Kafka Connect 配置

  • Kafka Connect 集群内部通信

常用命令如下:

  • curl -s <Kafka Connect Worker URL>:8083/ | jq
    获取 Connect Worker 信息

  • curl -s <Kafka Connect Worker URL>:8083/connector-plugins | jq
    列出 Connect Worker 上所有 Connector

  • curl -s <Kafka Connect Worker URL>:8083/connectors/<Connector名字>/tasks | jq
    获取 Connector 上 Task 以及相关配置的信息

  • curl -s <Kafka Connect Worker URL>:8083/connectors/<Connector名字>/status | jq
    获取 Connector 状态信息

  • curl -s <Kafka Connect Worker URL>:8083/connectors/<Connector名字>/config | jq
    获取 Connector 配置信息

  • curl -s -X PUT <Kafka Connect Worker URL>:8083/connectors/<Connector名字>/pause
    暂停 Connector

  • curl -s -X PUT <Kafka Connect Worker URL>:8083/connectors/<Connector名字>/resume
    重启 Connector

  • curl -s -X DELETE <Kafka Connect Worker URL>:8083/connectors/<Connector名字>
    删除 Connector

curl -s -X POST -H "Content-Type: application/json" --data 
 '{"name": "<Connector名字>", 
   "config":
    {"connector.class":"org.apache.kafka.connect.file.FileStreamSourceConnector",
    "key.converter.schemas.enable":"true",
    "file":"demo-file.txt",
    "tasks.max":"1",
    "value.converter.schemas.enable":"true",
    "name":"file-stream-demo-distributed",
    "topic":"demo-distributed",
    "value.converter":"org.apache.kafka.connect.json.JsonConverter",
    "key.converter":"org.apache.kafka.connect.json.JsonConverter"}
 }' 
http://<Kafka Connect Worker URL>:8083/connectors | jq

创建新 Connector (以FileStreamSourceConnector举例)

curl -s -X PUT -H "Content-Type: application/json" --data 
'{"connector.class":"org.apache.kafka.connect.file.FileStreamSourceConnector",
"key.converter.schemas.enable":"true",
"file":"demo-file.txt",
"tasks.max":"2",
"value.converter.schemas.enable":"true",
"name":"file-stream-demo-distributed",
"topic":"demo-2-distributed",
"value.converter":"org.apache.kafka.connect.json.JsonConverter",
"key.converter":"org.apache.kafka.connect.json.JsonConverter"}' 
<Kafka Connect Worker URL>:8083/connectors/file-stream-demo-distributed/config | jq

更新 Connector配置 (以FileStreamSourceConnector举例)

最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容