如何设置kafka filestreamconnector?

vmdwslir  于 2021-06-04  发布在  Kafka
关注(0)|答案(0)|浏览(198)

我正在尝试设置kafka连接器FileStreamLink,如下所示,

meetups-to-local.json

{
  "name": "meetups-to-local",
  "config": {
    "connector.class": "FileStreamSink",
    "tasks.max": "1",
    "topics": "meetups",
    "file": "/tmp/meetups/messages.txt"
  }
}

加载连接器的命令是:

[root@kafka-connect ~]# confluent load meetups-to-local -d meetups-to-local.json

This CLI is intended for development only, not for production
https://docs.confluent.io/current/cli/index.html

{
  "name": "meetups-to-local",
  "config": {
    "connector.class": "FileStreamSink",
    "tasks.max": "1",
    "topics": "meetups",
    "file": "/tmp/meetups/messages.txt",
    "name": "meetups-to-local"
  },
  "tasks": [
    {
      "connector": "meetups-to-local",
      "task": 0
    }
  ],
  "type": null

当我向这个连接器发送get请求时,我得到如下响应,显示连接器已经创建。

[root@kafka-connect ~]# curl -X GET http://localhost:8083/connectors/meetups-to-local

{"name":"meetups-to-local","config":{"topics":"meetups","file":"/tmp/meetups/messages.txt","name":"meetups-to-local","tasks.max":"1","connector.class":"FileStreamSink"},"tasks":[{"connector":"meetups-to-local","task":0}],"type":"sink"}

我给主题“聚会”发信息如下,

[root@kafka-connect ~]# curl -s http://stream.meetup.com/2/rsvps | kafka-console-producer --broker-list localhost:9092 --topic meetups

我可以使用控制台使用者在主题中看到新消息。但是我没有看到任何通过连接器在/tmp/位置创建的文件。如何解决这个问题?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题