kafka connect-elastic search-将行时发布到elastic search

o2rvlv0m  于 2021-06-04  发布在  Kafka
关注(0)|答案(0)|浏览(217)

我正在尝试将Kafka主题的数据发布到ElasticSearch。我可以把所有的数据发布到es上。但是,无法将行时间发布到es。

{
  "name": "elasticsearch_sink",
  "config": {
    "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
    "tasks.max": "1",
    "topics": "k-connect-status",
    "connection.url": "http://docker.for.mac.host.internal:9200",
    "type.name": "connectstatus",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter", 
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "validate.non.null": "false",
    "key.ignore":"false",
    "schema.ignore":"true",
    "value.converter.schemas.enable": "false"
  }
}

主题中的json数据:

{
  "ROWTIME":1591743374742,
  "ROWKEY":"status-connector-elasticsearch_sink_31",
  "state":"RUNNING",
  "trace":null,
  "worker_id":"connect:8083",
  "generation":2
}

ElasticSearch输出

{
  "_index" : "k-connect-status",
  "_type" : "connectstatus",
  "_id" : "status-connector-elasticsearch_sink_31",
  "_score" : 1.0,
  "_source" : {
    "generation" : 2,
    "trace" : null,
    "state" : "RUNNING",
    "worker_id" : "connect:8083"
  }
}

有没有办法将rowtime发布到ElasticSearch。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题