找不到类io.confluent.connect.hdfs.string.stringformat

drnojrws  于 2021-06-07  发布在  Kafka
关注(0)|答案(0)|浏览(238)

嗨,我试图移动Kafka的csv数据到hdfs使用hdfs接收器连接器和以下是我使用的属性
connect.properties属性

name=hdfs-sink
connector.class=io.confluent.connect.hdfs.HdfsSinkConnector
format.class=io.confluent.connect.hdfs.string.StringFormat
tasks.max=1
topics=topic_name
hadoop.conf.dir=/etc/hadoop/conf
hdfs.url=hdfs://nameservice1/dir
flush.size=3
hdfs.authentication.kerberos=true
connect.hdfs.principal=principal
connect.hdfs.keytab=principal.keytab
hdfs.namenode.principal=principal
partitioner.class=io.confluent.connect.hdfs.partitioner.TimeBasedPartitioner
partition.duration.ms=300000
path.format=path.format='year'=YYYY/'month'=MM/'day'=dd
locale=en
timezone=EST

辅助对象属性

bootstrap.servers=kafkaserver
plugin.path=/opt/confluent/share/java
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=org.apache.kafka.connect.storage.StringConverter
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
offset.storage.file.filename=/tmp/connect.offsets
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
consumer.group.id=connect_group
consumer.auto.offset.reset=earliest

我用的是汇合-5.0.1
但是当我运行kafka connect时,我得到了下面的例外
java.util.concurrent.executionexception:org.apache.kafka.connect.runtime.rest.errors.badrequestexception:连接器配置无效,并包含以下1个错误:配置格式的值io.confluent.connect.hdfs.string.stringformat无效。类:找不到类io.confluent.connect.hdfs.string.stringformat。**您还可以在org.apache.kafka.connect.util.convertingfuturecallback.result(convertingfuturecallback)的端点/{connectortype}/config/validate找到上面的错误列表。java:79)在org.apache.kafka.connect.util.convertingfuturecallback.get(convertingfuturecallback。java:66)在org.apache.kafka.connect.cli.connectstandalone.main(connectstandalone。java:110)原因:org.apache.kafka.connect.runtime.rest.errors.badrequestexception:连接器配置无效,并包含以下1个错误:无效值io.confluent.connect.hdfs.string.stringformat for configuration format.class:class找不到io.confluent.connect.hdfs.string.stringformat。您还可以在org.apache.kafka.connect.runtime.abstractherder.maybeaddconfigerrors(abstractherder)的端点/{connectortype}/config/validate找到上面的错误列表。java:423)在org.apache.kafka.connect.runtime.standaloneherder.putconnectorconfig(standaloneherder。java:189)在org.apache.kafka.connect.cli.connectstandalone.main(connectstandalone。java:107)

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题