Kafka连接数字类型字段

bfnvny8b  于 2021-06-08  发布在  Kafka
关注(0)|答案(1)|浏览(360)

当我想使用kafka connect与源rdbms(即oracle)连接时,数字类型字段被视为如下所示的字节,
列“id”的值为“4”的数字已被发送,但在消费者控制台,该值已被视为“id”:“ba==”
我能做些什么来解决这个问题?
kafka connect以下面的命令启动

connect-standalone ./etc/kafka/connect-standalone.properties /home/kafka/oracle.properties.test

######## connect-standalone.properties

# These are defaults. This file just demonstrates how to override some settings.

bootstrap.servers=kafkaserver01.localdomain:9092

# The converters specify the format of data in Kafka and how to translate it into Connect data. Every Connect user will

# need to configure these based on the format they want their data in when loaded from or stored into Kafka

key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter

# Converter-specific settings can be passed in by prefixing the Converter's setting with the converter we want to apply

# it to

key.converter.schemas.enable=true
value.converter.schemas.enable=true

# The internal converter used for offsets and config data is configurable and must be specified, but most users will

# always want to use the built-in default. Offset and config data is never visible outside of Kafka Connect in this format.

internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false

offset.storage.file.filename=/tmp/connect.offsets

# Flush much faster than normal, which is useful for testing/debugging

offset.flush.interval.ms=10000

######## /home/kafka/oracle.properties.test Configuration File

name=oracle-connect-test1
connector.class=io.confluent.connect.jdbc.JdbcSourceConnector
tasks.max=1
topic.prefix=
connection.url=jdbc:oracle:thin:test/oracle@testsrv01:1521:testdb
table.whitelist=TEST1,TEST2
mode=timestamp
timestamp.column.name=CDC_TIMESTAMP

## Console Consumer

kafka-console-consumer --bootstrap-server kafkaserver01.localdomain:9092  --topic TEST1

谢谢。

fcy6dtqo

fcy6dtqo1#

我找到了解决方案,请在连接器源属性中添加以下配置
numeric.precision.mapping=真
它将禁用在主题处编码数值
使用新版本的kafka-connect-jdbc-4.1.1
您可以使用属性

numeric.mapping=best_fit

为了达到最佳效果

相关问题