如何通过kafka将protobuf流聚合到clickhouse表中?

but5z9lq  于 2021-06-05  发布在  Kafka
关注(0)|答案(0)|浏览(419)

让我们考虑以下示例:

syntax = "proto3";

message Book {
  message Record {
    string f1 = 1;
    string f2 = 2;
    string f3 = 3;
  }
  repeated Record records = 1;
  string af1 = 2;
  string af2 = 3;
}

我应该如何描述合适的clickhouse table/consumer/queue 模特?
这不是关键,但我想应该是类似的:

CREATE TABLE qwe_queue
(
  f1 String,
  f2 String,
  f3 String,
  af1 String,
  af2 String
) ENGINE = Kafka
SETTINGS
kafka_broker_list='',
kafka_topic_list='',
kafka_group_name='',
kafka_format='Protobuf',
kafka_schema='ex.proto:Book';

CREATE TABLE qwe
(
  f1 String,
  f2 String,
  f3 String,
  af1 String,
  af2 String
) ENGINE = ReplacingMergeTree();

CREATE MATERIALIZED VIEW qwe_consumer TO qwe AS
SELECT
  anyLast(f1) as f1,
  anyLast(f2) as f2,
  anyLast(f3) as f3,
  anyLast(af1) as af1,
  anyLast(af2) as af2
FROM qwe_queue
SETTINGS stream_flush_interval_ms=60000;

但它不起作用。
应该如何描述?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题