Skip to content

Kafka engine information in systems table/logging level kafka engine #5128

@yctn

Description

@yctn

It would be very usefull to provide kafka information in a system table.
it then can be queryed for monitoring of the kafka ingestion.
things suchs as commited offsets. topic's amount of partitions etc.

secondly, it would be good to provide a way/config settings to set the logging level of librdkafka currently its set to default so the clickhouse-server.log receives huge spamming of all the librdkafka debug information.

Metadata

Metadata

Assignees

Labels

comp-message-queuesMessage queue integrations (Kafka, RabbitMQ, NATS table engines for stream ingestion/egress).feature

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions