Skip to content

Extract Kafka config to env var

Gmodena requested to merge T329061-remove-hardcoded-kafka-parameters into main

Bug: T329061

Make Kafka brokers and DC topic prefix user configurable. This MR is a temporary hack till we settled on a config file format.

Two new env vars have been introduced:

  • KAFKA_BOOTSTRAP_SERVERS: a comma separated list of Kafka brokers
  • KAFKA_TOPIC_PREFIX: kafka dc prefix used to prefix Kafka source and sink topics in eventutilities' Flink DataStream factory methods.
  • KAFKA_CONSUMER_GROUP: default Kafka default consumer group for eventutilities' Flink DataStream factory methods.

Breaking changes:

[x] Helm file should be updated to a relevant KAFKA_CONSUMER_GROUP. cc @otto I'll open a CR to deployment-charts.

cc / @otto @dcausse @tchin

Edited by Gmodena

Merge request reports