Skip to content

Add support for kafka_source specifying offsets_initializer

Ottomata requested to merge kafka_offsets into main

This will allow us to easily provide different a different offset reset from config/params. With this, we can now do:

source:
  connector: kafka
  options:
    offsets_initializer: earliest

To tell the source to start from earliest offset. This is especially useful for performance testing.

TODO is to implement support for specific offsets.

Edited by Ottomata

Merge request reports