You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Thomas Larsson <th...@klarna.com> on 2015/08/26 17:00:20 UTC

Can KafkaSource write offsets to Kafka topics

Hi,

We are trying out the KafkaSource from Flume 1.6 and it seems that for us
it is storing the consumer offset in zookeeper.
According to
https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka
the proposed method for storing the offset is to store it in a kafka topic.

Is this option available when using the KafkaSource or is it something that
is being considered for the future?

Best Regards
/Thomas