You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Petr Novak <os...@gmail.com> on 2015/09/17 20:09:06 UTC
Does Kafka support adding custom metadata to commits?
Hi all,
can I add custom metadata to the new commit topic which I could use to
recover my app? This would give me some level of consistency if I could
commit my additional data at once instead of writing them to another topic.
Many thanks,
Petr
Re: Does Kafka support adding custom metadata to commits?
Posted by Petr Novak <os...@gmail.com>.
Thanks so much.
On Thu, Sep 17, 2015 at 8:36 PM, Helleren, Erik <Er...@cmegroup.com>
wrote:
> Looking at the docs here (
> https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+c
> onsumer+offsets+in+Kafka), its possible to attach metadata as a string to
> each partition for the consumer group using the PartitionData constructor
> (
> http://apache.osuosl.org/kafka/0.8.2-beta/java-doc/org/apache/kafka/common
> /requests/OffsetCommitRequest.PartitionData.html)
> -Erik
>
> On 9/17/15, 1:09 PM, "Petr Novak" <os...@gmail.com> wrote:
>
> >Hi all,
> >can I add custom metadata to the new commit topic which I could use to
> >recover my app? This would give me some level of consistency if I could
> >commit my additional data at once instead of writing them to another
> >topic.
> >
> >Many thanks,
> >Petr
>
>
Re: Does Kafka support adding custom metadata to commits?
Posted by "Helleren, Erik" <Er...@cmegroup.com>.
Looking at the docs here (
https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+c
onsumer+offsets+in+Kafka), its possible to attach metadata as a string to
each partition for the consumer group using the PartitionData constructor
(http://apache.osuosl.org/kafka/0.8.2-beta/java-doc/org/apache/kafka/common
/requests/OffsetCommitRequest.PartitionData.html)
-Erik
On 9/17/15, 1:09 PM, "Petr Novak" <os...@gmail.com> wrote:
>Hi all,
>can I add custom metadata to the new commit topic which I could use to
>recover my app? This would give me some level of consistency if I could
>commit my additional data at once instead of writing them to another
>topic.
>
>Many thanks,
>Petr