You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by ma...@kafkatool.com on 2018/08/02 19:04:48 UTC
Re: Viewing transactional markers in client
This would be useful, for example, showing messages belonging to the
same transaction.
thanks
marko
----- Original Message -----
From: users@kafka.apache.org
To:<us...@kafka.apache.org>
Cc:
Sent:Tue, 31 Jul 2018 14:40:20 -0700
Subject:Re: Viewing transactional markers in client
No. Transaction markers are not exposed.
Why would you need them? They are considered implementation details.
-Matthias
On 7/27/18 5:58 AM, marko@kafkatool.com wrote:
> Is there any way for a KafkaConsumer to view/get the transactional
> marker messages?
>
> --
> Best regards,
> Marko
> www.kafkatool.com
>
Re: Viewing transactional markers in client
Posted by Cody Koeninger <co...@koeninger.org>.
Here's one reason I might want to be able to tell whether a given
offset is a transactional marker:
https://issues.apache.org/jira/browse/SPARK-24720
Alternatively, is there any efficient way to tell what the offset of
the last actual record in a topicpartition is (i.e. like endOffsets)
On Thu, Aug 2, 2018 at 3:09 PM, Matthias J. Sax <ma...@confluent.io> wrote:
> Messages don't contain any information to what transaction they belong.
>
> Note, that `transaction markers`, as special messages that only indicate
> a commit or abort. There is no `transaction marker` _in_ a message.
>
>
> -Matthias
>
> On 8/2/18 12:04 PM, marko@kafkatool.com wrote:
>>
>>
>> This would be useful, for example, showing messages belonging to the
>> same transaction.
>>
>> thanks
>>
>> marko
>>
>> ----- Original Message -----
>> From: users@kafka.apache.org
>> To:<us...@kafka.apache.org>
>> Cc:
>> Sent:Tue, 31 Jul 2018 14:40:20 -0700
>> Subject:Re: Viewing transactional markers in client
>>
>> No. Transaction markers are not exposed.
>>
>> Why would you need them? They are considered implementation details.
>>
>> -Matthias
>>
>> On 7/27/18 5:58 AM, marko@kafkatool.com wrote:
>> > Is there any way for a KafkaConsumer to view/get the transactional
>> > marker messages?
>> >
>> > --
>> > Best regards,
>> > Marko
>> > www.kafkatool.com
>> >
>>
>>
>>
>
Re: Viewing transactional markers in client
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Messages don't contain any information to what transaction they belong.
Note, that `transaction markers`, as special messages that only indicate
a commit or abort. There is no `transaction marker` _in_ a message.
-Matthias
On 8/2/18 12:04 PM, marko@kafkatool.com wrote:
>
>
> This would be useful, for example, showing messages belonging to the
> same transaction.
>
> thanks
>
> marko
>
> ----- Original Message -----
> From: users@kafka.apache.org
> To:<us...@kafka.apache.org>
> Cc:
> Sent:Tue, 31 Jul 2018 14:40:20 -0700
> Subject:Re: Viewing transactional markers in client
>
> No. Transaction markers are not exposed.
>
> Why would you need them? They are considered implementation details.
>
> -Matthias
>
> On 7/27/18 5:58 AM, marko@kafkatool.com wrote:
> > Is there any way for a KafkaConsumer to view/get the transactional
> > marker messages?
> >
> > --
> > Best regards,
> > Marko
> > www.kafkatool.com
> >
>
>
>