You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Eleanore Jin <el...@gmail.com> on 2020/08/27 17:18:50 UTC

Is KafkaIO KafkaWriter stateless

Hi all,

Just would like to confirm, KafkaWriter
<https://github.com/apache/beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaWriter.java>
has
no state, so that means, when enabled checkpoint, no state will be
checkpointed from KafkaWriter?

Thanks a lot!
Eleanore

Re: Is KafkaIO KafkaWriter stateless

Posted by Eleanore Jin <el...@gmail.com>.

Thanks Alex!

On Mon, Aug 31, 2020 at 9:32 AM Alexey Romanenko <ar...@gmail.com>
wrote:

> Yes, afaik, checkpoints are supported and used only for UnboundedRead
> transforms.
>
>
> On 27 Aug 2020, at 19:18, Eleanore Jin <el...@gmail.com> wrote:
>
> Hi all,
>
> Just would like to confirm, KafkaWriter
> <https://github.com/apache/beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaWriter.java> has
> no state, so that means, when enabled checkpoint, no state will be
> checkpointed from KafkaWriter?
>
> Thanks a lot!
> Eleanore
>
>
>

Re: Is KafkaIO KafkaWriter stateless

Posted by Alexey Romanenko <ar...@gmail.com>.

Yes, afaik, checkpoints are supported and used only for UnboundedRead transforms.


> On 27 Aug 2020, at 19:18, Eleanore Jin <el...@gmail.com> wrote:
> 
> Hi all, 
> 
> Just would like to confirm, KafkaWriter <https://github.com/apache/beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaWriter.java> has no state, so that means, when enabled checkpoint, no state will be checkpointed from KafkaWriter?
> 
> Thanks a lot!
> Eleanore