You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2021/03/10 08:50:00 UTC

[jira] [Assigned] (BEAM-11946) Use ReadFromKafkaDoFn for KafkaIO.Read by default when beam_fn_api is enabled

     [ https://issues.apache.org/jira/browse/BEAM-11946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Romanenko reassigned BEAM-11946:
---------------------------------------

    Assignee: Boyuan Zhang

> Use ReadFromKafkaDoFn for KafkaIO.Read by default when beam_fn_api is enabled
> -----------------------------------------------------------------------------
>
>                 Key: BEAM-11946
>                 URL: https://issues.apache.org/jira/browse/BEAM-11946
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-kafka
>            Reporter: Boyuan Zhang
>            Assignee: Boyuan Zhang
>            Priority: P2
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> There was a data loss bug in Dataflow when executing x-lang pipeline, which prevents us using ReadFromKafkaDoFn for KafkaIO default. Now the bug is fixed on dataflow side and we should use ReadFromKafkaDoFn when with beam_fn_api instead of using sdf wrapper.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)