You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2021/12/30 16:38:00 UTC

[jira] [Comment Edited] (BEAM-13298) JdbcIO like withResults() for KafkaIO

    [ https://issues.apache.org/jira/browse/BEAM-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17466932#comment-17466932 ] 

Alexey Romanenko edited comment on BEAM-13298 at 12/30/21, 4:37 PM:
--------------------------------------------------------------------

I created a parent task for that: BEAM-13584. So, we need to attach all similar tasks to it.


was (Author: aromanenko):
I created a parent task for that: BEAM-13584

> JdbcIO like withResults() for KafkaIO
> -------------------------------------
>
>                 Key: BEAM-13298
>                 URL: https://issues.apache.org/jira/browse/BEAM-13298
>             Project: Beam
>          Issue Type: Sub-task
>          Components: io-ideas, io-java-kafka
>         Environment: Production
>            Reporter: Ranjan Dahal
>            Priority: P2
>              Labels: KafkaIO
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> I am looking at use case where we have to wait until the Kafka Write operation is completed before we can move forward with another transform. Currently, JdbcIO support withResults() which waits for the previous transform to complete as part of Wait.on(Signal) and moves on to the next. 
> Similarly, it would be very beneficial to have this capability on KafkaIO (and others like PubSubIO, BigQueryIO etc). 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)