You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2020/05/29 17:28:00 UTC

[jira] [Assigned] (BEAM-5786) KafkaIO should support topic patterns

     [ https://issues.apache.org/jira/browse/BEAM-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Romanenko reassigned BEAM-5786:
--------------------------------------

    Assignee:     (was: Alexey Romanenko)

> KafkaIO should support topic patterns
> -------------------------------------
>
>                 Key: BEAM-5786
>                 URL: https://issues.apache.org/jira/browse/BEAM-5786
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-kafka
>            Reporter: Alexey Romanenko
>            Priority: P2
>
> For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one single topic by using {{withTopic(String)}} or list of topics by using {{withTopics(List<String>)}}. 
> It would make sense to provide another way for this using patterns, based on regular expressions, like {{withTopics(“org_[0-9]+_source”)}}. In this case, Kafka consumer could discover the topics based on user provided pattern.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)