[jira] [Commented] (FLINK-18449) Make topic discovery and partition discovery configurable for FlinkKafkaConsumer in Table API

["Jark Wu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-18449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149046#comment-17149046 ] 

Jark Wu commented on FLINK-18449:
---------------------------------

Would you like to work on this [~fsk119]? 
Btw, we need to discuss how to expose the configurations. Some thoughts from my side:
1) could we have an unified 'topic' option to support both static topic and topic list and topic pattern?
2) we may need to have an unified option for both topic discovery and partition discovery interval? 

> Make topic discovery and partition discovery configurable for FlinkKafkaConsumer in Table API
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLINK-18449
>                 URL: https://issues.apache.org/jira/browse/FLINK-18449
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Kafka, Table SQL / API
>    Affects Versions: 1.11.0
>            Reporter: Shengkai Fang
>            Priority: Major
>
> In streaming api, we can use regex to find topic and enable partiton discovery by setting non-negative value for `{{flink.partition-discovery.interval-millis}}`. However, it's not work in table api. I think we can add options such as 'topic-regex' and '{{partition-discovery.interval-millis}}' in WITH block for users.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)