You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Or Keren <or...@gmail.com> on 2023/06/09 12:53:47 UTC

[DISCUSS] Visibility on HybridSource or KafkaSource with multiple topics

Hey all,



*Motivation:*

Currently when using either HybridSource with multiple sources or
KafkaSource with multiple topics inside, it’s impossible to see the
distribution between the different sources regarding how many records have
been received so far. All of the received records metric is being displayed
as if it’s one source.



*Proposal:*
For the HybridSource:

   - Collapsible visibility on which sources are included in it, and how
   many records were received by each one of them.
   - Indicator which one of them is the active source.


For the KafkaSource:

   - Collapsible visibility on which topics are included in it, and how
   many records were received by each one of them.