You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jing Ge (Jira)" <ji...@apache.org> on 2022/06/18 14:41:00 UTC

[jira] [Updated] (FLINK-28117) More metrics for FileSource

     [ https://issues.apache.org/jira/browse/FLINK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jing Ge updated FLINK-28117:
----------------------------
    Component/s: Connectors / FileSystem
                 Runtime / Metrics

> More metrics for FileSource
> ---------------------------
>
>                 Key: FLINK-28117
>                 URL: https://issues.apache.org/jira/browse/FLINK-28117
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / FileSystem, Runtime / Metrics
>            Reporter: Jing Ge
>            Priority: Major
>
> According to user's requirement[1], following metrics are required:
> 1. No. of splits SplitAssigner is initialized with, number of splits re-added back to the SplitAssigner
> 2. Readers created per unit time
> 3. Time taken to create a reader
> 4. Time taken for the Reader to produce a single Row
> 5. Readers closed per unit time
>  
> Some further nice-to-have metrics:1. Number of rows emitted by the source per unit time
> 2. Time taken by the enumerator to discover the splits 
> 3. Total splits discovered
>  
> Please check FLIP-33 first and extend it if above mentioned metrics were not included in the FLIP.
>  
> [1] https://lists.apache.org/thread/t70hhss6d9s65y1vygyytbm6sgl05yrl



--
This message was sent by Atlassian Jira
(v8.20.7#820007)