You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/02 10:03:00 UTC

[jira] [Commented] (FLINK-9899) Add more metrics to the Kinesis source connector

    [ https://issues.apache.org/jira/browse/FLINK-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566569#comment-16566569 ] 

ASF GitHub Bot commented on FLINK-9899:
---------------------------------------

tzulitai commented on issue #6409: [FLINK-9899][Kinesis Connecotr] Add comprehensive per-shard metrics to ShardConsumer
URL: https://github.com/apache/flink/pull/6409#issuecomment-409875134
 
 
   @glaksh100 what's the status of this PR? As Chesnay mentioned, we need to document connector metrics.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Add more metrics to the Kinesis source connector
> ------------------------------------------------
>
>                 Key: FLINK-9899
>                 URL: https://issues.apache.org/jira/browse/FLINK-9899
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kinesis Connector
>    Affects Versions: 1.4.2, 1.5.1
>            Reporter: Lakshmi Rao
>            Assignee: Lakshmi Rao
>            Priority: Major
>              Labels: pull-request-available
>
> Currently there are sparse metrics available for the Kinesis Connector. Using the [ShardMetricsReporter|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/metrics/ShardMetricsReporter.java] add more stats. For example:
> - sleepTimeMillis 
> - maxNumberOfRecordsPerFetch
> - numberOfAggregatedRecordsPerFetch
> - numberOfDeaggregatedRecordsPerFetch
> - bytesPerFetch
> - averageRecordSizeBytes
> - runLoopTimeNanos
> - loopFrequencyHz



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)