You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/06/20 20:51:00 UTC
[jira] [Commented] (FLINK-6923) Kafka connector needs to expose
information about in-flight record in AbstractFetcher base class
[ https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056435#comment-16056435 ]
ASF GitHub Bot commented on FLINK-6923:
---------------------------------------
GitHub user zhenzhongxu opened a pull request:
https://github.com/apache/flink/pull/4149
[FLINK-6923] [Kafka Connector] Expose in-processing/in-flight record …
This PR exposes current in-processing record partition and offset information per Kafka consumer instance. This allows custom offset management and/or periodical metric reporting etc.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhenzhongxu/flink master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4149.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4149
----
commit e6b4c6070661b8275af55280f6364f6666a2d5f2
Author: Zhenzhong Xu <zx...@netflix.com>
Date: 2017-06-20T20:47:50Z
[FLINK-6923] [Kafka Connector] Expose in-processing/in-flight record partition and offset in AbstractFetcher base class
----
> Kafka connector needs to expose information about in-flight record in AbstractFetcher base class
> ------------------------------------------------------------------------------------------------
>
> Key: FLINK-6923
> URL: https://issues.apache.org/jira/browse/FLINK-6923
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Zhenzhong Xu
> Assignee: Zhenzhong Xu
> Priority: Minor
>
> We have a use case where we have our custom Fetcher implementation that extends AbstractFetcher base class. We need to periodically get current in flight (in processing) records' partition and offset information.
> This can be easily exposed in AbstractFetcher class.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)