You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/07/19 14:39:00 UTC
[jira] [Commented] (FLINK-7210) Add TwoPhaseCommitSinkFunction
(implementing exactly-once semantic in generic way)
[ https://issues.apache.org/jira/browse/FLINK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093178#comment-16093178 ]
ASF GitHub Bot commented on FLINK-7210:
---------------------------------------
GitHub user pnowojski opened a pull request:
https://github.com/apache/flink/pull/4368
[FLINK-7210] Introduce TwoPhaseCommitSinkFunction
This is intended to be a recommended base class for implementing exactly-once sinks in Flink
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pnowojski/flink 2phase
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4368.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4368
----
commit 6ea314a4abd9f609accbc9c5f450051560df43da
Author: Piotr Nowojski <pi...@gmail.com>
Date: 2017-07-04T15:45:53Z
[FLINK-7210] Implement TwoPhaseCommitSinkFunction
This is a recommended base class for implementing exactly-once sinks in Flink
----
> Add TwoPhaseCommitSinkFunction (implementing exactly-once semantic in generic way)
> ----------------------------------------------------------------------------------
>
> Key: FLINK-7210
> URL: https://issues.apache.org/jira/browse/FLINK-7210
> Project: Flink
> Issue Type: Improvement
> Components: Streaming Connectors
> Reporter: Piotr Nowojski
> Assignee: Piotr Nowojski
>
> To implement exactly-once sink there is a re-occurring pattern for doing it - two phase commit algorithm. It is used both in `BucketingSink` and in `Pravega` sink and it will be used in `Kafka 0.11` connector. It would be good to extract this common logic into one class, both to improve existing implementation (for exampe `Pravega`'s sink doesn't abort interrupted transactions) and to make it easier for the users to implement their own custom exactly-once sinks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)