You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2017/10/09 14:41:00 UTC

[jira] [Created] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

Aljoscha Krettek created FLINK-7784:
---------------------------------------

             Summary: Don't fail TwoPhaseCommitSinkFunction when failing to commit
                 Key: FLINK-7784
                 URL: https://issues.apache.org/jira/browse/FLINK-7784
             Project: Flink
          Issue Type: Bug
          Components: DataStream API
    Affects Versions: 1.4.0
            Reporter: Aljoscha Krettek
            Priority: Blocker


Currently, {{TwoPhaseCommitSinkFunction}} will fail if committing fails (either when doing it via the completed checkpoint notification or when trying to commit after restoring after failure). This means that the job will go into an infinite recovery loop because we will always keep failing.

In some cases it might be better to ignore those failures and keep on processing and this should be the default. We can provide an option that allows failing the sink on failing commits.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)