You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2023/01/17 03:31:38 UTC

[GitHub] [incubator-seatunnel] Hisoka-X commented on pull request #3945: [Bug][Connector-v2][HdfsSink]Fix data loss caused by commit failure.

Hisoka-X commented on PR #3945:
URL: https://github.com/apache/incubator-seatunnel/pull/3945#issuecomment-1384789857

   Hi, this is a problem we should faced, in two phase commit, we think the second phase always should success, if we abort it, the two phase commit can't make sure exactly-once. So if second phase failed, in zeta engine, we will recommit it again after job restarted. But flink engine can't support recommit in flink 1.13.6, so user should handle it by themself.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org