You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2023/01/14 13:32:33 UTC

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #3945: [Bug][Connector-v2][HdfsSink]Fix data loss caused by commit failure.

lightzhao commented on PR #3945:
URL: https://github.com/apache/incubator-seatunnel/pull/3945#issuecomment-1382739354

   > When commit operation failed, it will collect these failed transaction information and try to recommit those at engine point (This is the design idea). So it's meaningless to do these things. I will close this PR, if you have any other suggestion or problem, please reopen it. Thanks!
   
   @TyrantLucifer The problem is that on the Flink engine, the commit failure will result in the loss of kafka consumption data, which is not successfully written on the sink side, but the kafka consumption has been committed successfully.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org