You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "liming30 (via GitHub)" <gi...@apache.org> on 2023/07/13 07:50:34 UTC

[GitHub] [incubator-paimon] liming30 opened a new pull request, #1562: [flink] fix the issue that the historical snapshot may be lost when Enumerator performs snapshotState

liming30 opened a new pull request, #1562:
URL: https://github.com/apache/incubator-paimon/pull/1562

   
   ### Purpose
   
   [flink] fix the issue that the historical snapshot may be lost when Enumerator performs snapshotState
   
   Linked issue: close #1561 
   
   <!-- What is the purpose of the change -->
   
   ### Tests
   
   <!-- List UT and IT cases to verify this change -->
   
   Add `org.apache.paimon.flink.source.ContinuousFileSplitEnumeratorTest#testEnumeratorWithCheckpoint` to verify the correctness of checkpoint.
   
   ### API and Format
   
   No.
   
   ### Documentation
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] liming30 commented on pull request #1562: [flink] fix the issue that the historical snapshot may be lost when Enumerator performs snapshotState

Posted by "liming30 (via GitHub)" <gi...@apache.org>.
liming30 commented on PR #1562:
URL: https://github.com/apache/incubator-paimon/pull/1562#issuecomment-1633753669

   I'm not sure if this #1507 is trying to fix this, but it looks like `handleSplitRequest` and `processDiscoveredSplits` both run in a `coordinatorExecutor` and there shouldn't be a problem with thread conflicts.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] JingsongLi commented on pull request #1562: [flink] fix the issue that the historical snapshot may be lost when Enumerator performs snapshotState

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #1562:
URL: https://github.com/apache/incubator-paimon/pull/1562#issuecomment-1633762692

   @liming30 Really Thanks! This is a new bug!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] JingsongLi merged pull request #1562: [flink] fix the issue that the historical snapshot may be lost when Enumerator performs snapshotState

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #1562:
URL: https://github.com/apache/incubator-paimon/pull/1562


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org