You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JQ-Cao (via GitHub)" <gi...@apache.org> on 2025/11/28 03:36:33 UTC

[PR] [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled [paimon]

JQ-Cao opened a new pull request, #6699:
URL: https://github.com/apache/paimon/pull/6699

   ### Purpose
   
   Linked issue: close #6698
   
   If the table is dv enabled or using first-row as merge engine, DataTableBatchScan filters out records with level = 0. This breaks incremental queries using the input changelog producer, as changelog entries are incorrectly excluded. This change ensures changelog records are preserved in such scenarios.
   
   ### Tests
   
   IncrementalTableTest#testIncrementalWithInputChangeLogAndMoW: Added in the PR.
   
   ### API and Format
   
   No API changes.
   No storage format changes.
   
   ### Documentation
   
   None


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #6699:
URL: https://github.com/apache/paimon/pull/6699#issuecomment-4527203833

   The right solution should be fixing incremental query to not skip level 0.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled [paimon]

Posted by "pratheekrebala (via GitHub)" <gi...@apache.org>.
pratheekrebala commented on PR #6699:
URL: https://github.com/apache/paimon/pull/6699#issuecomment-3745562606

   Hi @JingsongLi, we're running into this issue when working with CDC logs..any chance you could take a look at this PR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed pull request #6699: [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled
URL: https://github.com/apache/paimon/pull/6699


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Fix incremental query unable to read changelog when batchScanSkipLevel0 is enabled [paimon]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #6699:
URL: https://github.com/apache/paimon/pull/6699#issuecomment-4402159824

   This pull request has had no activity for 90 days. If you'd like to keep it open, please push a new commit or leave a comment. Thanks for the contribution.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org