You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@paimon.apache.org by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2026/06/04 12:35:56 UTC

[PR] [flink] Support batch read/write for chain table [paimon]

yunfengzhou-hub opened a new pull request, #8122:
URL: https://github.com/apache/paimon/pull/8122

   ### Purpose                                                                                                                                
                                                                                                                                              
   Chain table currently only supports Spark for batch read/write. This PR adds Flink batch read/write support.                               
      
   The core chain table logic (ChainGroupReadTable, ChainSplit, ChainKeyValueFileReaderFactory, etc.) is entirely in paimon-core and shared between engines. Analysis shows that the standard Flink batch source path (StaticFileStoreSource → FileStoreSourceSplitGenerator → FileStoreSourceSplitReader) already handles ChainSplit transparently through the FallbackReadFileStoreTable wrapping, so no functional code changes are needed in the Flink module.                                                                                                 
   
   This PR:
   - Adds `FlinkChainTableITCase` with 4 integration tests covering daily chain table, hourly chain table (composite chain keys),
   - Updates chain table documentation to reflect Flink support and adds Flink SQL examples.
   
   ### Tests
   
   - `mvn -pl paimon-flink/paimon-flink-common -Dtest=FlinkChainTableITCase test`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [flink] Support batch read/write for chain table [paimon]

Posted by "wzhero1 (via GitHub)" <gi...@apache.org>.

wzhero1 commented on PR #8122:
URL: https://github.com/apache/paimon/pull/8122#issuecomment-4628848121

   LGTM


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [flink] Support batch read/write for chain table [paimon]

Posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org>.

yunfengzhou-hub merged PR #8122:
URL: https://github.com/apache/paimon/pull/8122


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org