You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JingsongLi (via GitHub)" <gi...@apache.org> on 2026/07/31 03:51:08 UTC

[PR] [core] Fix index source metadata compatibility [paimon]

JingsongLi opened a new pull request, #8952:
URL: https://github.com/apache/paimon/pull/8952

   ## What changed
   
   - Bump the commit message serializer to version 12 and route version 11 through a legacy five-field `GlobalIndexMeta` deserializer.
   - Bump the index manifest entry serializer to version 2 and read version 1 entries with the original five-field nested row.
   - Add binary regression coverage for old version 11 committables and current `sourceMeta` round trips.
   
   ## Why
   
   `sourceMeta` was added to the nested `GlobalIndexMeta` row without upgrading its enclosing serializer versions. Calling `getRow(..., 6)` constructs a `NestedRow` whose arity is always six, so `getFieldCount()` cannot identify older five-field data and bytes from the variable-length section can be misread as `sourceMeta`. The existing compatibility equality assertion did not catch this because `IndexFileMeta.equals` does not compare `globalIndexMeta`.
   
   ## Impact
   
   Existing version 11 commit messages and version 1 index manifest entries now deserialize with a null `sourceMeta`, while new data preserves the field.
   
   ## Tests
   
   `mvn -o -pl paimon-core -am -Pfast-build -DfailIfNoTests=false -DwildcardSuites=none -Dtest=ManifestCommittableSerializerCompatibilityTest,IndexManifestEntrySerializerTest,IndexFileMetaSerializerTest,CommitMessageSerializerTest test`
   
   All 21 targeted tests passed after rebasing onto `origin/master`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Fix index source metadata compatibility [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #8952:
URL: https://github.com/apache/paimon/pull/8952


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org