You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "aliehsaeedii (via GitHub)" <gi...@apache.org> on 2026/07/27 19:00:32 UTC

[PR] KAFKA-20413: Add list-value store format and headers round-trip tests [3/3] [kafka]

aliehsaeedii opened a new pull request, #22967:
URL: https://github.com/apache/kafka/pull/22967

   ## Summary
   
   Test-only. Adds direct coverage for the changelog encoding introduced in #22961, and fills a
   pre-existing gap in `ListValueStore` coverage. No production code changes.
   
   > ⚠️ **Stacked on #22961.** Until that merges, the diff shown here against `trunk` also contains
   > #22961's changes. The changes belonging to *this* PR are only the 3 test files listed below.
   >
   > This PR must merge **after** #22961: `ListValueStoreUpgradeUtilsTest` calls the split/join
   > methods added there.
   
   ## Why this is a separate PR
   
   #22961 deliberately kept itself reviewable as a self-contained format change, which meant
   `ListValueStoreUpgradeUtils` — its largest file — landed with only transitive coverage through its
   two callers, and no negative or byte-level tests. This PR closes that gap, so it is worth merging
   promptly after #22961 rather than letting it drift.
   
   ## Changes
   
   - **`ListValueStoreUpgradeUtilsTest`** — direct coverage of the encoding:
     - the PLAIN → HEADERS blob conversion, including the right-side value that used to be silently
       truncated (`right` → `ight`) and the left-side value that used to throw
       `SerializationException: negative length -1`;
     - the `split`/`join` pair, asserting the split output is byte-identical to what a PLAIN store
       would have written — the property that makes downgrade safe;
     - the exact wire layout: the **zigzag** `headersSize` varint, and one `0x00` per element with no
       headers;
     - duplicate header keys across different list elements (safe because record headers are a list,
       not a map);
     - tombstones, empty lists, and absent control headers (the legacy case, which must be identical
       to all-empty prefixes);
     - independence from record-header *ordering* — `ProcessorContextImpl#logChange` appends the
       consistency vector clock to the same `Headers` instance the store passes to `log()`, so the
       encoding must not depend on position;
     - the error paths: too few prefixes for the element count, trailing prefix bytes, and a
       `headersSize` longer than the element. There were no `assertThrows` anywhere in the encoding's
       coverage before this.
   - **`ListValueStoreTest`** — parametrize the existing list/iterator invariants (ordering,
     tombstones, delete-during-iterate, closed-iterator semantics) over both plain and
     headers-embedding value serdes.
   - **`ListValueStoreWithHeadersTest`** — assert per-record headers and timestamps survive a
     round-trip through the builder → metered → change-logger → `ListValueStore` pipeline, including
     duplicate keys with different headers and the empty-headers case.
   
   ## Testing
   
   42 tests, all passing. Checkstyle passes.
   
   ## Relationship to the other PRs
   
   | PR | scope | changes behaviour? |
   |---|---|---|
   | **#22961** | storage + changelog format | no — nothing constructs it |
   | **#22966** | DSL wiring + non-joined emit | yes — the switch |
   | **this one** | tests only | no |
   
   Independent of #22966 — the two can be reviewed in parallel and merged in either order once
   #22961 lands.
   
   ## Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   
   Reviewers: Matthias J. Sax <ma...@confluent.io>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-20413: Add list-value store format and headers round-trip tests [3/3] [kafka]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #22967:
URL: https://github.com/apache/kafka/pull/22967#issuecomment-5262041311

   A label of 'needs-attention' was automatically added to this PR in order to raise the
   attention of the committers. Once this issue has been triaged, the `triage` label
   should be removed to prevent this automation from happening again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-21263: Add list-value store format and headers round-trip tests [3/3] [kafka]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #22967:
URL: https://github.com/apache/kafka/pull/22967#issuecomment-6307229294

   A label of 'needs-attention' was automatically added to this PR in order to raise the
   attention of the committers. Once this issue has been triaged, the `triage` label
   should be removed to prevent this automation from happening again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org