[jira] [Assigned] (KAFKA-20749) KStream-KStream outer/left join crashes under EOS with transactional state stores

["Bill Bejeck (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-20749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bill Bejeck reassigned KAFKA-20749:
-----------------------------------

    Assignee: Nicholas Telford  (was: Bill Bejeck)

> KStream-KStream outer/left join crashes under EOS with transactional state stores
> ---------------------------------------------------------------------------------
>
>                 Key: KAFKA-20749
>                 URL: https://issues.apache.org/jira/browse/KAFKA-20749
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 4.4.0
>            Reporter: Bill Bejeck
>            Assignee: Nicholas Telford
>            Priority: Blocker
>             Fix For: 4.4.0
>
>
> R{{{}ocksDBTransactionBuffer{}}}'s staging map ({{{}AbstractTransactionBuffer.pendingWrites{}}}) is keyed by key bytes only, with no column-family dimension. Writes to the offsets column family (the "position" key, written when the store persists its Position) are staged into that shared map and then surface in data-column-family range()/all() scans. The outer-join ListValueStore tries to  deserialize the 40-byte serialized Position as a value list and fails. The {{get()}} methods was already gated against the offsets CF; the iterator paths were not. Non-transactional stores write straight to the offsets CF and never leak, which is why it's transactional-only. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)