[jira] [Comment Edited] (KAFKA-10173) BufferUnderflowException during Kafka Streams Upgrade

["John Roesler (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140865#comment-17140865 ] 

John Roesler edited comment on KAFKA-10173 at 6/19/20, 10:29 PM:
-----------------------------------------------------------------

[~rhauch] and [~mjsax] , you can consider my last comment for yourselves, but it doesn't seem like this would need to block 2.6.0. The code in question doesn't seem to have changed since 2.4.0.


was (Author: vvcephei):
[~rhauch]and [~mjsax] , you can consider my last comment for yourselves, but it doesn't seem like this would need to block 2.6.0. The code in question doesn't seem to have changed since 2.4.0.

> BufferUnderflowException during Kafka Streams Upgrade
> -----------------------------------------------------
>
>                 Key: KAFKA-10173
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10173
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 2.5.0
>            Reporter: Karsten Schnitter
>            Assignee: John Roesler
>            Priority: Blocker
>             Fix For: 2.5.1
>
>
> I migrated a Kafka Streams application from version 2.3.1 to 2.5.0. I followed the steps described in the upgrade guide and set the property {{migrate.from=2.3}}. On my dev system with just one running instance I got the following exception:
> {noformat}
> stream-thread [0-StreamThread-2] Encountered the following error during processing:
> java.nio.BufferUnderflowException: null
> 	at java.base/java.nio.HeapByteBuffer.get(Unknown Source)
> 	at java.base/java.nio.ByteBuffer.get(Unknown Source)
> 	at org.apache.kafka.streams.state.internals.BufferValue.extractValue(BufferValue.java:94)
> 	at org.apache.kafka.streams.state.internals.BufferValue.deserialize(BufferValue.java:83)
> 	at org.apache.kafka.streams.state.internals.InMemoryTimeOrderedKeyValueBuffer.restoreBatch(InMemoryTimeOrderedKeyValueBuffer.java:368)
> 	at org.apache.kafka.streams.processor.internals.CompositeRestoreListener.restoreBatch(CompositeRestoreListener.java:89)
> 	at org.apache.kafka.streams.processor.internals.StateRestorer.restore(StateRestorer.java:92)
> 	at org.apache.kafka.streams.processor.internals.StoreChangelogReader.processNext(StoreChangelogReader.java:350)
> 	at org.apache.kafka.streams.processor.internals.StoreChangelogReader.restore(StoreChangelogReader.java:94)
> 	at org.apache.kafka.streams.processor.internals.TaskManager.updateNewAndRestoringTasks(TaskManager.java:401)
> 	at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:779)
> 	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:697)
> 	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:670)
> {noformat}
> I figured out, that this problem only occurs for stores, where I use the suppress feature. If I rename the changelog topics during the migration, the problem will not occur. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)