You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "dyingjiecai (Jira)" <ji...@apache.org> on 2025/07/04 16:21:00 UTC
[jira] [Updated] (KAFKA-19472) A BufferOverflowException is thrown by RemoteLogManager when FetchApiVersion <= 2
[ https://issues.apache.org/jira/browse/KAFKA-19472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dyingjiecai updated KAFKA-19472:
--------------------------------
Description:
RemoteLogReader throws a BufferOverflowException when FetchApi version <= 2 and firstBatchSize exceeds max.partition.fetch.bytes
Exception Message
{code:java}
[2025-07-04 16:11:42,910] ERROR Error occurred while reading the remote data for remote-storage-perf-5-0 (kafka.log.remote.RemoteLogReader)
java.nio.BufferOverflowException
at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1007)
at java.base/java.nio.HeapByteBuffer.put(HeapByteBuffer.java:243)
at org.apache.kafka.common.record.DefaultRecordBatch.writeTo(DefaultRecordBatch.java:236)
at kafka.log.remote.RemoteLogManager.read(RemoteLogManager.java:1647)
at kafka.log.remote.RemoteLogReader.lambda$call$0(RemoteLogReader.java:66)
at com.yammer.metrics.core.Timer.time(Timer.java:91)
at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:66)
at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:36)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:842)
{code}
firstBatch.writeTo(buffer) will throw BufferOverflowException when firstBatch size is larger than the size of buffer passed to the method
was:
RemoteLogReader throws a BufferOverflowException when FetchApi version <= 2 and firstBatchSize exceeds max.partition.fetch.bytes
Exception Message
{code:java}
[2025-07-04 16:11:42,910] ERROR Error occurred while reading the remote data for remote-storage-perf-5-0 (kafka.log.remote.RemoteLogReader)
java.nio.BufferOverflowException
at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1007)
at java.base/java.nio.HeapByteBuffer.put(HeapByteBuffer.java:243)
at org.apache.kafka.common.record.DefaultRecordBatch.writeTo(DefaultRecordBatch.java:236)
at kafka.log.remote.RemoteLogManager.read(RemoteLogManager.java:1647)
at kafka.log.remote.RemoteLogReader.lambda$call$0(RemoteLogReader.java:66)
at com.yammer.metrics.core.Timer.time(Timer.java:91)
at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:66)
at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:36)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:842)
{code}
firstBatch.writeTo(buffer) will throw BufferOverflowException when firstBatch size is larger then size of buffer
> A BufferOverflowException is thrown by RemoteLogManager when FetchApiVersion <= 2
> ---------------------------------------------------------------------------------
>
> Key: KAFKA-19472
> URL: https://issues.apache.org/jira/browse/KAFKA-19472
> Project: Kafka
> Issue Type: Bug
> Components: log
> Affects Versions: 3.9.0
> Environment: BrokerVersion 3.9.1
> ClientVersion 0.10.0.0
> Reporter: dyingjiecai
> Priority: Major
> Attachments: 1280X1280 (1).PNG
>
>
> RemoteLogReader throws a BufferOverflowException when FetchApi version <= 2 and firstBatchSize exceeds max.partition.fetch.bytes
> Exception Message
> {code:java}
> [2025-07-04 16:11:42,910] ERROR Error occurred while reading the remote data for remote-storage-perf-5-0 (kafka.log.remote.RemoteLogReader)
> java.nio.BufferOverflowException
> at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1007)
> at java.base/java.nio.HeapByteBuffer.put(HeapByteBuffer.java:243)
> at org.apache.kafka.common.record.DefaultRecordBatch.writeTo(DefaultRecordBatch.java:236)
> at kafka.log.remote.RemoteLogManager.read(RemoteLogManager.java:1647)
> at kafka.log.remote.RemoteLogReader.lambda$call$0(RemoteLogReader.java:66)
> at com.yammer.metrics.core.Timer.time(Timer.java:91)
> at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:66)
> at kafka.log.remote.RemoteLogReader.call(RemoteLogReader.java:36)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> at java.base/java.lang.Thread.run(Thread.java:842)
> {code}
> firstBatch.writeTo(buffer) will throw BufferOverflowException when firstBatch size is larger than the size of buffer passed to the method
--
This message was sent by Atlassian Jira
(v8.20.10#820010)