You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Attila Doroszlai (Jira)" <ji...@apache.org> on 2023/02/16 21:43:00 UTC
[jira] [Updated] (HDDS-7983) Intermittent OutOfMemoryError in TestOzoneRpcClientWithRatis#testUploadWithStreamAndMemoryMappedBuffer
[ https://issues.apache.org/jira/browse/HDDS-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Attila Doroszlai updated HDDS-7983:
-----------------------------------
Description:
{code}
[INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
[ERROR] java.lang.OutOfMemoryError: Java heap space
{code}
* https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
Dump from local run:
{code}
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
at org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
at org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
at org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
at org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
at org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
{code}
CC [~szetszwo]
was:
{code}
[INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
[ERROR] java.lang.OutOfMemoryError: Java heap space
{code}
* https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
* https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
Dump from local run:
{code}
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
at org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
at org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
at org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
at org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
at org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
{code}
> Intermittent OutOfMemoryError in TestOzoneRpcClientWithRatis#testUploadWithStreamAndMemoryMappedBuffer
> ------------------------------------------------------------------------------------------------------
>
> Key: HDDS-7983
> URL: https://issues.apache.org/jira/browse/HDDS-7983
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Client
> Affects Versions: 1.4.0
> Reporter: Attila Doroszlai
> Priority: Critical
>
> {code}
> [INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
> [ERROR] java.lang.OutOfMemoryError: Java heap space
> {code}
> * https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
> * https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
> * https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
> * https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
> Dump from local run:
> {code}
> java.lang.OutOfMemoryError: Java heap space
> at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
> at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
> at org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
> at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
> at org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
> at org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
> at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
> at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
> at org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
> at org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
> at org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
> at org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
> {code}
> CC [~szetszwo]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org