[jira] [Created] (DRILL-8483) SpilledRecordBatch memory leak when the program threw an exception during the process of building a hash table

["shihuafeng (Jira)" <ji...@apache.org>]

shihuafeng created DRILL-8483:
---------------------------------

             Summary: SpilledRecordBatch memory leak when the program threw an exception during the process of building a hash table
                 Key: DRILL-8483
                 URL: https://issues.apache.org/jira/browse/DRILL-8483
             Project: Apache Drill
          Issue Type: Bug
          Components:  Server
    Affects Versions: 1.21.1
            Reporter: shihuafeng
             Fix For: 1.21.2


During the process of reading data from disk to building hash tables in memory, if an exception is thrown, it will result in a memory  SpilledRecordBatch leak

exception log as following
{code:java}
Caused by: org.apache.drill.exec.exception.OutOfMemoryException: Unable to allocate buffer of size 8192 due to memory limit (41943040). Current allocation: 3684352
        at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:241)
        at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:216)
        at org.apache.drill.exec.vector.VarCharVector.allocateNew(VarCharVector.java:411)
        at org.apache.drill.exec.vector.NullableVarCharVector.allocateNew(NullableVarCharVector.java:270)
        at org.apache.drill.exec.physical.impl.common.HashPartition.allocateNewVectorContainer(HashPartition.java:215)
        at org.apache.drill.exec.physical.impl.common.HashPartition.allocateNewCurrentBatchAndHV(HashPartition.java:238)
        at org.apache.drill.exec.physical.impl.common.HashPartition.<init>(HashPartition.java:165){code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)