You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "shfshihuafeng (via GitHub)" <gi...@apache.org> on 2024/03/24 14:49:36 UTC
[PR] DRILL-8485: HashJoinPOP memory leak is caused by an oom exception whe… (drill)
shfshihuafeng opened a new pull request, #2891:
URL: https://github.com/apache/drill/pull/2891
…n read data from InputStream
# [DRILL-8485](https://issues.apache.org/jira/browse/DRILL-8485): HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
## Description
it is similar to [DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484)
**exception info**
```
Caused by: org.apache.drill.exec.exception.OutOfMemoryException: Unable to allocate buffer of size 16384 (rounded from 15364) due to memory limit (41943040). Current allocation: 4337664
at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:241)
at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:216)
at org.apache.drill.exec.memory.BaseAllocator.read(BaseAllocator.java:856)
```
**leak info**
```
Allocator(frag:5:1) 5000000/1000000/27824128/40041943040 (res/actual/peak/limit)
child allocators: 1
Allocator(op:5:1:1:HashJoinPOP) 1000000/16384/22822912/41943040 (res/actual/peak/limit)
child allocators: 0
ledgers: 2
ledger[442780] allocator: op:5:1:1:HashJoinPOP), isOwning: true, size: 8192, references: 2, life: 4486836603491..0, allocatorManager: [390894, life: 4486836601180..0] holds 4 buffers.
DrillBuf[458469], udle: [390895 1024..8192]
event log for: DrillBuf[458469]
```
## Documentation
(Please describe user-visible changes similar to what should appear in the Drill documentation.)
## Testing
The testing method for drill-8485 is the similar as for [DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484). we can throw exception in the method readVectors
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] DRILL-8485: HashJoinPOP memory leak is caused by an oom exception whe… (drill)
Posted by "shfshihuafeng (via GitHub)" <gi...@apache.org>.
shfshihuafeng commented on PR #2891:
URL: https://github.com/apache/drill/pull/2891#issuecomment-2017129746
> LGTM +1 Thanks @shfshihuafeng for all these memory leak fixes.
I am honored to get your approved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] DRILL-8485: HashJoinPOP memory leak is caused by an oom exception whe… (drill)
Posted by "cgivre (via GitHub)" <gi...@apache.org>.
cgivre merged PR #2891:
URL: https://github.com/apache/drill/pull/2891
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org