[jira] [Resolved] (IMPALA-7145) Leak of memory from OpenSSL when spill-to-disk encryption is enabled

["Tim Armstrong (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong resolved IMPALA-7145.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.1.0
                   Impala 2.13.0

> Leak of memory from OpenSSL when spill-to-disk encryption is enabled
> --------------------------------------------------------------------
>
>                 Key: IMPALA-7145
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7145
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 2.0, Impala 2.3.0, Impala 2.5.0, Impala 2.4.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0, Impala 2.9.0, Impala 2.10.0, Impala 2.11.0, Impala 2.12.0, Impala 2.13.0, Impala 3.1.0, 2.2.0, 2.1.0
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Blocker
>              Labels: resource-management
>             Fix For: Impala 2.13.0, Impala 3.1.0
>
>
> I tried looping this test for a while to flush out a different issue and discovered a memory leak:
> {noformat}
> while impala-py.test tests/query_test/test_spilling.py -k naaj -n4 --verbose; do date; done
> {noformat}
> Eventually the test fails with "Memory Limit Exceeded" and there is a huge amount of untracked memory reported on /memz.
> I tried running the heap growth profiler and the only suspicious thing I saw was CRYPTO_malloc, similar to IMPALA-6792. My current hypothesis is that it's something related to disk spill encryption and we haven't noticed it before because we had disk spill encryption off.
> If I disable encryption "start-impala-cluster.py --impalad_args=--disk_spill_encryption=false" then I don't see the leak.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org