You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Jacky Li (JIRA)" <ji...@apache.org> on 2017/06/22 01:29:00 UTC

[jira] [Resolved] (CARBONDATA-1212) Memory leak in case of compaction when unsafe is true

     [ https://issues.apache.org/jira/browse/CARBONDATA-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-1212.
----------------------------------
    Resolution: Fixed

> Memory leak in case of compaction when unsafe is true
> -----------------------------------------------------
>
>                 Key: CARBONDATA-1212
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1212
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>             Fix For: 1.2.0
>
>         Attachments: data.csv
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> In case of compaction, queryExecutor object is formed for multiple blocks but the objects are not retained and finish method is called only on the last instance created for query executor. Due to this the memory allocated to precious objects is not released which can lead to out of memory issue.
> Steps to reproduce:
> ----------------------------------
> CREATE TABLE IF NOT EXISTS t3 (ID Int, date Date, country String, name String, phonetype String, serialname char(10), salary Int) STORED BY 'carbondata' TBLPROPERTIES('DICTIONARY_EXCLUDE'='name')
> LOAD DATA LOCAL INPATH 'data.csv' into table t3
> LOAD DATA LOCAL INPATH 'data.csv' into table t3
> alter table t3 compact 'major'



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)