You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@carbondata.apache.org by "kumar vishal (JIRA)" <ji...@apache.org> on 2016/12/20 06:37:58 UTC

[jira] [Created] (CARBONDATA-545) Carbon Query GC Problem

kumar vishal created CARBONDATA-545:
---------------------------------------

             Summary: Carbon Query GC Problem
                 Key: CARBONDATA-545
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-545
             Project: CarbonData
          Issue Type: Improvement
          Components: data-query
            Reporter: kumar vishal
            Assignee: kumar vishal
             Fix For: 1.0.0-incubating


Problem
There are lots of gc when carbon is processing more number of records during query, which is impacting carbon query performance.To solve this gc problem happening when query output is too huge or when more number of records are processed.

Solution
Currently we are storing all the data which is read during query from carbon data file in heap, when number of query output is huge it is causing more gc. Instead of storing in heap we can store this data in offheap and will clear when scanning is finished for that query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)