You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "kumar vishal (JIRA)" <ji...@apache.org> on 2018/07/19 16:06:00 UTC

[jira] [Created] (CARBONDATA-2760) Reduce Memory footprint and store size for local dictionary encoded columns

kumar vishal created CARBONDATA-2760:
----------------------------------------

             Summary: Reduce Memory footprint and store size for local dictionary encoded columns
                 Key: CARBONDATA-2760
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2760
             Project: CarbonData
          Issue Type: Improvement
            Reporter: kumar vishal
            Assignee: kumar vishal


*Problem*
 # Local dictionary encoded page is using unsafevarlenghtcolumn column page which internally maintains offset of each value in another column page because of this memory footprint is high.
 # for complex primitive string data type column page while compressing, it is converting to LV even if it is encoded with dictionary values, because of this store size is high.

*Solution:*
 # Use UnsafeFixedLength Column page for local dictionary encoded columns
 # No need to convert to LV during query if local dictionary is present so use UnsafeFixLength Column page



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)