You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "kumar vishal (JIRA)" <ji...@apache.org> on 2018/07/19 16:06:00 UTC
[jira] [Created] (CARBONDATA-2760) Reduce Memory footprint and
store size for local dictionary encoded columns
kumar vishal created CARBONDATA-2760:
----------------------------------------
Summary: Reduce Memory footprint and store size for local dictionary encoded columns
Key: CARBONDATA-2760
URL: https://issues.apache.org/jira/browse/CARBONDATA-2760
Project: CarbonData
Issue Type: Improvement
Reporter: kumar vishal
Assignee: kumar vishal
*Problem*
# Local dictionary encoded page is using unsafevarlenghtcolumn column page which internally maintains offset of each value in another column page because of this memory footprint is high.
# for complex primitive string data type column page while compressing, it is converting to LV even if it is encoded with dictionary values, because of this store size is high.
*Solution:*
# Use UnsafeFixedLength Column page for local dictionary encoded columns
# No need to convert to LV during query if local dictionary is present so use UnsafeFixLength Column page
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)