You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Venkata Ramana G (JIRA)" <ji...@apache.org> on 2018/07/23 05:54:00 UTC
[jira] [Resolved] (CARBONDATA-2760) Reduce Memory footprint and
store size for local dictionary encoded columns
[ https://issues.apache.org/jira/browse/CARBONDATA-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Venkata Ramana G resolved CARBONDATA-2760.
------------------------------------------
Resolution: Fixed
Fix Version/s: 1.4.1
> Reduce Memory footprint and store size for local dictionary encoded columns
> ---------------------------------------------------------------------------
>
> Key: CARBONDATA-2760
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2760
> Project: CarbonData
> Issue Type: Improvement
> Reporter: kumar vishal
> Assignee: kumar vishal
> Priority: Major
> Fix For: 1.4.1
>
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> *Problem*
> # Local dictionary encoded page is using unsafevarlenghtcolumn column page which internally maintains offset of each value in another column page because of this memory footprint is high.
> # for complex primitive string data type column page while compressing, it is converting to LV even if it is encoded with dictionary values, because of this store size is high.
> *Solution:*
> # Use UnsafeFixedLength Column page for local dictionary encoded columns
> # No need to convert to LV during query if local dictionary is present so use UnsafeFixLength Column page
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)