You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2015/10/01 16:40:28 UTC
[jira] [Updated] (KYLIN-980) FactDistinctColumnsJob to support high
cardinality columns
[ https://issues.apache.org/jira/browse/KYLIN-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liyang updated KYLIN-980:
-------------------------
Summary: FactDistinctColumnsJob to support high cardinality columns (was: FactDistinctColumnsJob need be optimized to support high cardinality columns)
> FactDistinctColumnsJob to support high cardinality columns
> ----------------------------------------------------------
>
> Key: KYLIN-980
> URL: https://issues.apache.org/jira/browse/KYLIN-980
> Project: Kylin
> Issue Type: Improvement
> Affects Versions: v0.7.2
> Reporter: Shaofeng SHI
> Assignee: Shaofeng SHI
>
> In FactDistinctColumnsJob's combiner and reducer, it uses a HashSet to remove the duplicated values; But if a column's cardinality is very big, say > 10 Million, it may reports OutOfMemory error;
> It should be enhanced to support such case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)