You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/06/30 12:23:00 UTC
[jira] [Commented] (KYLIN-2662) NegativeArraySizeException in
"Extract Fact Table Distinct Columns"
[ https://issues.apache.org/jira/browse/KYLIN-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528675#comment-16528675 ]
ASF subversion and git services commented on KYLIN-2662:
--------------------------------------------------------
Commit 75d6c9427ef8455406553389d181343ff2a9e838 in kylin's branch refs/heads/sync from Li Yang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=75d6c94 ]
KYLIN-2662 fix NegativeArraySizeException in TrieDictionaryForest
> NegativeArraySizeException in "Extract Fact Table Distinct Columns"
> -------------------------------------------------------------------
>
> Key: KYLIN-2662
> URL: https://issues.apache.org/jira/browse/KYLIN-2662
> Project: Kylin
> Issue Type: Bug
> Reporter: liyang
> Assignee: liyang
> Priority: Major
> Labels: scope
>
> The full exception. The root cause suspect to be a cell goes over 32 KB. Need verification and fix.
> {code}
> java.lang.NegativeArraySizeException
> at org.apache.kylin.dict.TrieDictionary.getValueBytesFromIdWithoutCache(SourceFile:239)
> at org.apache.kylin.dict.TrieDictionaryForestBuilder.addTree(SourceFile:134)
> at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(SourceFile:110)
> at org.apache.kylin.dict.DictionaryGenerator$StringTrieDictForestBuilder.build(SourceFile:218)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(SourceFile:231)
> at org.apache.kylin.engine.mr.KylinReducer.cleanup(SourceFile:71)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)