[jira] [Created] (KYLIN-2662) NegativeArraySizeException in "Extract Fact Table Distinct Columns"

["liyang (JIRA)" <ji...@apache.org>]

liyang created KYLIN-2662:
-----------------------------

             Summary: NegativeArraySizeException in "Extract Fact Table Distinct Columns"
                 Key: KYLIN-2662
                 URL: https://issues.apache.org/jira/browse/KYLIN-2662
             Project: Kylin
          Issue Type: Bug
            Reporter: liyang


The full exception. The root cause suspect to be a cell goes over 32 KB. Need verification and fix.

{code}
java.lang.NegativeArraySizeException
                at org.apache.kylin.dict.TrieDictionary.getValueBytesFromIdWithoutCache(SourceFile:239)
                at org.apache.kylin.dict.TrieDictionaryForestBuilder.addTree(SourceFile:134)
                at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(SourceFile:110)
                at org.apache.kylin.dict.DictionaryGenerator$StringTrieDictForestBuilder.build(SourceFile:218)
                at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(SourceFile:231)
                at org.apache.kylin.engine.mr.KylinReducer.cleanup(SourceFile:71)
                at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)
                at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
                at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
                at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
                at java.security.AccessController.doPrivileged(Native Method)
                at javax.security.auth.Subject.doAs(Subject.java:415)
                at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
                at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)