You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2018/04/18 06:57:00 UTC

[jira] [Created] (KYLIN-3342) Cubing level calculation inconsistent?

liyang created KYLIN-3342:
-----------------------------

             Summary: Cubing level calculation inconsistent?
                 Key: KYLIN-3342
                 URL: https://issues.apache.org/jira/browse/KYLIN-3342
             Project: Kylin
          Issue Type: Bug
            Reporter: liyang


Got below exception during cube build.

{{ Caused by: java.lang.IndexOutOfBoundsException: Index: 7, Size: 7}}
{{ at java.util.ArrayList.rangeCheck(ArrayList.java:635)}}
{{ at java.util.ArrayList.get(ArrayList.java:411)}}
{{ at org.apache.kylin.engine.mr.common.CubeStatsReader.estimateLayerSize(SourceFile:280)}}
{{ at org.apache.kylin.engine.spark.SparkCubingByLayer.estimateRDDPartitionNum(SourceFile:219)}}
{{ at org.apache.kylin.engine.spark.SparkCubingByLayer.execute(SourceFile:199)}}
{{ at org.apache.kylin.common.util.AbstractApplication.execute(SourceFile:37)}}
{{ ... 6 more}}

 

Found two way of calculating the level of cuboids
 * via CuboidScheduler.getBuildLevel()
 * via CuboidUtil.getLongestDepth(...)

We should settle down on one approach.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)