[jira] [Comment Edited] (KYLIN-3667) ArrayIndexOutOfBoundsException in NDCuboidBuilder

["Hubert STEFANI (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676487#comment-16676487 ] 

Hubert STEFANI edited comment on KYLIN-3667 at 11/6/18 10:49 AM:
-----------------------------------------------------------------

I have uploaded the cube json definition

 


was (Author: hstefani):
I have uploaded the cube json definition




-- 

<http://www.novagen.tech/>
*Hubert STEFANI*
*B* : +33 1 76 21 55 40 | +33 3 59 56 16 30 | *P* : + 33 6 20 75 43 68 | *M*
: hstefani@novagen.tech
Paris La Défense, Les Collines de l’Arche, Immeuble Opéra E
Lille Flandres , 14 rue du Vieux Faubourg
[image: FACEBOOK] <https://www.facebook.com/novagenconseil/> [image:
LINKEDIN] <https://www.linkedin.com/company/novagen-conseil/> [image:
YOUTUBE] <https://www.youtube.com/channel/UC9FUgNCkoiddPmqLvea_apQ> [image:
TWITTER] <https://twitter.com/NovagenConseil> [image: INSTAGRAM]
<https://www.instagram.com/novagen_conseil/?hl=fr> This email may be
confidential or privileged. If you received this communication by mistake,
please don't forward it to anyone else, please erase all copies and
attachments, and please let me know that it went to the wrong person. Thank
you.



<https://www.linkedin.com/company/10980670/>


> ArrayIndexOutOfBoundsException in NDCuboidBuilder
> -------------------------------------------------
>
>                 Key: KYLIN-3667
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3667
>             Project: Kylin
>          Issue Type: Bug
>          Components: Spark Engine
>    Affects Versions: v2.5.0
>         Environment: AWS EMR 
>            Reporter: Hubert STEFANI
>            Priority: Major
>         Attachments: cube.json
>
>
> The former errors
> https://issues.apache.org/jira/browse/KYLIN-3115
> and
> https://issues.apache.org/jira/browse/KYLIN-1768
> still remain in step SparkCubingByLayer.
> we encounter the following error : 
> java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
>  at org.apache.kylin.engine.mr.common.NDCuboidBuilder.buildKeyInternal(NDCuboidBuilder.java:106)
>  at org.apache.kylin.engine.mr.common.NDCuboidBuilder.buildKey2(NDCuboidBuilder.java:87)
>  at org.apache.kylin.engine.spark.SparkCubingByLayer$CuboidFlatMap.call(SparkCubingByLayer.java:425)
>  at org.apache.kylin.engine.spark.SparkCubingByLayer$CuboidFlatMap.call(SparkCubingByLayer.java:370)
>  at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$3$1.apply(JavaRDDLike.scala:143)
>  at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$3$1.apply(JavaRDDLike.scala:143)
>  at scala.collection.Iterator$$anon$12.nextCur(Iterator.scala:434)
>  at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:440)
>  at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
>  at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:63)
>  at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:96)
>  at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
>  at org.apache.spark.scheduler.Task.run(Task.scala:99)
>  at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  
> Do we have to (painfully) change dimensions size or should it be fixed through a patch ?
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)