You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "yushi (Jira)" <ji...@apache.org> on 2021/09/02 08:37:00 UTC

[jira] [Commented] (KYLIN-5065) error when TrieDictionaryForestBuilder.build

    [ https://issues.apache.org/jira/browse/KYLIN-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408681#comment-17408681 ] 

yushi commented on KYLIN-5065:
------------------------------

can you share The detailed log about KYLIN, such as  kylin.log.

You can see yarn's  log or MR's log to find something about The ERROR

> error when TrieDictionaryForestBuilder.build
> --------------------------------------------
>
>                 Key: KYLIN-5065
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5065
>             Project: Kylin
>          Issue Type: Bug
>          Components: Measure - Count Distinct
>    Affects Versions: v3.1.2
>            Reporter: andy peng
>            Priority: Blocker
>
> when i build my cube,an error appeared, but the same cube built succeed in test environment.
> i dont konw why. 
> who can help me. thank you very much.
>  my  kylin version  is 3.1.2 , the latest version .
> Job Error Details
> |*Error Step* |Extract Fact Table Distinct Columns|
> |*MR Job* |job_1628056838389_5692|
>  
> error information:
> org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees        at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)        at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)        at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)        at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163)        at java.security.AccessController.doPrivileged(Native Method)        at javax.security.auth.Subject.doAs(Subject.java:422)        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)          at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)        at org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238)        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)        at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)        at java.lang.Thread.run(Thread.java:748)Caused by: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees        at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)        at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)        at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)        at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163)        at java.security.AccessController.doPrivileged(Native Method)        at javax.security.auth.Subject.doAs(Subject.java:422)        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)          at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235)        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)        ... 6 more



--
This message was sent by Atlassian Jira
(v8.3.4#803005)