You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "yushi (Jira)" <ji...@apache.org> on 2021/09/02 08:37:00 UTC
[jira] [Commented] (KYLIN-5065) error when
TrieDictionaryForestBuilder.build
[ https://issues.apache.org/jira/browse/KYLIN-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408681#comment-17408681 ]
yushi commented on KYLIN-5065:
------------------------------
can you share The detailed log about KYLIN, such as kylin.log.
You can see yarn's log or MR's log to find something about The ERROR
> error when TrieDictionaryForestBuilder.build
> --------------------------------------------
>
> Key: KYLIN-5065
> URL: https://issues.apache.org/jira/browse/KYLIN-5065
> Project: Kylin
> Issue Type: Bug
> Components: Measure - Count Distinct
> Affects Versions: v3.1.2
> Reporter: andy peng
> Priority: Blocker
>
> when i build my cube,an error appeared, but the same cube built succeed in test environment.
> i dont konw why.
> who can help me. thank you very much.
> my kylin version is 3.1.2 , the latest version .
> Job Error Details
> |*Error Step* |Extract Fact Table Distinct Columns|
> |*MR Job* |job_1628056838389_5692|
>
> error information:
> org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117) at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211) at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) at org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Caused by: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117) at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211) at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) ... 6 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)