You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "JiangYang (Jira)" <ji...@apache.org> on 2021/07/16 03:48:00 UTC
[jira] [Commented] (KYLIN-5035) Fix Merge Cuboid Statistics
EOFException
[ https://issues.apache.org/jira/browse/KYLIN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381712#comment-17381712 ]
JiangYang commented on KYLIN-5035:
----------------------------------
*
cause by two task write to one file fix by disable speculation.
> Fix Merge Cuboid Statistics EOFException
> ----------------------------------------
>
> Key: KYLIN-5035
> URL: https://issues.apache.org/jira/browse/KYLIN-5035
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine, Spark Engine
> Reporter: JiangYang
> Assignee: JiangYang
> Priority: Major
>
> org.apache.kylin.job.exception.ExecuteException: java.io.EOFException at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) at org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:197) at java.io.DataInputStream.readFully(DataInputStream.java:169) at org.apache.hadoop.io.SequenceFile\$Reader.init(SequenceFile.java:1918) at org.apache.hadoop.io.SequenceFile\$Reader.initialize(SequenceFile.java:1883) at org.apache.hadoop.io.SequenceFile\$Reader.(SequenceFile.java:1832) at org.apache.kylin.engine.mr.common.CubeStatsReader\$CubeStatsResult.(CubeStatsReader.java:484) at org.apache.kylin.engine.mr.common.CubeStatsReader.(CubeStatsReader.java:133) at org.apache.kylin.engine.mr.steps.MergeStatisticsWithOldStep.doWork(MergeStatisticsWithOldStep.java:97) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) ... 6 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)