You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/12/07 08:31:00 UTC
[jira] [Commented] (KYLIN-4283) FileNotFound error in "Garbage
Collection" step should not break cube building.
[ https://issues.apache.org/jira/browse/KYLIN-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990398#comment-16990398 ]
ASF subversion and git services commented on KYLIN-4283:
--------------------------------------------------------
Commit 8d335ebdc9498f87945d4e3ddaa2ad28fcc2397d in kylin's branch refs/heads/master from Zhou Kang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8d335eb ]
KYLIN-4283: return SUCCEED while IOException happend in GarbageCollectionStep
> FileNotFound error in "Garbage Collection" step should not break cube building.
> -------------------------------------------------------------------------------
>
> Key: KYLIN-4283
> URL: https://issues.apache.org/jira/browse/KYLIN-4283
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Reporter: ZhouKang
> Assignee: ZhouKang
> Priority: Minor
> Fix For: v3.0.0, v2.6.5
>
>
>
> Job failed because of FileNotFound.
> I think Garbage Collection failed should not make the build job failed
> {code:java}
> // code placeholder
> java.io.FileNotFoundException: File /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-ff3f6fc3-2211-3593-1ba4-9b5326a05258/cube does not exist.
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:773)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:113)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:831)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:827)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:838)
> at org.apache.kylin.storage.hbase.steps.HDFSPathGarbageCollectionStep.dropHdfsPathOnCluster(HDFSPathGarbageCollectionStep.java:95)
> at org.apache.kylin.storage.hbase.steps.HDFSPathGarbageCollectionStep.doWork(HDFSPathGarbageCollectionStep.java:65)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)