You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shao Feng Shi (Jira)" <ji...@apache.org> on 2019/12/07 08:31:00 UTC
[jira] [Updated] (KYLIN-4283) FileNotFound error in "Garbage
Collection" step should not break cube building.
[ https://issues.apache.org/jira/browse/KYLIN-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shao Feng Shi updated KYLIN-4283:
---------------------------------
Component/s: Job Engine
Fix Version/s: v2.6.5
v3.0.0
Issue Type: Improvement (was: Bug)
Priority: Minor (was: Major)
Summary: FileNotFound error in "Garbage Collection" step should not break cube building. (was: Job error because of FileNotFound in Step Garbage Collection)
> FileNotFound error in "Garbage Collection" step should not break cube building.
> -------------------------------------------------------------------------------
>
> Key: KYLIN-4283
> URL: https://issues.apache.org/jira/browse/KYLIN-4283
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Reporter: ZhouKang
> Assignee: ZhouKang
> Priority: Minor
> Fix For: v3.0.0, v2.6.5
>
>
>
> Job failed because of FileNotFound.
> I think Garbage Collection failed should not make the build job failed
> {code:java}
> // code placeholder
> java.io.FileNotFoundException: File /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-ff3f6fc3-2211-3593-1ba4-9b5326a05258/cube does not exist.
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:773)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:113)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:831)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:827)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:838)
> at org.apache.kylin.storage.hbase.steps.HDFSPathGarbageCollectionStep.dropHdfsPathOnCluster(HDFSPathGarbageCollectionStep.java:95)
> at org.apache.kylin.storage.hbase.steps.HDFSPathGarbageCollectionStep.doWork(HDFSPathGarbageCollectionStep.java:65)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)