You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/03/19 16:01:30 UTC
[GitHub] [druid] dataedgehungary opened a new issue #9540: KILL TASK error -
failed to delete .../0_descriptor.json
dataedgehungary opened a new issue #9540: KILL TASK error - failed to delete .../0_descriptor.json
URL: https://github.com/apache/druid/issues/9540
### Affected Version
0.12.1 - HDP 3.1.4 install
### Description
Dear All,
I am trying to delete unused segment data from hdfs deep storage. I encounter a weird error and the kill task failes, with:
`2020-03-19T15:39:39,737 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[KillTask{id=kill_PONTMASTERDB.druid_vasarlas_2011068_2017-02-01T00:00:00.000Z_2017-03-01T00:00:00.000Z_2020-03-19T15:39:30.395Z, type=kill, dataSource=PONTMASTERDB.druid_vasarlas_2011068}]
io.druid.segment.loading.SegmentLoadingException: Unable to kill segment, failed to delete [hdfs://namenodeha/druid/segments/PONTMASTERDB.druid_vasarlas_2011068/20170201T000000.000Z_20170301T000000.000Z/2020-03-13T10_14_25.197+01_00/0_descriptor.json]
at io.druid.storage.hdfs.HdfsDataSegmentKiller.kill(HdfsDataSegmentKiller.java:93) ~[?:?]
at io.druid.segment.loading.OmniDataSegmentKiller.kill(OmniDataSegmentKiller.java:46) ~[druid-server-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315]
at io.druid.indexing.common.task.KillTask.run(KillTask.java:103) ~[druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:445) [druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:417) [druid-indexing-service-0.12.1.3.1.4.0-315.jar:0.12.1.3.1.4.0-315]
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) [guava-28.0-jre.jar:?]
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69) [guava-28.0-jre.jar:?]
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) [guava-28.0-jre.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_112]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_112]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]`
My first guess is that it is trying to delete 0_descriptor.json but it does not find the file. On my HDFS tree, inside all the segments, there are 2 file:
0_index.zip
descriptor.json
The kill task successfully deletes the 0_index.zip, but returns error when it tries to delete 0_descriptor.json but that does not exists...
Where do I go wrong?
Thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org