You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/05/27 06:38:22 UTC
[GitHub] [druid] JiajianQtl opened a new issue #11310: Auto compaction does not work when KillStalePendingSegments encounter exception
JiajianQtl opened a new issue #11310:
URL: https://github.com/apache/druid/issues/11310
### Affected Version
0.20 and 0.21
### Description
org.apache.druid.server.coordinator.duty.CompactSegments will not run if org.apache.druid.server.coordinator.KillStalePendingSegments encounter any exception.
DruidCoordinator.java
`for (CoordinatorDuty duty : duties) {
// Don't read state and run state in the same duty otherwise racy conditions may exist
if (!coordinationPaused
&& coordLeaderSelector.isLeader()
&& startingLeaderCounter == coordLeaderSelector.localTerm()) {
final long start = System.nanoTime();
params = duty.run(params); // =====================> exceptions may interrupt the following duty
final long end = System.nanoTime();
if (params == null) {
// This duty wanted to cancel the run. No log message, since the duty should have logged a reason.
return;
} else {
params.getCoordinatorStats().addToDutyStat("runtime", duty.getClass().getName(), TimeUnit.NANOSECONDS.toMillis(end - start));
}
}`
Error messages:
`2021-05-27 04:45:58,633 ERROR org.apache.druid.server.coordinator.DruidCoordinator: Caught exception, ignoring so that schedule keeps going.: {class=org.apache.druid.server.coordinator.DruidCoordinator, exceptionType=class java.lang.RuntimeException, exceptionMessage=org.apache.druid.java.util.common.ISE: Error while killing pendingSegments of dataSource[foo] created until [2021-05-25T13:04:17.774Z]}
java.lang.RuntimeException: org.apache.druid.java.util.common.ISE: Error while killing pendingSegments of dataSource[foo] created until [2021-05-25T13:04:17.774Z]
at org.apache.druid.client.indexing.HttpIndexingServiceClient.killPendingSegments(HttpIndexingServiceClient.java:389) ~[druid-server-0.21.0.jar:0.21.0]
at org.apache.druid.server.coordinator.KillStalePendingSegments.run(KillStalePendingSegments.java:79) ~[druid-server-0.21.0.jar:0.21.0]
at org.apache.druid.server.coordinator.DruidCoordinator$DutiesRunnable.run(DruidCoordinator.java:815) ~[druid-server-0.21.0.jar:0.21.0]
at org.apache.druid.server.coordinator.DruidCoordinator$2.call(DruidCoordinator.java:638) ~[druid-server-0.21.0.jar:0.21.0]
at org.apache.druid.server.coordinator.DruidCoordinator$2.call(DruidCoordinator.java:631) ~[druid-server-0.21.0.jar:0.21.0]
at org.apache.druid.java.util.common.concurrent.ScheduledExecutors$4.run(ScheduledExecutors.java:163) ~[druid-core-0.21.0.jar:0.21.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_191]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_191]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_191]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_191]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_191]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
Caused by: org.apache.druid.java.util.common.ISE: Error while killing pendingSegments of dataSource[foo] created until [2021-05-25T13:04:17.774Z]
at org.apache.druid.client.indexing.HttpIndexingServiceClient.killPendingSegments(HttpIndexingServiceClient.java:377) ~[druid-server-0.21.0.jar:0.21.0]
... 12 more
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org