You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2018/08/16 04:56:00 UTC
[jira] [Updated] (TEZ-3980) ShuffleRunner: the wake loop needs to
check for shutdown
[ https://issues.apache.org/jira/browse/TEZ-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gopal V updated TEZ-3980:
-------------------------
Attachment: TEZ-3980.1.patch
> ShuffleRunner: the wake loop needs to check for shutdown
> --------------------------------------------------------
>
> Key: TEZ-3980
> URL: https://issues.apache.org/jira/browse/TEZ-3980
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Gopal V
> Assignee: Gopal V
> Priority: Major
> Attachments: TEZ-3980.1.patch
>
>
> In the ShuffleRunner threads, there's a loop which does not terminate if the task threads get killed.
> {code}
> while ((runningFetchers.size() >= numFetchers || pendingHosts.isEmpty())
> && numCompletedInputs.get() < numInputs) {
> inputContext.notifyProgress();
> boolean ret = wakeLoop.await(1000, TimeUnit.MILLISECONDS);
> }
> {code}
> The wakeLoop signal does not exit this out of the loop and is missing a break for shut-down.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)