You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2018/08/16 04:56:00 UTC

[jira] [Updated] (TEZ-3980) ShuffleRunner: the wake loop needs to check for shutdown

     [ https://issues.apache.org/jira/browse/TEZ-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gopal V updated TEZ-3980:
-------------------------
    Attachment: TEZ-3980.1.patch

> ShuffleRunner: the wake loop needs to check for shutdown
> --------------------------------------------------------
>
>                 Key: TEZ-3980
>                 URL: https://issues.apache.org/jira/browse/TEZ-3980
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Gopal V
>            Priority: Major
>         Attachments: TEZ-3980.1.patch
>
>
> In the ShuffleRunner threads, there's a loop which does not terminate if the task threads get killed.
> {code}
>           while ((runningFetchers.size() >= numFetchers || pendingHosts.isEmpty())
>               && numCompletedInputs.get() < numInputs) {
>             inputContext.notifyProgress();
>             boolean ret = wakeLoop.await(1000, TimeUnit.MILLISECONDS);
>           }
> {code}
> The wakeLoop signal does not exit this out of the loop and is missing a break for shut-down.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)