[jira] [Commented] (TEZ-3803) Tasks can get killed due to insufficient progress while waiting for shuffle inputs to complete

["TezQA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099589#comment-16099589 ] 

TezQA commented on TEZ-3803:
----------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment
  http://issues.apache.org/jira/secure/attachment/12878700/TEZ-3803.001.patch
  against master revision 5d78833.

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 2 new or modified test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 2 new Findbugs (version 3.0.1) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in :
                   org.apache.tez.mapreduce.TestMRRJobs
                  org.apache.tez.runtime.library.common.shuffle.impl.TestShuffleManager
                  org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler
                  org.apache.tez.runtime.library.api.TestTezRuntimeConfiguration
                  org.apache.tez.mapreduce.processor.reduce.TestReduceProcessor

                                      The following test timeouts occurred in :
 org.apache.tez.mapreduce.TestMRRJobsDAGApi
org.apache.tez.test.TestSecureShuffle
org.apache.tez.test.TestPipelinedShuffle

Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/2585//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-TEZ-Build/2585//artifact/patchprocess/newPatchFindbugsWarningstez-runtime-library.html
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2585//console

This message is automatically generated.

> Tasks can get killed due to insufficient progress while waiting for shuffle inputs to complete
> ----------------------------------------------------------------------------------------------
>
>                 Key: TEZ-3803
>                 URL: https://issues.apache.org/jira/browse/TEZ-3803
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>            Priority: Critical
>         Attachments: TEZ-3803.001.patch
>
>
> In a scenario where a downstream task has no slow start and gets started before all its shuffle inputs are done, the task can timeout as the wait does not notify progress( set the "progress is being made bit") like it does in MapReduce.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)