You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Nishan Shetty (Created) (JIRA)" <ji...@apache.org> on 2012/04/17 09:22:16 UTC
[jira] [Created] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
-------------------------------------------------------------------------------------
Key: MAPREDUCE-4159
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 2.0.0
Reporter: Nishan Shetty
1.Configure "mapreduce.job.ubertask.enable" to true
2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
Observe that job is running in Uber mode
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258194#comment-13258194 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #233 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/233/])
svn merge -c 1328031 from trunk. FIXES: MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328034)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328034
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256829#comment-13256829 ]
Robert Joseph Evans commented on MAPREDUCE-4159:
------------------------------------------------
The patch looks mostly good. I would prefer to see an optimization
{code}
boolean isvalidUberMaxReduces = true;
if (sysMaxReduces != 0 && sysMaxReduces != 1) {
isvalidUberMaxReduces = false;
}
{code}
can be replaced with
{code}
boolean isvalidUberMaxReduces = (sysMaxReduces == 0) || (sysMaxReduces == 1);
{code}
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256509#comment-13256509 ]
Devaraj K commented on MAPREDUCE-4159:
--------------------------------------
It is not considering the value of 'mapreduce.job.ubertask.maxreduces' while making the job uber mode decision.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257396#comment-13257396 ]
Devaraj K commented on MAPREDUCE-4159:
--------------------------------------
The above test failures are not related to the patch.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4159:
-------------------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
2.0.0
0.23.3
Status: Resolved (was: Patch Available)
Thanks Devaraj,
I just pulled this into trunk, branch-2, and branch-0.23
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256635#comment-13256635 ]
Devaraj K commented on MAPREDUCE-4159:
--------------------------------------
The above failures are not related to this patch.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258233#comment-13258233 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1055 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1055/])
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328031)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328031
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4159:
---------------------------------
Attachment: MAPREDUCE-4159-1.patch
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257623#comment-13257623 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2124 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2124/])
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328031)
Result = ABORTED
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328031
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258212#comment-13258212 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1020 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1020/])
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328031)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328031
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256623#comment-13256623 ]
Hadoop QA commented on MAPREDUCE-4159:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12523184/MAPREDUCE-4159.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell
org.apache.hadoop.yarn.server.TestDiskFailures
org.apache.hadoop.yarn.server.TestContainerManagerSecurity
org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens
org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
org.apache.hadoop.mapred.TestMiniMRClasspath
org.apache.hadoop.mapreduce.v2.TestMRJobs
org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers
org.apache.hadoop.mapred.TestMiniMRBringup
org.apache.hadoop.mapred.TestMiniMRChildTask
org.apache.hadoop.mapred.TestReduceFetch
org.apache.hadoop.mapred.TestClusterMRNotification
org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
org.apache.hadoop.mapred.TestJobCounters
org.apache.hadoop.mapreduce.TestChild
org.apache.hadoop.mapred.TestMiniMRClientCluster
org.apache.hadoop.ipc.TestSocketFactory
org.apache.hadoop.mapreduce.v2.TestMRJobsWithHistoryService
org.apache.hadoop.mapreduce.v2.TestMROldApiJobs
org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution
org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
org.apache.hadoop.mapred.TestClientRedirect
org.apache.hadoop.mapred.TestLazyOutput
org.apache.hadoop.mapred.TestJobCleanup
org.apache.hadoop.mapreduce.TestMapReduceLazyOutput
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
org.apache.hadoop.mapreduce.v2.TestMRAppWithCombiner
org.apache.hadoop.conf.TestNoDefaultsJobConf
org.apache.hadoop.mapreduce.v2.TestRMNMInfo
org.apache.hadoop.mapred.TestClusterMapReduceTestCase
org.apache.hadoop.mapreduce.v2.TestNonExistentJob
org.apache.hadoop.mapred.TestJobSysDirWithDFS
org.apache.hadoop.mapreduce.v2.TestUberAM
org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser
org.apache.hadoop.mapred.TestJobName
org.apache.hadoop.mapreduce.security.TestJHSSecurity
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2246//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2246//console
This message is automatically generated.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257585#comment-13257585 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2181 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2181/])
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328031)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328031
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4159:
---------------------------------
Attachment: MAPREDUCE-4159.patch
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257586#comment-13257586 ]
Hudson commented on MAPREDUCE-4159:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2107 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2107/])
MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby) (Revision 1328031)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328031
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.0, 3.0.0
>
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4159:
-------------------------------------------
Status: Open (was: Patch Available)
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4159) Job is running in Uber mode
after setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257258#comment-13257258 ]
Hadoop QA commented on MAPREDUCE-4159:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12523300/MAPREDUCE-4159-1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell
org.apache.hadoop.yarn.server.TestDiskFailures
org.apache.hadoop.yarn.server.TestContainerManagerSecurity
org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens
org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
org.apache.hadoop.mapred.TestMiniMRClasspath
org.apache.hadoop.mapreduce.v2.TestMRJobs
org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers
org.apache.hadoop.mapred.TestMiniMRBringup
org.apache.hadoop.mapred.TestMiniMRChildTask
org.apache.hadoop.mapred.TestReduceFetch
org.apache.hadoop.mapred.TestClusterMRNotification
org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
org.apache.hadoop.mapred.TestJobCounters
org.apache.hadoop.mapreduce.TestChild
org.apache.hadoop.mapred.TestMiniMRClientCluster
org.apache.hadoop.ipc.TestSocketFactory
org.apache.hadoop.mapreduce.v2.TestMRJobsWithHistoryService
org.apache.hadoop.mapreduce.v2.TestMROldApiJobs
org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution
org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
org.apache.hadoop.mapred.TestClientRedirect
org.apache.hadoop.mapred.TestLazyOutput
org.apache.hadoop.mapred.TestJobCleanup
org.apache.hadoop.mapreduce.TestMapReduceLazyOutput
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
org.apache.hadoop.mapreduce.v2.TestMRAppWithCombiner
org.apache.hadoop.conf.TestNoDefaultsJobConf
org.apache.hadoop.mapreduce.v2.TestRMNMInfo
org.apache.hadoop.mapred.TestClusterMapReduceTestCase
org.apache.hadoop.mapreduce.v2.TestNonExistentJob
org.apache.hadoop.mapred.TestJobSysDirWithDFS
org.apache.hadoop.mapreduce.v2.TestUberAM
org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser
org.apache.hadoop.mapred.TestJobName
org.apache.hadoop.mapreduce.security.TestJHSSecurity
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2252//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2252//console
This message is automatically generated.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4159:
---------------------------------
Affects Version/s: 3.0.0
Status: Patch Available (was: Open)
Thanks a lot Robert for looking into the patch.
I have updated the patch with the optimization.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159-1.patch, MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4159:
---------------------------------
Assignee: Devaraj K
Status: Patch Available (was: Open)
I have attached patch to address this issue.
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4159.patch
>
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4159) Job is running in Uber mode after
setting "mapreduce.job.ubertask.maxreduces" to zero
Posted by "Nishan Shetty (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nishan Shetty updated MAPREDUCE-4159:
-------------------------------------
Description:
1.Configure "mapreduce.job.ubertask.enable" to true
2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
Observe that job is running in Uber mode instead of normal mode(non uber mode)
was:
1.Configure "mapreduce.job.ubertask.enable" to true
2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
Observe that job is running in Uber mode
> Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0
> Reporter: Nishan Shetty
>
> 1.Configure "mapreduce.job.ubertask.enable" to true
> 2.Configure "mapreduce.job.ubertask.maxreduces" to 0(zero)
> 3.Run job such that it has one reducer(more than "mapreduce.job.ubertask.maxreduces" value)
> Observe that job is running in Uber mode instead of normal mode(non uber mode)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira