You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Tom White (Created) (JIRA)" <ji...@apache.org> on 2012/04/12 22:07:18 UTC
[jira] [Created] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Support limits on task status string length and number of block locations in branch-2
-------------------------------------------------------------------------------------
Key: MAPREDUCE-4146
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Tom White
This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4146:
------------------------------------
Status: Patch Available (was: Open)
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281008#comment-13281008 ]
Tom White commented on MAPREDUCE-4146:
--------------------------------------
+1 thanks for addressing the feedback Ahmed.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276112#comment-13276112 ]
Hadoop QA commented on MAPREDUCE-4146:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12527473/MAPREDUCE-4146_rev2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2388//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2388//console
This message is automatically generated.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284866#comment-13284866 ]
Hudson commented on MAPREDUCE-4146:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2295 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2295/])
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. (Revision 1343755)
Result = SUCCESS
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343755
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/split/JobSplitWriter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/task/TaskAttemptContextImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestBlockLimits.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestReporter.java
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285677#comment-13285677 ]
Hudson commented on MAPREDUCE-4146:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1095 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1095/])
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. (Revision 1343755)
Result = SUCCESS
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343755
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/split/JobSplitWriter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/task/TaskAttemptContextImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestBlockLimits.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestReporter.java
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271051#comment-13271051 ]
Tom White commented on MAPREDUCE-4146:
--------------------------------------
Generally looks fine. I noticed that the property for controlling the number of split locations should be mapreduce.job.max.split.locations (from branch-1), not mapreduce.max.block.locations. Also, the default value for this property seems to be different to branch-1.
The findbugs problem is due to HADOOP-8354. Please see if the increase in javac warnings can be avoided.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270195#comment-13270195 ]
Hadoop QA commented on MAPREDUCE-4146:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12525947/MAPREDUCE-4146.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 1937 javac compiler warnings (more than the trunk's current 1933 warnings).
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
-1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2367//testReport/
Javac warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2367//artifact/trunk/trunk/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2367//console
This message is automatically generated.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4146:
------------------------------------
Attachment: MAPREDUCE-4146.patch
Attaching a patch that adds the task status length and number of block locations limits.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Jim Donofrio (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295430#comment-13295430 ]
Jim Donofrio commented on MAPREDUCE-4146:
-----------------------------------------
Hadoop 2.0.1-alpha
{code}
if (locations.length > maxBlockLocations) {
throw new IOException("Max block location exceeded for split: "
+ split + " splitsize: " + locations.length +
" maxsize: " + maxBlockLocations);
}
{code}
Hadoop 1.0.3
I am wondering why this part of the path conflicts with the current behavior in Hadoop 1.0.3 by failing thejob with an IOException instead of just capping the number of splits? It is common to exceed the split number when doing a map side join
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284905#comment-13284905 ]
Hudson commented on MAPREDUCE-4146:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2314 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2314/])
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. (Revision 1343755)
Result = FAILURE
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343755
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/split/JobSplitWriter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/task/TaskAttemptContextImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestBlockLimits.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestReporter.java
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284865#comment-13284865 ]
Hudson commented on MAPREDUCE-4146:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2368 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2368/])
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. (Revision 1343755)
Result = SUCCESS
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343755
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/split/JobSplitWriter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/task/TaskAttemptContextImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestBlockLimits.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestReporter.java
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated MAPREDUCE-4146:
---------------------------------
Resolution: Fixed
Fix Version/s: 2.0.1-alpha
Target Version/s: (was: 2.0.0-alpha)
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Ahmed!
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4146:
------------------------------------
Status: Patch Available (was: Open)
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan reassigned MAPREDUCE-4146:
---------------------------------------
Assignee: Ahmed Radwan
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4146:
------------------------------------
Attachment: MAPREDUCE-4146_rev2.patch
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-4146:
-------------------------------------
Status: Open (was: Patch Available)
Sorry for coming in late.
I think doing statics is a mistake we should avoid in MR2. It should just be job-configurable since all you can do is blow up your own AM, it wasn't quite the case with MR1.
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4146.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285595#comment-13285595 ]
Hudson commented on MAPREDUCE-4146:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1061 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1061/])
MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. (Revision 1343755)
Result = SUCCESS
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343755
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/split/JobSplitWriter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/task/TaskAttemptContextImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestBlockLimits.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestReporter.java
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.1-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4146) Support limits on task status
string length and number of block locations in branch-2
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4146.
------------------------------------
> Support limits on task status string length and number of block locations in branch-2
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4146
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4146
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Tom White
> Assignee: Ahmed Radwan
> Fix For: 2.0.2-alpha
>
> Attachments: MAPREDUCE-4146.patch, MAPREDUCE-4146_rev2.patch
>
>
> This brings MAPREDUCE-1943 to branch-2. Counter limits were introduced in MAPREDUCE-901.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira