You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ahmed Radwan (JIRA)" <ji...@apache.org> on 2012/07/07 01:12:34 UTC
[jira] [Created] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Ahmed Radwan created MAPREDUCE-4406:
---------------------------------------
Summary: Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
Key: MAPREDUCE-4406
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416843#comment-13416843 ]
Alejandro Abdelnur commented on MAPREDUCE-4406:
-----------------------------------------------
+1
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415823#comment-13415823 ]
Ahmed Radwan commented on MAPREDUCE-4406:
-----------------------------------------
The Jenkins TestCombineFileInputFormat failure above doesn't seem to be related to this patch.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416856#comment-13416856 ]
Hudson commented on MAPREDUCE-4406:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2514 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2514/])
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) (Revision 1362751)
Result = FAILURE
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362751
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4406:
------------------------------------
Attachment: MAPREDUCE-4406.patch
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4406:
------------------------------------
Status: Patch Available (was: Open)
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416852#comment-13416852 ]
Hudson commented on MAPREDUCE-4406:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2493 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2493/])
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) (Revision 1362751)
Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362751
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13417102#comment-13417102 ]
Hudson commented on MAPREDUCE-4406:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1140 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1140/])
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) (Revision 1362751)
Result = FAILURE
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362751
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4406:
------------------------------------
Attachment: MAPREDUCE-4406_rev2.patch
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414139#comment-13414139 ]
Alejandro Abdelnur commented on MAPREDUCE-4406:
-----------------------------------------------
The first patch would reintroduce fixed ports in the minicluster, we don't want that for running testcases.
We could achieve this by having a new config property, ie 'hadoop.minicluster.fixed.ports' = FALSE (default).
If this property is FALSE, we use the current random port configuration.
If this property is TRUE, we use the fixed port behavior from configuration.
Then MAPREDUCE-987 would set this property to TRUE before starting the minicluster.
This wouldn't change the current random behavior which is desirable for dev/jenkins.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415785#comment-13415785 ]
Hadoop QA commented on MAPREDUCE-4406:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12536741/MAPREDUCE-4406_rev2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests:
org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2606//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2606//console
This message is automatically generated.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4406.
------------------------------------
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.0.2-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13408553#comment-13408553 ]
Hadoop QA commented on MAPREDUCE-4406:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12535462/MAPREDUCE-4406.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2551//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2551//console
This message is automatically generated.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13417009#comment-13417009 ]
Hudson commented on MAPREDUCE-4406:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1107 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1107/])
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) (Revision 1362751)
Result = FAILURE
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362751
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416849#comment-13416849 ]
Hudson commented on MAPREDUCE-4406:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2558 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2558/])
MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) (Revision 1362751)
Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362751
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415743#comment-13415743 ]
Ahmed Radwan commented on MAPREDUCE-4406:
-----------------------------------------
Many thanks Tucu for the review! Yes, I have noticed now that all these addresses are in *-default.xml so will be picked by the minicluster and will be fixed. Here is a new patch adding the conf properties for using fixed ports. I'll be also updating MAPREDUCE-987 to set these ports.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmed Radwan updated MAPREDUCE-4406:
------------------------------------
Component/s: test
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-4406.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4406) Users should be able to specify
the MiniCluster ResourceManager and JobHistoryServer ports
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated MAPREDUCE-4406:
------------------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Thanks Ahmed. Committed to trunk and branch-2.
> Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4406
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4406
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Fix For: 2.2.0-alpha
>
> Attachments: MAPREDUCE-4406.patch, MAPREDUCE-4406_rev2.patch
>
>
> There is use-cases where users may need to specify the ports used for the resource manager and history server for the minicluster.
> In the current implementation, the MiniCluster sets these addresses regardless of them being already set by the user in the conf.
> Users should be able to add these properties to the conf and in such case the MiniCluster will use the specified addresses. If not specified then the current behavior of the MiniCluster for explicitly setting the addresses will be used.
> I'll be uploading a patch momentarily.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira