You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2011/06/24 01:16:47 UTC
[jira] [Created] (HADOOP-7423) Document topology script
requirements
Document topology script requirements
-------------------------------------
Key: HADOOP-7423
URL: https://issues.apache.org/jira/browse/HADOOP-7423
Project: Hadoop Common
Issue Type: Improvement
Components: documentation
Reporter: Eli Collins
The topology script documentation is cluster_setup.xml is unclear. The topology script:
# Only needs to handle IP addresses (not hostnames)
# Needs to handle multiple arguments for caching to work effectively
We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7423) Document topology script
requirements
Posted by "Andy Isaacson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Isaacson updated HADOOP-7423:
----------------------------------
Attachment: hadoop-7423.txt
Document topology script API and non-dynamicness.
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Assignee: Andy Isaacson
> Labels: newbie
> Attachments: hadoop-7423.txt
>
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7423) Document topology script
requirements
Posted by "Andy Isaacson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Isaacson updated HADOOP-7423:
----------------------------------
Status: Patch Available (was: Open)
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Assignee: Andy Isaacson
> Labels: newbie
> Attachments: hadoop-7423.txt
>
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7423) Document topology script
requirements
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054241#comment-13054241 ]
Joep Rottinghuis commented on HADOOP-7423:
------------------------------------------
Isn't it true that even with IP addresses used in the topology script, one still has to make sure that Hostname=>IP=>Hostname is always consistent?
We had a situation where some nodes were inserted in each rack all and the numeric part of the names of the data nodes shifted by a few numbers (the domain also changed slighty). Even though the IP addresses stayed the same, for some of the nodes an nslookup resulted in multiple entries. We got some weird behavior.
In a brief glance through the code there seem to be several places where IP is mapped to name and name is mapped to IP, or am I wrong in this?
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Labels: newbie
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7423) Document topology script
requirements
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-7423:
-----------------------------------
Tags: (was: newbie)
Labels: newbie (was: )
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Labels: newbie
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7423) Document topology script
requirements
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-7423:
--------------------------------
Target Version/s: 1.2.0, 2.2.0-alpha
Affects Version/s: 1.0.0
2.0.0-alpha
Your addition looks good.
- In trunk/2.x we've switched the docs to apt, here's the relevant page to update: ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm. Since we still have the forest doc in trunk might as well update it too (will be removed when we migrate docs over) as you've done here.
- Needs to be updated to reflect HADOOP-7030
- Don't think mapred.cache.task.levels exists anymore
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Affects Versions: 1.0.0, 2.0.0-alpha
> Reporter: Eli Collins
> Assignee: Andy Isaacson
> Labels: newbie
> Attachments: hadoop-7423.txt
>
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7423) Document topology script
requirements
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289560#comment-13289560 ]
Hadoop QA commented on HADOOP-7423:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12530890/hadoop-7423.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+0 tests included. The patch appears to be a documentation patch that doesn't require tests.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1085//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1085//console
This message is automatically generated.
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Assignee: Andy Isaacson
> Labels: newbie
> Attachments: hadoop-7423.txt
>
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HADOOP-7423) Document topology script
requirements
Posted by "Andy Isaacson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Isaacson reassigned HADOOP-7423:
-------------------------------------
Assignee: Andy Isaacson
> Document topology script requirements
> -------------------------------------
>
> Key: HADOOP-7423
> URL: https://issues.apache.org/jira/browse/HADOOP-7423
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Eli Collins
> Assignee: Andy Isaacson
> Labels: newbie
>
> The topology script documentation is cluster_setup.xml is unclear. The topology script:
> # Only needs to handle IP addresses (not hostnames)
> # Needs to handle multiple arguments for caching to work effectively
> We should check in an example script or include an example one in the docs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira