You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eli Collins (Created) (JIRA)" <ji...@apache.org> on 2012/03/26 02:11:22 UTC
[jira] [Created] (HADOOP-8210) Common side of HDFS-3148
Common side of HDFS-3148
------------------------
Key: HADOOP-8210
URL: https://issues.apache.org/jira/browse/HADOOP-8210
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Eli Collins
Assignee: Eli Collins
Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244451#comment-13244451 ]
Hudson commented on HADOOP-8210:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2045 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2045/])
HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins (Revision 1308457)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308457
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/DNS.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243888#comment-13243888 ]
Hadoop QA commented on HADOOP-8210:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12520846/hadoop-8210.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.fs.viewfs.TestViewFsTrash
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/809//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/809//console
This message is automatically generated.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244407#comment-13244407 ]
Daryn Sharp commented on HADOOP-8210:
-------------------------------------
+1 this part doesn't look like it will impact tokens
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-8210:
--------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: (was: 2.0.0)
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Thank you for the reviews, Todd and Daryn! I've committed this and merged to branch-2.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 2.0.0
>
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245284#comment-13245284 ]
Hudson commented on HADOOP-8210:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #1004 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1004/])
HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins (Revision 1308457)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308457
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/DNS.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 2.0.0
>
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244403#comment-13244403 ]
Todd Lipcon commented on HADOOP-8210:
-------------------------------------
+1
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238020#comment-13238020 ]
Hadoop QA commented on HADOOP-8210:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12519884/hadoop-8210.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/779//console
This message is automatically generated.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238514#comment-13238514 ]
Daryn Sharp commented on HADOOP-8210:
-------------------------------------
Given the extensive use of IPs in this patch, is this going to impact the ability to use hostnames as a token's service?
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238024#comment-13238024 ]
Eli Collins commented on HADOOP-8210:
-------------------------------------
Think the change to bump commons-net in hadoop-project/pom.xml needs its own change.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-8210:
--------------------------------
Attachment: hadoop-8210.txt
Thanks Todd. Updated patch attached.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243597#comment-13243597 ]
Todd Lipcon commented on HADOOP-8210:
-------------------------------------
{code}
+ LinkedHashSet<InetAddress> addrs = new LinkedHashSet<InetAddress>();
{code}
I think it's worth changing the return type of this function to LinkedHashSet, so it's clear that the ordering here is on purpose. Perhaps also add a comment here saying something like:
{code}
// See below for reasoning behind using an ordered set.
{code}
----
{code}
+ // that depend on a particular element being 1st in the array.
+ // Eg. getDefaultIP always returns the 1st element.
{code}
Nits: please un-abbreviate "first" for better readability. Also, "e.g." instead of "Eg." -- or just say "For example"
----
{code}
+ ips[i] = addr.getHostAddress();
+ i++;
{code}
I think it's more idiomatic to just put the postincrement inside the []s
----
- there's a small spurious whitespace change in NetUtils.java
- looks like the pom change is still in this patch (redundant with HADOOP-8211)
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-8210:
--------------------------------
Target Version/s: 2.0.0 (was: 0.23.3)
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244459#comment-13244459 ]
Hudson commented on HADOOP-8210:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #1970 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1970/])
HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins (Revision 1308457)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308457
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/DNS.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239953#comment-13239953 ]
Eli Collins commented on HADOOP-8210:
-------------------------------------
HDFS-3148, which this jira tracks the common side of, just pertains to outgoing client interfaces, so doesn't pertain to datanode IPs. However, I think your comment is relevant to HADOOP-8198. I think HADOOP-7510 is complimentary, if we don't use hostnames then we'd have to have a separate service token for each interface on the datanode. Could you take a look at the design doc and see if it jives with what you're thinking?
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240029#comment-13240029 ]
Daryn Sharp commented on HADOOP-8210:
-------------------------------------
Very nice doc. I need to study it a bit more and see if/how it meshes with a few ideas I've been pondering with regards to tokens and multiple hostnames and ips. I started thinking of alternatives after seeing the token splitting that HA is currently doing.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244466#comment-13244466 ]
Hudson commented on HADOOP-8210:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1982 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1982/])
HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins (Revision 1308457)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308457
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/DNS.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 2.0.0
>
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238941#comment-13238941 ]
Eli Collins commented on HADOOP-8210:
-------------------------------------
Why would the local client interface used impact security?
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-8210:
--------------------------------
Attachment: hadoop-8210.txt
Patch attached (for trunk).
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245332#comment-13245332 ]
Hudson commented on HADOOP-8210:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #1039 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1039/])
HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins (Revision 1308457)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308457
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/DNS.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 2.0.0
>
> Attachments: hadoop-8210.txt, hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8210) Common side of HDFS-3148
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HADOOP-8210:
--------------------------------
Status: Patch Available (was: Open)
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8210) Common side of HDFS-3148
Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239494#comment-13239494 ]
Daryn Sharp commented on HADOOP-8210:
-------------------------------------
I may not be properly understanding the intent of the change, hence my request for clarification. I haven't fully researched the related jiras. I'll quickly explain host based tokens so you can easily respond.
As you probably already know, the default token implementation always resolves the host to an ip for the token's service. This is fine if the user explicitly specified an ip (maybe due to dns errors, or no dns entries), but the host based tokens preserve the exact hostname or ip the user specified. Preserving the hostname shields the user against ip changes which is very important, for example, when a local or remote NN's ip may change during an upgrade.
That said, will this change be used exclusively by the client to select an outgoing network interface? That will be fine. My concern is if the client starts always using ips for a remote host since the token will probably have to contain the ip -- depending how/where these new methods are used. Resolving an ip back to a hostname is insufficient since the user may have provided a CNAME and a reverse lookup will return the A name. If the CNAME's ip changes, the client will not detect it which defeats the host based tokens.
Thanks in advance for taking the time to explain.
> Common side of HDFS-3148
> ------------------------
>
> Key: HADOOP-8210
> URL: https://issues.apache.org/jira/browse/HADOOP-8210
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: io, performance
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hadoop-8210.txt
>
>
> Common side of HDFS-3148, add necessary DNS and NetUtils methods. Test coverage is in the HDFS-3148 patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira