You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2012/07/19 22:47:36 UTC
[jira] [Created] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Jason Lowe created HDFS-3688:
--------------------------------
Summary: Namenode loses datanode hostname if datanode re-registers
Key: HDFS-3688
URL: https://issues.apache.org/jira/browse/HDFS-3688
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node
Affects Versions: 0.23.3
Reporter: Jason Lowe
If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419333#comment-13419333 ]
Hadoop QA commented on HDFS-3688:
---------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12537365/HDFS-3688.patch
against trunk revision .
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2877//console
This message is automatically generated.
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421361#comment-13421361 ]
Hudson commented on HDFS-3688:
------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #323 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/323/])
HDFS-3688. Namenode loses datanode hostname if datanode re-registers (Jason Lowe via daryn) (Revision 1364662)
Result = UNSTABLE
daryn : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1364662
Files :
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDatanodeRegister.java
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3
>
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418704#comment-13418704 ]
Jason Lowe commented on HDFS-3688:
----------------------------------
Yes, ran into that as well when looking into this bug. Thanks for pointing out the JIRA, as it saves me from filing the duplicate. ;-)
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418663#comment-13418663 ]
Jason Lowe commented on HDFS-3688:
----------------------------------
When the datanode registers with the namenode, the namenode bashes the datanode's provided hostname with an IP address and sends this new registration object back to the datanode, which proceeds to bash over its name with the IP address. If the datanode ever re-registers, it uses the "updated" hostname (now IP address) when registering, and the hostname for the datanode is lost.
This appears to only affect 0.23, since branch-2 and trunk have separate fields for tracking the datanode hostname vs. IP address, so the hostname isn't clobbered. See changes such as HDFS-3171, HDFS-3144, and HDFS-3164.
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated HDFS-3688:
------------------------------
Assignee: Jason Lowe
Hadoop Flags: Reviewed
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated HDFS-3688:
------------------------------
Resolution: Fixed
Fix Version/s: 0.23.3
Status: Resolved (was: Patch Available)
I've committed to branch-23. To reiterate Jason's earlier comment, issue has already been fixed in later versions. Thanks Jason!
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3
>
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419416#comment-13419416 ]
Jason Lowe commented on HDFS-3688:
----------------------------------
Patch failed on trunk since it's only for 23. Manually ran test-patch for this on branch-0.23, here's the output:
{noformat}
-1 overall.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version ) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hdfs.TestDatanodeBlockScanner
+1 contrib tests. The patch passed contrib unit tests.
{noformat}
The test failure appears to be unrelated, and when I ran the test again manually it passed. I believe this test is known to have some races in it, see HDFS-2881.
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated HDFS-3688:
-----------------------------
Status: Patch Available (was: Open)
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed HDFS-3688.
-------------------------------
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated HDFS-3688:
-----------------------------
Attachment: HDFS-3688.patch
Patch for branch-0.23 that has the datanode preserve the original hostname when registering with the namenode.
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3688) Namenode loses datanode hostname if
datanode re-registers
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420683#comment-13420683 ]
Daryn Sharp commented on HDFS-3688:
-----------------------------------
+1 Looks good.
> Namenode loses datanode hostname if datanode re-registers
> ---------------------------------------------------------
>
> Key: HDFS-3688
> URL: https://issues.apache.org/jira/browse/HDFS-3688
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Attachments: HDFS-3688.patch
>
>
> If a datanode ever re-registers with the namenode (e.g.: namenode restart, temporary network cut, etc.) then the datanode ends up registering with an IP address as the datanode name rather than the hostname.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira