You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Boris Shkolnik (JIRA)" <ji...@apache.org> on 2011/03/02 20:11:37 UTC
[jira] Created: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
-------------------------------------------------------------------------------------------------------------------------------------
Key: HDFS-1696
URL: https://issues.apache.org/jira/browse/HDFS-1696
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Boris Shkolnik
Assignee: Boris Shkolnik
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HDFS-1696:
---------------------------------
Attachment: HDFS-1696.patch
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HDFS-1696:
---------------------------------
Attachment: HDFS-1696-1.patch
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001589#comment-13001589 ]
Boris Shkolnik commented on HDFS-1696:
--------------------------------------
in datanode, instead of exiting in case of mismatching buildVersion, now we just keep waiting for NN to connect with the right version.
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003035#comment-13003035 ]
dhruba borthakur commented on HDFS-1696:
----------------------------------------
what if we get rid of the build version check completely ( we have removed it entirely in our deployment of hadoop)? It allows for running different versions of datanodes, namenode, avatarnode, etc. It allows for rolling datanode upgrades, etc.etc.
as long as the RPC protocol is compatible, datanodes should continue operating normally with the namenode.
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004245#comment-13004245 ]
Boris Shkolnik commented on HDFS-1696:
--------------------------------------
I guess it should work.
You should create a separate JIRA for it. So others can comment on it.
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik resolved HDFS-1696.
----------------------------------
Resolution: Fixed
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001659#comment-13001659 ]
Boris Shkolnik commented on HDFS-1696:
--------------------------------------
committed to Federation branch
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001586#comment-13001586 ]
Suresh Srinivas commented on HDFS-1696:
---------------------------------------
Can you please add some description on this mechanism. +1 for the patch.
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1696) HDFS Federation: when build version
doesn't match - datanode should wait (keep connecting) untill NN comes up
with the right version
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001902#comment-13001902 ]
Suresh Srinivas commented on HDFS-1696:
---------------------------------------
More description of the change:
In federation block pools are upgraded one at a time. Consider a case where a datanode is started with a later release and the namenode is not yet upgraded. In that case, instead of shutting down or stop talking to the namenode, the datanode continues to periodically perform handshake with the namenode. This ensures that if one or more namenodes are not upgraded yet, the datanode continues to perform handshakes and finally upgrades the block pool corresponding to the namenode, when the namenode is upgraded.
This helps need for restarting the datanode, if a namenode had not been upgraded when the cluster started up.
> HDFS Federation: when build version doesn't match - datanode should wait (keep connecting) untill NN comes up with the right version
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1696
> URL: https://issues.apache.org/jira/browse/HDFS-1696
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: HDFS-1696-1.patch, HDFS-1696.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira