You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Uma Maheswara Rao G (Created) (JIRA)" <ji...@apache.org> on 2012/02/21 02:17:34 UTC
[jira] [Created] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
HA: Balancer should use logical uri for creating failover proxy with HA enabled.
--------------------------------------------------------------------------------
Key: HDFS-2979
URL: https://issues.apache.org/jira/browse/HDFS-2979
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Presently Balancer uses real URI for creating the failover proxy.
Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
Posted by "Todd Lipcon (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reopened HDFS-2979:
-------------------------------
This patch seems to have made some tests fail (I noticed with TestFileAppend2). It seems to be trying to connect to 127.0.0.1:0 instead of the correct port.
> HA: Balancer should use logical uri for creating failover proxy with HA enabled.
> --------------------------------------------------------------------------------
>
> Key: HDFS-2979
> URL: https://issues.apache.org/jira/browse/HDFS-2979
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: balancer, hdfs client
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Aaron T. Myers
> Fix For: HA branch (HDFS-1623)
>
> Attachments: HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979.patch
>
>
> Presently Balancer uses real URI for creating the failover proxy.
> Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
> java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
> at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
> at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
> at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
> at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
Posted by "Aaron T. Myers (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HDFS-2979.
----------------------------------
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
Thanks a lot for the reviews, Eli. I've just committed this to the HA branch.
> HA: Balancer should use logical uri for creating failover proxy with HA enabled.
> --------------------------------------------------------------------------------
>
> Key: HDFS-2979
> URL: https://issues.apache.org/jira/browse/HDFS-2979
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: balancer, hdfs client
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Aaron T. Myers
> Fix For: HA branch (HDFS-1623)
>
> Attachments: HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979.patch
>
>
> Presently Balancer uses real URI for creating the failover proxy.
> Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
> java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
> at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
> at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
> at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
> at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
Posted by "Aaron T. Myers (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers reopened HDFS-2979:
----------------------------------
On second thought, I'm going to revert this change and fix the issue with NN conf mutation by modifying the test TestBalancerWithHANameNodes test case. The conf mutation issue should be fixed in a more general way.
> HA: Balancer should use logical uri for creating failover proxy with HA enabled.
> --------------------------------------------------------------------------------
>
> Key: HDFS-2979
> URL: https://issues.apache.org/jira/browse/HDFS-2979
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: balancer, hdfs client
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Aaron T. Myers
> Fix For: HA branch (HDFS-1623)
>
> Attachments: HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979.patch
>
>
> Presently Balancer uses real URI for creating the failover proxy.
> Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
> java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
> at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
> at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
> at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
> at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
Posted by "Aaron T. Myers (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HDFS-2979.
----------------------------------
Resolution: Fixed
Thanks a lot for the reviews, Todd. I've just committed the latest patch to the HA branch.
> HA: Balancer should use logical uri for creating failover proxy with HA enabled.
> --------------------------------------------------------------------------------
>
> Key: HDFS-2979
> URL: https://issues.apache.org/jira/browse/HDFS-2979
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: balancer, hdfs client
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Aaron T. Myers
> Fix For: HA branch (HDFS-1623)
>
> Attachments: HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979.patch
>
>
> Presently Balancer uses real URI for creating the failover proxy.
> Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
> java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
> at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
> at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
> at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
> at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2979) HA: Balancer should use logical uri
for creating failover proxy with HA enabled.
Posted by "Aaron T. Myers (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HDFS-2979.
----------------------------------
Resolution: Fixed
Thanks Todd. I've filed HDFS-3033 to address these failures.
> HA: Balancer should use logical uri for creating failover proxy with HA enabled.
> --------------------------------------------------------------------------------
>
> Key: HDFS-2979
> URL: https://issues.apache.org/jira/browse/HDFS-2979
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: balancer, hdfs client
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Aaron T. Myers
> Fix For: HA branch (HDFS-1623)
>
> Attachments: HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979-HDFS-1623.patch, HDFS-2979.patch
>
>
> Presently Balancer uses real URI for creating the failover proxy.
> Since the failover proxy checks for uri consistency, we should pass logical uri for creating failover proxy instead of instead of real URI. Presently will work only with default port.
> java.io.IOException: Port 49832 specified in URI hdfs://127.0.0.1:49832 but host '127.0.0.1' is a logical (HA) namenode and does not use port information.
> at org.apache.hadoop.hdfs.HAUtil.getFailoverProxyProviderClass(HAUtil.java:224)
> at org.apache.hadoop.hdfs.HAUtil.createFailoverProxy(HAUtil.java:247)
> at org.apache.hadoop.hdfs.server.balancer.NameNodeConnector.<init>(NameNodeConnector.java:80)
> at org.apache.hadoop.hdfs.server.balancer.Balancer.run(Balancer.java:1401)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira