You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org> on 2008/07/02 22:35:44 UTC

[jira] Created: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Find out why users have network problems in HBase and not in Hadoop
-------------------------------------------------------------------

                 Key: HBASE-719
                 URL: https://issues.apache.org/jira/browse/HBASE-719
             Project: Hadoop HBase
          Issue Type: Improvement
    Affects Versions: 0.1.3, 0.2.0
            Reporter: Jean-Daniel Cryans
            Assignee: Jean-Daniel Cryans
            Priority: Minor


Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans updated HBASE-719:
-------------------------------------

    Attachment: hbase-719-v2.patch

Corrected minor issues. Added some comments since this part of the code is a bit weird.

> Find out why users have network problems in HBase and not in Hadoop
> -------------------------------------------------------------------
>
>                 Key: HBASE-719
>                 URL: https://issues.apache.org/jira/browse/HBASE-719
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.1.3, 0.2.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>         Attachments: hbase-719-v2.patch, hbase-719.patch
>
>
> Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans updated HBASE-719:
-------------------------------------

    Attachment: hbase-719.patch

Small patch, review please. One thing to check, I wasn't able to persist changes done to HServerAddress from HMaster so I have to pass the address with the other 2 configs in HMaster.regionServerStartup

> Find out why users have network problems in HBase and not in Hadoop
> -------------------------------------------------------------------
>
>                 Key: HBASE-719
>                 URL: https://issues.apache.org/jira/browse/HBASE-719
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.1.3, 0.2.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>         Attachments: hbase-719.patch
>
>
> Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610220#action_12610220 ] 

Jean-Daniel Cryans commented on HBASE-719:
------------------------------------------

Found the issue. In Hadoop, when they receive the first call from a Datanode the code is :

{code}
String dnAddress = Server.getRemoteAddress();
    if (dnAddress == null) {
      // Mostly called inside an RPC.
      // But if not, use address passed by the data-node.
      dnAddress = nodeReg.getHost();
    }      

    String hostName = nodeReg.getHost();
      
    // update the datanode's name with ip:port
    DatanodeID dnReg = new DatanodeID(dnAddress + ":" + nodeReg.getPort(),
                                      nodeReg.getStorageID(),
                                      nodeReg.getInfoPort());
{code}
The important line is the first one as it always returns the good address and then the DatanodeID is updated. I will do exactly the same thing for HBase.

> Find out why users have network problems in HBase and not in Hadoop
> -------------------------------------------------------------------
>
>                 Key: HBASE-719
>                 URL: https://issues.apache.org/jira/browse/HBASE-719
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.1.3, 0.2.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>
> Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610251#action_12610251 ] 

stack commented on HBASE-719:
-----------------------------

I don't understand this bit J-D:

{code}
+      serverInfo.getServerAddress().updateInfo(new HServerAddress
+          (conf.get("hbase.regionserver.address"), 
+          serverInfo.getServerAddress().getPort()));
{code}

Why not do this up in the Constructor?

Should we remove getThisIP from same file?

Any reason for not just creating a new HServerInfo rather than alter the one passed: i.e. updateInfo



> Find out why users have network problems in HBase and not in Hadoop
> -------------------------------------------------------------------
>
>                 Key: HBASE-719
>                 URL: https://issues.apache.org/jira/browse/HBASE-719
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.1.3, 0.2.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>         Attachments: hbase-719.patch
>
>
> Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HBASE-719) Find out why users have network problems in HBase and not in Hadoop

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack resolved HBASE-719.
-------------------------

       Resolution: Fixed
    Fix Version/s: 0.2.0

Committed.  Thanks for the patch J-D!

> Find out why users have network problems in HBase and not in Hadoop
> -------------------------------------------------------------------
>
>                 Key: HBASE-719
>                 URL: https://issues.apache.org/jira/browse/HBASE-719
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.1.3, 0.2.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>             Fix For: 0.2.0
>
>         Attachments: hbase-719-v2.patch, hbase-719.patch
>
>
> Many many times, I saw users (including me) who misconfigured their OS network and it still worked in Hadoop but not in HBase (the region servers report themselves as 127.0.0.1 which is bad). Find out why and correct it if possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.