You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org> on 2010/07/17 02:15:50 UTC
[jira] Created: (HBASE-2841) Support psuedo-distributed ZooKeeper
in HBase
Support psuedo-distributed ZooKeeper in HBase
---------------------------------------------
Key: HBASE-2841
URL: https://issues.apache.org/jira/browse/HBASE-2841
Project: HBase
Issue Type: Improvement
Components: scripts, zookeeper
Reporter: Nicolas Spiegelberg
Priority: Trivial
HBASE-1511 added psuedo-distributed support for RegionServers and backup Masters, however there were some obstacles preventing the last piece: psuedo-distributed ZooKeeper clients (HQuorumPeer). No major obstacles, just enough that I don't have time to work on them immediately. This would be a great noob task to get familiar with how our ZooKeeper code works and make minor changes that will greatly help us test this product. Note that if you're feeling extra ambitious, you could work on adding startZkCluster(int), killZkPeer(int), and restartZkPeer(int) to HBaseTestingUtility.java for JUnit test goodness.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2841) Support psuedo-distributed ZooKeeper
in HBase
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889430#action_12889430 ]
Nicolas Spiegelberg commented on HBASE-2841:
--------------------------------------------
For developer...
psuedo-distributed ZK is more work than the others based upon the way that ZooKeeperWrapper & HQuorumPeer was written. Should still be doable, but noting some of the problems for consideration:
1. Need to add conf item (hbase.zookeeper.myid) to override ID lookup in HQuorumPeer.writeMyID()
2. These config params should be different per HQuorumPeer: hbase.zookeeper.property.clientPort + hbase.zookeeper.property.dataDir
3. hbase.zookeeper.property.server.<id> should be given to hbase as <addr>:<peer_port>:<leader_port>:<client_port>
a. We currently don't allow a custom peer_port + leader_port even though ZK supports it
b. Need extra client_port for ZooKeeperWrapper.setQuorumServers()
4. GNU Parsing code needs to be added to HQuorumPeer to support overriding config values on the fly. See HMaster.doMain() for help
Also, make sure that the master rewrite code does not affect this change, if you finish first.
> Support psuedo-distributed ZooKeeper in HBase
> ---------------------------------------------
>
> Key: HBASE-2841
> URL: https://issues.apache.org/jira/browse/HBASE-2841
> Project: HBase
> Issue Type: Improvement
> Components: scripts, zookeeper
> Reporter: Nicolas Spiegelberg
> Priority: Trivial
>
> HBASE-1511 added psuedo-distributed support for RegionServers and backup Masters, however there were some obstacles preventing the last piece: psuedo-distributed ZooKeeper clients (HQuorumPeer). No major obstacles, just enough that I don't have time to work on them immediately. This would be a great noob task to get familiar with how our ZooKeeper code works and make minor changes that will greatly help us test this product. Note that if you're feeling extra ambitious, you could work on adding startZkCluster(int), killZkPeer(int), and restartZkPeer(int) to HBaseTestingUtility.java for JUnit test goodness.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2841) Support psuedo-distributed ZooKeeper
in HBase
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889437#action_12889437 ]
Nicolas Spiegelberg commented on HBASE-2841:
--------------------------------------------
Also see: http://hadoop.apache.org/zookeeper/docs/r3.3.0/zookeeperStarted.html#sc_RunningReplicatedZooKeeper
> Support psuedo-distributed ZooKeeper in HBase
> ---------------------------------------------
>
> Key: HBASE-2841
> URL: https://issues.apache.org/jira/browse/HBASE-2841
> Project: HBase
> Issue Type: Improvement
> Components: scripts, zookeeper
> Reporter: Nicolas Spiegelberg
> Priority: Trivial
>
> HBASE-1511 added psuedo-distributed support for RegionServers and backup Masters, however there were some obstacles preventing the last piece: psuedo-distributed ZooKeeper clients (HQuorumPeer). No major obstacles, just enough that I don't have time to work on them immediately. This would be a great noob task to get familiar with how our ZooKeeper code works and make minor changes that will greatly help us test this product. Note that if you're feeling extra ambitious, you could work on adding startZkCluster(int), killZkPeer(int), and restartZkPeer(int) to HBaseTestingUtility.java for JUnit test goodness.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.