You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org> on 2010/07/02 20:23:50 UTC
[jira] Created: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Offer a fully integrated Hadoop+HBase+ZooKeeper solution
--------------------------------------------------------
Key: HBASE-2811
URL: https://issues.apache.org/jira/browse/HBASE-2811
Project: HBase
Issue Type: New Feature
Reporter: Jean-Daniel Cryans
Fix For: 0.21.0
As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
# We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
# Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
Then we need to make sure that we have options to disable that management like we currently do for ZK.
This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884840#action_12884840 ]
Jean-Daniel Cryans commented on HBASE-2811:
-------------------------------------------
About #2, it's just a proposal to counter the "too many components" argument.
> Offer a fully integrated Hadoop+HBase+ZooKeeper solution
> --------------------------------------------------------
>
> Key: HBASE-2811
> URL: https://issues.apache.org/jira/browse/HBASE-2811
> Project: HBase
> Issue Type: New Feature
> Reporter: Jean-Daniel Cryans
> Fix For: 0.21.0
>
>
> As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
> # We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
> # Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
> Then we need to make sure that we have options to disable that management like we currently do for ZK.
> This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jean-Daniel Cryans updated HBASE-2811:
--------------------------------------
Fix Version/s: 0.92.0
(was: 0.90.0)
Let's punt to 0.92.0
> Offer a fully integrated Hadoop+HBase+ZooKeeper solution
> --------------------------------------------------------
>
> Key: HBASE-2811
> URL: https://issues.apache.org/jira/browse/HBASE-2811
> Project: HBase
> Issue Type: New Feature
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.0
>
>
> As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
> # We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
> # Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
> Then we need to make sure that we have options to disable that management like we currently do for ZK.
> This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884826#action_12884826 ]
Jonathan Gray commented on HBASE-2811:
--------------------------------------
We should definitely do #1. +1 on configurable like ZK and also pre-configured HDFS.
I think #2 could be interesting but I'm not sure in which contexts it makes sense. Single node, yeah. But if you have a cluster it seems like you benefit from multiple JVMs. Is it really that much more simple to launch a cluster of one process per server vs two or three?
Are there some benefits I'm not thinking about?
> Offer a fully integrated Hadoop+HBase+ZooKeeper solution
> --------------------------------------------------------
>
> Key: HBASE-2811
> URL: https://issues.apache.org/jira/browse/HBASE-2811
> Project: HBase
> Issue Type: New Feature
> Reporter: Jean-Daniel Cryans
> Fix For: 0.21.0
>
>
> As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
> # We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
> # Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
> Then we need to make sure that we have options to disable that management like we currently do for ZK.
> This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902263#action_12902263 ]
Jonathan Gray commented on HBASE-2811:
--------------------------------------
I'd really like to see #1 happen for 0.90. Someone did take ownership of this at some point, need to dig through my notes :)
> Offer a fully integrated Hadoop+HBase+ZooKeeper solution
> --------------------------------------------------------
>
> Key: HBASE-2811
> URL: https://issues.apache.org/jira/browse/HBASE-2811
> Project: HBase
> Issue Type: New Feature
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.0
>
>
> As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
> # We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
> # Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
> Then we need to make sure that we have options to disable that management like we currently do for ZK.
> This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-2811) Offer a fully integrated
Hadoop+HBase+ZooKeeper solution
Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884853#action_12884853 ]
Jonathan Gray commented on HBASE-2811:
--------------------------------------
Sure, I do think it's an interesting idea. Not trying to just shoot it down, trying to think if there are benefits out there over approach #1.
> Offer a fully integrated Hadoop+HBase+ZooKeeper solution
> --------------------------------------------------------
>
> Key: HBASE-2811
> URL: https://issues.apache.org/jira/browse/HBASE-2811
> Project: HBase
> Issue Type: New Feature
> Reporter: Jean-Daniel Cryans
> Fix For: 0.21.0
>
>
> As dicussed at the Hadoop Summit and HUG11, we could improve usability a lot simply by shipping with all the required components and manage them all. I see two way of doing this:
> # We keep all components separated and start/stop them in the right order. It would be much easier for us to develop but it would be much less friendly to use than the next solution.
> # Integrate the DNs and TTs with the RSs, the NN, the JT and a ZK quorum member with the master. I'm not sure if it's easily doable but that's what we do for our unit tests so it must be possible.
> Then we need to make sure that we have options to disable that management like we currently do for ZK.
> This would also give us the chance to configure HDFS with the right amount of xcievers out of the box, among other settings.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.