You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Elliott Clark (JIRA)" <ji...@apache.org> on 2011/01/21 20:57:44 UTC
[jira] Created: (WHIRR-214) Add nodes to running clusters
Add nodes to running clusters
-----------------------------
Key: WHIRR-214
URL: https://issues.apache.org/jira/browse/WHIRR-214
Project: Whirr
Issue Type: New Feature
Reporter: Elliott Clark
I would like to be able to add a node to a running cluster.
For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (WHIRR-214) Add nodes to running
clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002404#comment-13002404 ]
David Alves edited comment on WHIRR-214 at 3/4/11 2:16 AM:
-----------------------------------------------------------
Should this issue take only care of expansion or also of contraction? Seems that, at least from a cluster management point of view (i.e., not looking into specific services) that the issue could easily take care of both.
was (Author: dr-alves):
Should this patch take only care of expansion or also of contraction?
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984910#action_12984910 ]
Tom White commented on WHIRR-214:
---------------------------------
This could be implemented as an "add n nodes" command (like the one in the older scripts), or as a "expand cluster to n nodes" command (pallet takes this approach). The latter is idempotent which might be nice.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995046#comment-12995046 ]
David Alves commented on WHIRR-214:
-----------------------------------
Thanks Adrian, no worries. I think I got it from HadoopNameNodeClusterActionHandler.beforeConfigure(ClusterActionEvent) that writes the hadoop config files to tmp/.
I'll ask for further assistance if I get stuck.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-214) Add nodes to running clusters
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-214:
------------------------------
Attachment: zookeeper-repair-or-extend-cluster.patch
Attached a proof-of-concept implementation that adds a new command (repair-cluster) which can be used to repair or extend a ZooKeeper cluster with small downtime (reconfig + restart) and no data loss.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
> Attachments: zookeeper-repair-or-extend-cluster.patch
>
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994933#comment-12994933 ]
Adrian Cole commented on WHIRR-214:
-----------------------------------
no, but depending on how patient you are, I could create an example for this :)
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002742#comment-13002742 ]
Tom White commented on WHIRR-214:
---------------------------------
Fine by me as long as there is some service integration from the beginning (even if it is rudimentary, and e.g. just destroys the running nodes) to prove the abstraction. It's also important to clearly explain the behaviour to users, since there may be data loss scenarios.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995059#comment-12995059 ]
David Alves commented on WHIRR-214:
-----------------------------------
Got it. Service creates it and DestroyClusterCommand updates it.
Thanks
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002404#comment-13002404 ]
David Alves commented on WHIRR-214:
-----------------------------------
Should this patch take only care of expansion or also of contraction?
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994533#comment-12994533 ]
Adrian Cole commented on WHIRR-214:
-----------------------------------
one way to resize a cluster based on a current one is to persist the "template" of the cluster onto one of the machines (or all of the machines). Ex. serialize the template to json and copy it to disk. When going to resize the cluster, pick any member and the deserialize the template from this location.
ex. put(".template", Payloads.newStringPayload(json.asJson(template)))
make sense?
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002749#comment-13002749 ]
David Alves commented on WHIRR-214:
-----------------------------------
{quote}It's also important to clearly explain the behaviour to users, since there may be data loss scenarios.{quote}
Important point. What we could do here is to change either ClusterActionHandlerSupport or ClusterActionHandler to add new lifecycle stages that would execute before the Destroy stage. The rationale is that destroying a cluster is different than decommissioning nodes from a cluster. By making these changes and throwing UnsupportedOperationException by default services would mandatorily have to deal with them in order for decommissioning to work.
I also agree with having some service support from the beginning but this should probably go on another issue, right?
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994895#comment-12994895 ]
David Alves commented on WHIRR-214:
-----------------------------------
Makes a lot of sense :)
Is persisting data in the nodes to keep cluster state an out-of-the-box functionality in jclouds? if so can you point me to any examples?
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002771#comment-13002771 ]
Tom White commented on WHIRR-214:
---------------------------------
> I also agree with having some service support from the beginning but this should probably go on another issue, right?
It's hard if not impossible to design a general interface without having a concrete implementation so it's better to write a simple implementation as a part of the initial JIRA IMO.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984973#action_12984973 ]
Tom White commented on WHIRR-214:
---------------------------------
> A general solution would be to just have the user change the instance teamplates and then have whirr figure out the difference.
Indeed. To clarify a little further, I think we're talking about changing the cardinality (e.g. "10 dn+tt" to "20 dn+tt") rather than the cardinality and the groups (e.g. "10 dn+tt" to "20 dn+tt+hbase-regionserver"). In the latter case, Whirr would just start 20 new nodes.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984937#action_12984937 ]
Elliott Clark commented on WHIRR-214:
-------------------------------------
In thinking about it more. A general solution would be to just have the user change the instance teamplates and then have whirr figure out the difference.
Spinning up a new cluster is just the difference between 0 nodes and the templates
Adding to a cluster is the difference between whats currently running and the template.
Like Tom said this is idempotent so it could be part of a work flow.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994378#comment-12994378 ]
David Alves commented on WHIRR-214:
-----------------------------------
Some questions:
Cluster expansion/contraction is supposed to be in a new command right (e.g. ModifyClusterCommand)?
As I see it it could be something like:
whirr modify-cluster --instance-templates "20 dn+tt"
(where instance-templates was before 10 dn+tt)
My question is:
What are the "old" instance templates from which we are calculating the difference? is it the current cluster instance templates or the configured instance templates?
Is there a way to rebuild instance templates based on the current cluster states (instead of configuration). From what I gather in ListClusterCommand the only thing that is retrieved is current node metadata directly from jclouds (node ids, addresses, etc, not the actual services running on the nodes).
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995053#comment-12995053 ]
Tom White commented on WHIRR-214:
---------------------------------
> Is there a way to rebuild instance templates based on the current cluster states (instead of configuration)
When a cluster is started it writes the list of instances (including roles) to ~/.whirr/<cluster-name>/instances. You could use this to get the cluster status. Also, when the cluster is changed this file should be updated. (It might be nice to make this pluggable, but this probably belongs to another issue.)
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (WHIRR-214) Add nodes to running
clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995059#comment-12995059 ]
David Alves edited comment on WHIRR-214 at 2/16/11 4:06 AM:
------------------------------------------------------------
Got it. Service creates it and DestroyInstanceCommand updates it.
Thanks
was (Author: dr-alves):
Got it. Service creates it and DestroyClusterCommand updates it.
Thanks
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002651#comment-13002651 ]
Tom White commented on WHIRR-214:
---------------------------------
We should handle both, but not necessarily in this JIRA. In Hadoop, for example, contraction is harder than expansion since you have to manage the decommissioning process.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002495#comment-13002495 ]
Andrei Savu commented on WHIRR-214:
-----------------------------------
I believe we should handle both of them. A scalability monitor will need to able expand but also to contract the cluster as the performance requirements and the amount of data / requests changes.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-214) Add nodes to running clusters
Posted by "David Alves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002733#comment-13002733 ]
David Alves commented on WHIRR-214:
-----------------------------------
My suggestion would be to make the focus of this issue the non-service-specific part of expansion and contraction and to define hooks that specific services can use to handle adding and removing nodes from a running cluster, which as Tom said can be tricky in a series of cases.
> Add nodes to running clusters
> -----------------------------
>
> Key: WHIRR-214
> URL: https://issues.apache.org/jira/browse/WHIRR-214
> Project: Whirr
> Issue Type: New Feature
> Reporter: Elliott Clark
>
> I would like to be able to add a node to a running cluster.
> For example if I have created a hadoop, hbase, zookeeper cluster I would like to be able to add region servers to hbase, Zookeeper nodes to the quorum, and task nodes to hadoop.
> Something akin to the functionality of the hbase-ec2 script. Where if I launch a node on an already running cluster. It is configured to join the cluster.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira