You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Dima Spivak <ds...@cloudera.com> on 2015/01/15 07:51:59 UTC
Alternative implementations of ClusterManager?
Hey folks,
I've been hacking about and trying to start making some contributions to
hbase-it this week, but have encountered a bit of a hurdle that some of you
might be able to help me get over.
In particular, according to the ref guide, cluster management (e.g. killing
RSs, starting a master) is handled by implementations of ClusterManager,
with the default being HBaseClusterManager. This makes sense and is the
source of the shell commands I see when I run things like ChaosMonkey from
the command line when executing an integration test. The ref guide also
states, though, that there are other implementations of ClusterManager,
including one for Apache Ambari that can be plugged in. My questions, then,
are:
1) Where is this Ambari implementation?
2) If I have the implementation in hand, how do I let ChaosMonkey know to
use it and not HBaseClusterManager to handle doing things to my distributed
cluster?
Cheers,
Dima
Re: Alternative implementations of ClusterManager?
Posted by Dima Spivak <ds...@cloudera.com>.
Vandana,
Great, that's just what I was looking for. Looks like I just need to
specify a class in hbase-site using the hbase.it.clustermanager.class
property and then ITU will pick it up from the classpath. Thanks for the
pointer.
Enis,
Okie doke, glad that I'm not just really bad at searching the code :). I'll
file a docs JIRA to bring the ref guide up to date for anyone else playing
with this stuff.
Thanks again,
Dima
On Thu, Jan 15, 2015 at 12:30 PM, Enis Söztutar <en...@gmail.com> wrote:
> Hi,
>
> Vandana answered the second q already. For the first, there is no concrete
> Ambari CM implemented. Probably the ref guide was mentioning a possible
> impl. I know though that some people have their own implementation
> (although in the code we have only one).
>
> Enis
>
> On Thu, Jan 15, 2015 at 9:38 AM, Vandana Ayyalsomayajula <
> mailvandana.ays@gmail.com> wrote:
>
> > Hi Dima,
> >
> > The IntegrationTestingUtility class sets the default cluster manager
> here:
> >
> >
> >
> https://github.com/apache/hbase/blob/0.98/hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java#L136
> >
> > You might have to make the cluster manager setting configurable and then
> > plug in your implementation.
> >
> > Thanks
> > Vandana
> >
> >
> > On Wed, Jan 14, 2015 at 10:51 PM, Dima Spivak <ds...@cloudera.com>
> > wrote:
> >
> > > Hey folks,
> > >
> > > I've been hacking about and trying to start making some contributions
> to
> > > hbase-it this week, but have encountered a bit of a hurdle that some of
> > you
> > > might be able to help me get over.
> > >
> > > In particular, according to the ref guide, cluster management (e.g.
> > killing
> > > RSs, starting a master) is handled by implementations of
> ClusterManager,
> > > with the default being HBaseClusterManager. This makes sense and is the
> > > source of the shell commands I see when I run things like ChaosMonkey
> > from
> > > the command line when executing an integration test. The ref guide also
> > > states, though, that there are other implementations of ClusterManager,
> > > including one for Apache Ambari that can be plugged in. My questions,
> > then,
> > > are:
> > >
> > > 1) Where is this Ambari implementation?
> > >
> > > 2) If I have the implementation in hand, how do I let ChaosMonkey know
> to
> > > use it and not HBaseClusterManager to handle doing things to my
> > distributed
> > > cluster?
> > >
> > > Cheers,
> > > Dima
> > >
> >
>
Re: Alternative implementations of ClusterManager?
Posted by Enis Söztutar <en...@gmail.com>.
Hi,
Vandana answered the second q already. For the first, there is no concrete
Ambari CM implemented. Probably the ref guide was mentioning a possible
impl. I know though that some people have their own implementation
(although in the code we have only one).
Enis
On Thu, Jan 15, 2015 at 9:38 AM, Vandana Ayyalsomayajula <
mailvandana.ays@gmail.com> wrote:
> Hi Dima,
>
> The IntegrationTestingUtility class sets the default cluster manager here:
>
>
> https://github.com/apache/hbase/blob/0.98/hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java#L136
>
> You might have to make the cluster manager setting configurable and then
> plug in your implementation.
>
> Thanks
> Vandana
>
>
> On Wed, Jan 14, 2015 at 10:51 PM, Dima Spivak <ds...@cloudera.com>
> wrote:
>
> > Hey folks,
> >
> > I've been hacking about and trying to start making some contributions to
> > hbase-it this week, but have encountered a bit of a hurdle that some of
> you
> > might be able to help me get over.
> >
> > In particular, according to the ref guide, cluster management (e.g.
> killing
> > RSs, starting a master) is handled by implementations of ClusterManager,
> > with the default being HBaseClusterManager. This makes sense and is the
> > source of the shell commands I see when I run things like ChaosMonkey
> from
> > the command line when executing an integration test. The ref guide also
> > states, though, that there are other implementations of ClusterManager,
> > including one for Apache Ambari that can be plugged in. My questions,
> then,
> > are:
> >
> > 1) Where is this Ambari implementation?
> >
> > 2) If I have the implementation in hand, how do I let ChaosMonkey know to
> > use it and not HBaseClusterManager to handle doing things to my
> distributed
> > cluster?
> >
> > Cheers,
> > Dima
> >
>
Re: Alternative implementations of ClusterManager?
Posted by Vandana Ayyalsomayajula <ma...@gmail.com>.
Hi Dima,
The IntegrationTestingUtility class sets the default cluster manager here:
https://github.com/apache/hbase/blob/0.98/hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java#L136
You might have to make the cluster manager setting configurable and then
plug in your implementation.
Thanks
Vandana
On Wed, Jan 14, 2015 at 10:51 PM, Dima Spivak <ds...@cloudera.com> wrote:
> Hey folks,
>
> I've been hacking about and trying to start making some contributions to
> hbase-it this week, but have encountered a bit of a hurdle that some of you
> might be able to help me get over.
>
> In particular, according to the ref guide, cluster management (e.g. killing
> RSs, starting a master) is handled by implementations of ClusterManager,
> with the default being HBaseClusterManager. This makes sense and is the
> source of the shell commands I see when I run things like ChaosMonkey from
> the command line when executing an integration test. The ref guide also
> states, though, that there are other implementations of ClusterManager,
> including one for Apache Ambari that can be plugged in. My questions, then,
> are:
>
> 1) Where is this Ambari implementation?
>
> 2) If I have the implementation in hand, how do I let ChaosMonkey know to
> use it and not HBaseClusterManager to handle doing things to my distributed
> cluster?
>
> Cheers,
> Dima
>