Ambari with Druid

[๏̯͡๏ <ÐΞ€ρ@Ҝ>, de...@gmail.com]

Hello
I really like the way ambari can be used to setup cluster effortlessly. I
would like to use this benefits

1. Druid is a distributed columnar store (druid.io)
2. Druid has several node types like, historical, realtime, broker and
coordinator.
3. Each of these can be started by unpacking a tar and start the java class
with Java 1.7. Its that simple.
4. Now i would like to use ambari to install druid on these various nodes,
just like we install hadoop on various nodes and then assign various
service to each of them.

How easy or difficult is to remove hadoop* out of ambari and replace it
with druid* or any other installation?

What do you think ? Can ambari be made that generic ?

1. Ambari allows you to install hadoop on a bunch of nodes and provide
monitoring like (service, cpu, disk, io)
2. Can ambari be made hadoop agnostic ? or generic enough that any cluster
could be installed with it ?
-- 
Deepak

Re: Ambari with Druid

[Pradeep Gollakota <pr...@gmail.com>]

https://cwiki.apache.org/confluence/display/AMBARI/Stacks+and+Services


On Wed, Jun 4, 2014 at 10:35 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:

> Custom stack ? Is this new feature with 1.6.0 ?
> Is this exposed from Web UI ? Or i this only REST interface ?
>
>
> On Wed, Jun 4, 2014 at 10:00 PM, Pradeep Gollakota <pr...@gmail.com>
> wrote:
>
>> Ambari has a concept of custom stacks. So, you can write a custom stack
>> to deploy Druid. At installation time, you can choose to install your Druid
>> stack but not the Hadoop stack.
>>
>>
>> On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com>
>> wrote:
>>
>>> Hello
>>> I really like the way ambari can be used to setup cluster effortlessly.
>>> I would like to use this benefits
>>>
>>> 1. Druid is a distributed columnar store (druid.io)
>>> 2. Druid has several node types like, historical, realtime, broker and
>>> coordinator.
>>> 3. Each of these can be started by unpacking a tar and start the java
>>> class with Java 1.7. Its that simple.
>>> 4. Now i would like to use ambari to install druid on these various
>>> nodes, just like we install hadoop on various nodes and then assign various
>>> service to each of them.
>>>
>>> How easy or difficult is to remove hadoop* out of ambari and replace it
>>> with druid* or any other installation?
>>>
>>> What do you think ? Can ambari be made that generic ?
>>>
>>> 1. Ambari allows you to install hadoop on a bunch of nodes and provide
>>> monitoring like (service, cpu, disk, io)
>>> 2. Can ambari be made hadoop agnostic ? or generic enough that any
>>> cluster could be installed with it ?
>>>  --
>>> Deepak
>>>
>>>
>>
>
>
> --
> Deepak
>
>

Re: Ambari with Druid

[๏̯͡๏ <ÐΞ€ρ@Ҝ>, de...@gmail.com]

Custom stack ? Is this new feature with 1.6.0 ?
Is this exposed from Web UI ? Or i this only REST interface ?


On Wed, Jun 4, 2014 at 10:00 PM, Pradeep Gollakota <pr...@gmail.com>
wrote:

> Ambari has a concept of custom stacks. So, you can write a custom stack to
> deploy Druid. At installation time, you can choose to install your Druid
> stack but not the Hadoop stack.
>
>
> On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
>
>> Hello
>> I really like the way ambari can be used to setup cluster effortlessly. I
>> would like to use this benefits
>>
>> 1. Druid is a distributed columnar store (druid.io)
>> 2. Druid has several node types like, historical, realtime, broker and
>> coordinator.
>> 3. Each of these can be started by unpacking a tar and start the java
>> class with Java 1.7. Its that simple.
>> 4. Now i would like to use ambari to install druid on these various
>> nodes, just like we install hadoop on various nodes and then assign various
>> service to each of them.
>>
>> How easy or difficult is to remove hadoop* out of ambari and replace it
>> with druid* or any other installation?
>>
>> What do you think ? Can ambari be made that generic ?
>>
>> 1. Ambari allows you to install hadoop on a bunch of nodes and provide
>> monitoring like (service, cpu, disk, io)
>> 2. Can ambari be made hadoop agnostic ? or generic enough that any
>> cluster could be installed with it ?
>>  --
>> Deepak
>>
>>
>


-- 
Deepak

Re: Ambari with Druid

[Pradeep Gollakota <pr...@gmail.com>]

Ambari has a concept of custom stacks. So, you can write a custom stack to
deploy Druid. At installation time, you can choose to install your Druid
stack but not the Hadoop stack.


On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:

> Hello
> I really like the way ambari can be used to setup cluster effortlessly. I
> would like to use this benefits
>
> 1. Druid is a distributed columnar store (druid.io)
> 2. Druid has several node types like, historical, realtime, broker and
> coordinator.
> 3. Each of these can be started by unpacking a tar and start the java
> class with Java 1.7. Its that simple.
> 4. Now i would like to use ambari to install druid on these various nodes,
> just like we install hadoop on various nodes and then assign various
> service to each of them.
>
> How easy or difficult is to remove hadoop* out of ambari and replace it
> with druid* or any other installation?
>
> What do you think ? Can ambari be made that generic ?
>
> 1. Ambari allows you to install hadoop on a bunch of nodes and provide
> monitoring like (service, cpu, disk, io)
> 2. Can ambari be made hadoop agnostic ? or generic enough that any cluster
> could be installed with it ?
> --
> Deepak
>
>

Re: Ambari with Druid

[Dion Dodgen <di...@gmail.com>]

Hi Deepak, Yusaku,

Since 1.5.1 you can add a custom stack yes, but code needs to be modified
to deploy a hadoop free stack.

Kind Regards,
Dion


On Wed, Jun 4, 2014 at 6:26 PM, Yusaku Sako <yu...@hortonworks.com> wrote:

> Deepak,
>
> That should be possible (may require some minimal changes).
> There's interest to be able to deploy Storm, without installing HDFS,
> for example, so this would be a similar use case.
> I think that currently the Web UI forces you to install HDFS (or HCFS).
>
> Yusaku
>
> On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> > Hello
> > I really like the way ambari can be used to setup cluster effortlessly. I
> > would like to use this benefits
> >
> > 1. Druid is a distributed columnar store (druid.io)
> > 2. Druid has several node types like, historical, realtime, broker and
> > coordinator.
> > 3. Each of these can be started by unpacking a tar and start the java
> class
> > with Java 1.7. Its that simple.
> > 4. Now i would like to use ambari to install druid on these various
> nodes,
> > just like we install hadoop on various nodes and then assign various
> service
> > to each of them.
> >
> > How easy or difficult is to remove hadoop* out of ambari and replace it
> with
> > druid* or any other installation?
> >
> > What do you think ? Can ambari be made that generic ?
> >
> > 1. Ambari allows you to install hadoop on a bunch of nodes and provide
> > monitoring like (service, cpu, disk, io)
> > 2. Can ambari be made hadoop agnostic ? or generic enough that any
> cluster
> > could be installed with it ?
> > --
> > Deepak
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>



-- 
Kind Regards,
Dion

Re: Ambari with Druid

[Yusaku Sako <yu...@hortonworks.com>]

Deepak,

That should be possible (may require some minimal changes).
There's interest to be able to deploy Storm, without installing HDFS,
for example, so this would be a similar use case.
I think that currently the Web UI forces you to install HDFS (or HCFS).

Yusaku

On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> Hello
> I really like the way ambari can be used to setup cluster effortlessly. I
> would like to use this benefits
>
> 1. Druid is a distributed columnar store (druid.io)
> 2. Druid has several node types like, historical, realtime, broker and
> coordinator.
> 3. Each of these can be started by unpacking a tar and start the java class
> with Java 1.7. Its that simple.
> 4. Now i would like to use ambari to install druid on these various nodes,
> just like we install hadoop on various nodes and then assign various service
> to each of them.
>
> How easy or difficult is to remove hadoop* out of ambari and replace it with
> druid* or any other installation?
>
> What do you think ? Can ambari be made that generic ?
>
> 1. Ambari allows you to install hadoop on a bunch of nodes and provide
> monitoring like (service, cpu, disk, io)
> 2. Can ambari be made hadoop agnostic ? or generic enough that any cluster
> could be installed with it ?
> --
> Deepak
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Ambari with Druid

[Yusaku Sako <yu...@hortonworks.com>]

Deepak,

That should be possible (may require some minimal changes).
There's interest to be able to deploy Storm, without installing HDFS,
for example, so this would be a similar use case.
I think that currently the Web UI forces you to install HDFS (or HCFS).

Yusaku

On Wed, Jun 4, 2014 at 9:21 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> Hello
> I really like the way ambari can be used to setup cluster effortlessly. I
> would like to use this benefits
>
> 1. Druid is a distributed columnar store (druid.io)
> 2. Druid has several node types like, historical, realtime, broker and
> coordinator.
> 3. Each of these can be started by unpacking a tar and start the java class
> with Java 1.7. Its that simple.
> 4. Now i would like to use ambari to install druid on these various nodes,
> just like we install hadoop on various nodes and then assign various service
> to each of them.
>
> How easy or difficult is to remove hadoop* out of ambari and replace it with
> druid* or any other installation?
>
> What do you think ? Can ambari be made that generic ?
>
> 1. Ambari allows you to install hadoop on a bunch of nodes and provide
> monitoring like (service, cpu, disk, io)
> 2. Can ambari be made hadoop agnostic ? or generic enough that any cluster
> could be installed with it ?
> --
> Deepak
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.