You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MrAsanjar ." <af...@gmail.com> on 2015/04/19 18:17:41 UTC
Big Data Solution Project Proposal.
To whom it may concern,
My name is Amir Sanjar, Big Data Solution Development Lead at Canonical. My
team has been developing various Big Data solutions built on top of Apache
Hadoop, Hortonworks, and Cloudera distributions (i.e
https://jujucharms.com/big-data). We would like to contribute these and
future solutions to the Apache BigTop community. I wish to propose creating
a BigTop Solution project to house all big data solutions regardless of
orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet, ...),
any suggestions ?
Fwd: Big Data Solution Project Proposal.
Posted by jay vyas <ja...@gmail.com>.
Thanks for updating on this mrasanjar !!!!!!!!!!! Thats interesting to hear.
---------- Forwarded message ----------
From: MrAsanjar . <af...@gmail.com>
Date: Thu, May 14, 2015 at 8:49 AM
Subject: Re: Big Data Solution Project Proposal.
To: dev@bigtop.apache.org
Just to make sure the word is out -- CentoOS support has landed in juju
trunk, and can be demoed using development (1.24 alpha/beta etc) versions
of juju *now*.
We expect it to be added to the release notes and officially included as
part of 1.24 stable (June 15). That will of course be an early release,
and we expect there will be some bugs to iron out.
But as of 1.24 Juju will have support for CentoOS and Windows and that
should definitely be enough to indicate that we are multi-platform capable,
and as with any open source project, patches are always welcome from people
in the community that are eager to round out that list.
On Fri, May 8, 2015 at 1:34 PM, MrAsanjar . <af...@gmail.com> wrote:
> Hi Jay,
> Good question, CentOS support is going through it's beta testing now. I'll
> get you exact GA dates, but it should be soon.
>
>
> On Fri, May 8, 2015 at 1:25 PM, jay vyas <ja...@gmail.com>
> wrote:
>
>> hi mr asanjar. This is cool, so will juju's work on fedora/centos ?
>>
>> one identifying factor of bigtop is that it works identically well in
>> debian versus fedora based OSs
>>
>> On Fri, May 8, 2015 at 2:01 PM, MrAsanjar . <af...@gmail.com> wrote:
>>
>> > Hi Konstantin,
>> > Sorry for a late reply, I was on a long overdue vacation in sunny Malta
>> :)
>> > *The vision is to build a big-data solution ecosystem where it allows
>> > community collaboration in design and development of *
>> >
>> >
>> >
>> > *publicly available big-data solutions, regarless of the deployment
>> > mechanism.Regarding Juju, I envision its deployment model not only will
>> > co-exist but also will compliment other style of deployment/management
>> > mechanisms ( ), as it has done with ClouderaManager CH5.3
>> > https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
>> > <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
>> >
>> >
>> >
>> > *While Juju is written in Python, its charms can be written in any
>> > language. You can write them in Python, Bash, Puppet (i.e. bigtop
>> > deployment)and Chef scripts. *
>> > *I will be glad to provide any other information and answer questions.*
>> >
>> > On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org>
>> > wrote:
>> >
>> > > Hello Amir.
>> > >
>> > > Thanks a lot for reaching out to the Bigtop community! It be great to
>> > have
>> > > these hosted here as well as get some help to maintain them in the
>> > future.
>> > >
>> > > Could you please share with us a little bit more details on how you
>> > > envision
>> > > it would work and how it might co-exist or compliment our in-house
>> Puppet
>> > > deployment mechanism?
>> > >
>> > > Thanks in advance!
>> > > Cos
>> > >
>> > > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
>> > > > To whom it may concern,
>> > > > My name is Amir Sanjar, Big Data Solution Development Lead at
>> > Canonical.
>> > > My
>> > > > team has been developing various Big Data solutions built on top of
>> > > Apache
>> > > > Hadoop, Hortonworks, and Cloudera distributions (i.e
>> > > > https://jujucharms.com/big-data). We would like to contribute these
>> > and
>> > > > future solutions to the Apache BigTop community. I wish to propose
>> > > creating
>> > > > a BigTop Solution project to house all big data solutions
>> regardless of
>> > > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager,
>> puppet,
>> > > ...),
>> > > > any suggestions ?
>> > >
>> >
>>
>>
>>
>> --
>> jay vyas
>>
>
>
--
jay vyas
Re: Big Data Solution Project Proposal.
Posted by "MrAsanjar ." <af...@gmail.com>.
Just to make sure the word is out -- CentoOS support has landed in juju
trunk, and can be demoed using development (1.24 alpha/beta etc) versions
of juju *now*.
We expect it to be added to the release notes and officially included as
part of 1.24 stable (June 15). That will of course be an early release,
and we expect there will be some bugs to iron out.
But as of 1.24 Juju will have support for CentoOS and Windows and that
should definitely be enough to indicate that we are multi-platform capable,
and as with any open source project, patches are always welcome from people
in the community that are eager to round out that list.
On Fri, May 8, 2015 at 1:34 PM, MrAsanjar . <af...@gmail.com> wrote:
> Hi Jay,
> Good question, CentOS support is going through it's beta testing now. I'll
> get you exact GA dates, but it should be soon.
>
>
> On Fri, May 8, 2015 at 1:25 PM, jay vyas <ja...@gmail.com>
> wrote:
>
>> hi mr asanjar. This is cool, so will juju's work on fedora/centos ?
>>
>> one identifying factor of bigtop is that it works identically well in
>> debian versus fedora based OSs
>>
>> On Fri, May 8, 2015 at 2:01 PM, MrAsanjar . <af...@gmail.com> wrote:
>>
>> > Hi Konstantin,
>> > Sorry for a late reply, I was on a long overdue vacation in sunny Malta
>> :)
>> > *The vision is to build a big-data solution ecosystem where it allows
>> > community collaboration in design and development of *
>> >
>> >
>> >
>> > *publicly available big-data solutions, regarless of the deployment
>> > mechanism.Regarding Juju, I envision its deployment model not only will
>> > co-exist but also will compliment other style of deployment/management
>> > mechanisms ( ), as it has done with ClouderaManager CH5.3
>> > https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
>> > <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
>> >
>> >
>> >
>> > *While Juju is written in Python, its charms can be written in any
>> > language. You can write them in Python, Bash, Puppet (i.e. bigtop
>> > deployment)and Chef scripts. *
>> > *I will be glad to provide any other information and answer questions.*
>> >
>> > On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org>
>> > wrote:
>> >
>> > > Hello Amir.
>> > >
>> > > Thanks a lot for reaching out to the Bigtop community! It be great to
>> > have
>> > > these hosted here as well as get some help to maintain them in the
>> > future.
>> > >
>> > > Could you please share with us a little bit more details on how you
>> > > envision
>> > > it would work and how it might co-exist or compliment our in-house
>> Puppet
>> > > deployment mechanism?
>> > >
>> > > Thanks in advance!
>> > > Cos
>> > >
>> > > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
>> > > > To whom it may concern,
>> > > > My name is Amir Sanjar, Big Data Solution Development Lead at
>> > Canonical.
>> > > My
>> > > > team has been developing various Big Data solutions built on top of
>> > > Apache
>> > > > Hadoop, Hortonworks, and Cloudera distributions (i.e
>> > > > https://jujucharms.com/big-data). We would like to contribute these
>> > and
>> > > > future solutions to the Apache BigTop community. I wish to propose
>> > > creating
>> > > > a BigTop Solution project to house all big data solutions
>> regardless of
>> > > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager,
>> puppet,
>> > > ...),
>> > > > any suggestions ?
>> > >
>> >
>>
>>
>>
>> --
>> jay vyas
>>
>
>
Re: Big Data Solution Project Proposal.
Posted by "MrAsanjar ." <af...@gmail.com>.
Hi Jay,
Good question, CentOS support is going through it's beta testing now. I'll
get you exact GA dates, but it should be soon.
On Fri, May 8, 2015 at 1:25 PM, jay vyas <ja...@gmail.com>
wrote:
> hi mr asanjar. This is cool, so will juju's work on fedora/centos ?
>
> one identifying factor of bigtop is that it works identically well in
> debian versus fedora based OSs
>
> On Fri, May 8, 2015 at 2:01 PM, MrAsanjar . <af...@gmail.com> wrote:
>
> > Hi Konstantin,
> > Sorry for a late reply, I was on a long overdue vacation in sunny Malta
> :)
> > *The vision is to build a big-data solution ecosystem where it allows
> > community collaboration in design and development of *
> >
> >
> >
> > *publicly available big-data solutions, regarless of the deployment
> > mechanism.Regarding Juju, I envision its deployment model not only will
> > co-exist but also will compliment other style of deployment/management
> > mechanisms ( ), as it has done with ClouderaManager CH5.3
> > https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
> > <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
> >
> >
> >
> > *While Juju is written in Python, its charms can be written in any
> > language. You can write them in Python, Bash, Puppet (i.e. bigtop
> > deployment)and Chef scripts. *
> > *I will be glad to provide any other information and answer questions.*
> >
> > On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org>
> > wrote:
> >
> > > Hello Amir.
> > >
> > > Thanks a lot for reaching out to the Bigtop community! It be great to
> > have
> > > these hosted here as well as get some help to maintain them in the
> > future.
> > >
> > > Could you please share with us a little bit more details on how you
> > > envision
> > > it would work and how it might co-exist or compliment our in-house
> Puppet
> > > deployment mechanism?
> > >
> > > Thanks in advance!
> > > Cos
> > >
> > > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> > > > To whom it may concern,
> > > > My name is Amir Sanjar, Big Data Solution Development Lead at
> > Canonical.
> > > My
> > > > team has been developing various Big Data solutions built on top of
> > > Apache
> > > > Hadoop, Hortonworks, and Cloudera distributions (i.e
> > > > https://jujucharms.com/big-data). We would like to contribute these
> > and
> > > > future solutions to the Apache BigTop community. I wish to propose
> > > creating
> > > > a BigTop Solution project to house all big data solutions regardless
> of
> > > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet,
> > > ...),
> > > > any suggestions ?
> > >
> >
>
>
>
> --
> jay vyas
>
Re: Big Data Solution Project Proposal.
Posted by jay vyas <ja...@gmail.com>.
hi mr asanjar. This is cool, so will juju's work on fedora/centos ?
one identifying factor of bigtop is that it works identically well in
debian versus fedora based OSs
On Fri, May 8, 2015 at 2:01 PM, MrAsanjar . <af...@gmail.com> wrote:
> Hi Konstantin,
> Sorry for a late reply, I was on a long overdue vacation in sunny Malta :)
> *The vision is to build a big-data solution ecosystem where it allows
> community collaboration in design and development of *
>
>
>
> *publicly available big-data solutions, regarless of the deployment
> mechanism.Regarding Juju, I envision its deployment model not only will
> co-exist but also will compliment other style of deployment/management
> mechanisms ( ), as it has done with ClouderaManager CH5.3
> https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
> <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
>
>
>
> *While Juju is written in Python, its charms can be written in any
> language. You can write them in Python, Bash, Puppet (i.e. bigtop
> deployment)and Chef scripts. *
> *I will be glad to provide any other information and answer questions.*
>
> On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org>
> wrote:
>
> > Hello Amir.
> >
> > Thanks a lot for reaching out to the Bigtop community! It be great to
> have
> > these hosted here as well as get some help to maintain them in the
> future.
> >
> > Could you please share with us a little bit more details on how you
> > envision
> > it would work and how it might co-exist or compliment our in-house Puppet
> > deployment mechanism?
> >
> > Thanks in advance!
> > Cos
> >
> > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> > > To whom it may concern,
> > > My name is Amir Sanjar, Big Data Solution Development Lead at
> Canonical.
> > My
> > > team has been developing various Big Data solutions built on top of
> > Apache
> > > Hadoop, Hortonworks, and Cloudera distributions (i.e
> > > https://jujucharms.com/big-data). We would like to contribute these
> and
> > > future solutions to the Apache BigTop community. I wish to propose
> > creating
> > > a BigTop Solution project to house all big data solutions regardless of
> > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet,
> > ...),
> > > any suggestions ?
> >
>
--
jay vyas
Re: Big Data Solution Project Proposal.
Posted by "MrAsanjar ." <af...@gmail.com>.
Good questions:
Q) how do you think the charms will be contributed?
A) We are planing to move all charms to github, that will make the
contribution process much easier. Goal is to mirror bigtop contribution
process.
Q) How they are going to be maintained, by whom, etc.
A) we in canonical will maintain all contributed charms as a committer to
the project. However we will strongly recommend more community members to
join contributor and committer ranks, as any other open source project.
Q) How the interaction between Bigtop-proper and the
Juju charms store (?!) would be formed?
A) Charmstore is getting remapped, meanwhile we could provide tools to sync
bigtop<->Charmstore
On Thu, May 14, 2015 at 6:35 PM, Konstantin Boudnik <co...@apache.org> wrote:
> Thanks Amir.
>
> So, how do you think the charms will be contributed? How they are going to
> be
> maintained, by whom, etc. How the interaction between Bigtop-proper and the
> Juju charms store (?!) would be formed? I do not expect you to have ready
> answers for all these questions, but I'd love to have a discussion around
> these points: I am sure we'll be seeing more situations like that in the
> future.
>
> From Bigtop standpoint of view, something like this will probably belong
> to a
> contrib/ project, although we don't have such concept yet.
>
> Thanks in advance,
> Cos
>
> On Fri, May 08, 2015 at 01:01PM, MrAsanjar . wrote:
> > Hi Konstantin,
> > Sorry for a late reply, I was on a long overdue vacation in sunny Malta
> :)
> > *The vision is to build a big-data solution ecosystem where it allows
> > community collaboration in design and development of *
> >
> >
> >
> > *publicly available big-data solutions, regarless of the deployment
> > mechanism.Regarding Juju, I envision its deployment model not only will
> > co-exist but also will compliment other style of deployment/management
> > mechanisms ( ), as it has done with ClouderaManager CH5.3
> > https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
> > <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
> >
> >
> >
> > *While Juju is written in Python, its charms can be written in any
> > language. You can write them in Python, Bash, Puppet (i.e. bigtop
> > deployment)and Chef scripts. *
> > *I will be glad to provide any other information and answer questions.*
> >
> > On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org>
> wrote:
> >
> > > Hello Amir.
> > >
> > > Thanks a lot for reaching out to the Bigtop community! It be great to
> have
> > > these hosted here as well as get some help to maintain them in the
> future.
> > >
> > > Could you please share with us a little bit more details on how you
> > > envision
> > > it would work and how it might co-exist or compliment our in-house
> Puppet
> > > deployment mechanism?
> > >
> > > Thanks in advance!
> > > Cos
> > >
> > > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> > > > To whom it may concern,
> > > > My name is Amir Sanjar, Big Data Solution Development Lead at
> Canonical.
> > > My
> > > > team has been developing various Big Data solutions built on top of
> > > Apache
> > > > Hadoop, Hortonworks, and Cloudera distributions (i.e
> > > > https://jujucharms.com/big-data). We would like to contribute these
> and
> > > > future solutions to the Apache BigTop community. I wish to propose
> > > creating
> > > > a BigTop Solution project to house all big data solutions regardless
> of
> > > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet,
> > > ...),
> > > > any suggestions ?
> > >
>
Re: Big Data Solution Project Proposal.
Posted by Konstantin Boudnik <co...@apache.org>.
Thanks Amir.
So, how do you think the charms will be contributed? How they are going to be
maintained, by whom, etc. How the interaction between Bigtop-proper and the
Juju charms store (?!) would be formed? I do not expect you to have ready
answers for all these questions, but I'd love to have a discussion around
these points: I am sure we'll be seeing more situations like that in the
future.
>From Bigtop standpoint of view, something like this will probably belong to a
contrib/ project, although we don't have such concept yet.
Thanks in advance,
Cos
On Fri, May 08, 2015 at 01:01PM, MrAsanjar . wrote:
> Hi Konstantin,
> Sorry for a late reply, I was on a long overdue vacation in sunny Malta :)
> *The vision is to build a big-data solution ecosystem where it allows
> community collaboration in design and development of *
>
>
>
> *publicly available big-data solutions, regarless of the deployment
> mechanism.Regarding Juju, I envision its deployment model not only will
> co-exist but also will compliment other style of deployment/management
> mechanisms ( ), as it has done with ClouderaManager CH5.3
> https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
> <https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
>
>
>
> *While Juju is written in Python, its charms can be written in any
> language. You can write them in Python, Bash, Puppet (i.e. bigtop
> deployment)and Chef scripts. *
> *I will be glad to provide any other information and answer questions.*
>
> On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org> wrote:
>
> > Hello Amir.
> >
> > Thanks a lot for reaching out to the Bigtop community! It be great to have
> > these hosted here as well as get some help to maintain them in the future.
> >
> > Could you please share with us a little bit more details on how you
> > envision
> > it would work and how it might co-exist or compliment our in-house Puppet
> > deployment mechanism?
> >
> > Thanks in advance!
> > Cos
> >
> > On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> > > To whom it may concern,
> > > My name is Amir Sanjar, Big Data Solution Development Lead at Canonical.
> > My
> > > team has been developing various Big Data solutions built on top of
> > Apache
> > > Hadoop, Hortonworks, and Cloudera distributions (i.e
> > > https://jujucharms.com/big-data). We would like to contribute these and
> > > future solutions to the Apache BigTop community. I wish to propose
> > creating
> > > a BigTop Solution project to house all big data solutions regardless of
> > > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet,
> > ...),
> > > any suggestions ?
> >
Re: Big Data Solution Project Proposal.
Posted by "MrAsanjar ." <af...@gmail.com>.
Hi Konstantin,
Sorry for a late reply, I was on a long overdue vacation in sunny Malta :)
*The vision is to build a big-data solution ecosystem where it allows
community collaboration in design and development of *
*publicly available big-data solutions, regarless of the deployment
mechanism.Regarding Juju, I envision its deployment model not only will
co-exist but also will compliment other style of deployment/management
mechanisms ( ), as it has done with ClouderaManager CH5.3
https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13
<https://jujucharms.com/u/bigdata-dev/cdh5-cm/trusty/13>. *
*While Juju is written in Python, its charms can be written in any
language. You can write them in Python, Bash, Puppet (i.e. bigtop
deployment)and Chef scripts. *
*I will be glad to provide any other information and answer questions.*
On Fri, Apr 24, 2015 at 9:58 PM, Konstantin Boudnik <co...@apache.org> wrote:
> Hello Amir.
>
> Thanks a lot for reaching out to the Bigtop community! It be great to have
> these hosted here as well as get some help to maintain them in the future.
>
> Could you please share with us a little bit more details on how you
> envision
> it would work and how it might co-exist or compliment our in-house Puppet
> deployment mechanism?
>
> Thanks in advance!
> Cos
>
> On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> > To whom it may concern,
> > My name is Amir Sanjar, Big Data Solution Development Lead at Canonical.
> My
> > team has been developing various Big Data solutions built on top of
> Apache
> > Hadoop, Hortonworks, and Cloudera distributions (i.e
> > https://jujucharms.com/big-data). We would like to contribute these and
> > future solutions to the Apache BigTop community. I wish to propose
> creating
> > a BigTop Solution project to house all big data solutions regardless of
> > orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet,
> ...),
> > any suggestions ?
>
Re: Big Data Solution Project Proposal.
Posted by Konstantin Boudnik <co...@apache.org>.
Hello Amir.
Thanks a lot for reaching out to the Bigtop community! It be great to have
these hosted here as well as get some help to maintain them in the future.
Could you please share with us a little bit more details on how you envision
it would work and how it might co-exist or compliment our in-house Puppet
deployment mechanism?
Thanks in advance!
Cos
On Sun, Apr 19, 2015 at 11:17AM, MrAsanjar . wrote:
> To whom it may concern,
> My name is Amir Sanjar, Big Data Solution Development Lead at Canonical. My
> team has been developing various Big Data solutions built on top of Apache
> Hadoop, Hortonworks, and Cloudera distributions (i.e
> https://jujucharms.com/big-data). We would like to contribute these and
> future solutions to the Apache BigTop community. I wish to propose creating
> a BigTop Solution project to house all big data solutions regardless of
> orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet, ...),
> any suggestions ?
Re: Big Data Solution Project Proposal.
Posted by "Kelly, Jonathan" <jo...@amazon.com>.
Looks cool, but it seems to be licensed under GPL v3/LGPL, so it wouldn't be possible to contribute it to Apache Bigtop, would it?
~ Jonathan
Sent from Nine<http://www.9folders.com/>
From: "MrAsanjar ." <af...@gmail.com>
Sent: Apr 19, 2015 9:18 AM
To: dev@bigtop.apache.org
Subject: Big Data Solution Project Proposal.
To whom it may concern,
My name is Amir Sanjar, Big Data Solution Development Lead at Canonical. My
team has been developing various Big Data solutions built on top of Apache
Hadoop, Hortonworks, and Cloudera distributions (i.e
https://jujucharms.com/big-data). We would like to contribute these and
future solutions to the Apache BigTop community. I wish to propose creating
a BigTop Solution project to house all big data solutions regardless of
orchestration tool (i.e. Juju, Ambari, Chef, ClouderaManager, puppet, ...),
any suggestions ?