You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Michael G. Noll" <mi...@michael-noll.com> on 2014/02/26 09:53:43 UTC
Puppet module for deploying Kafka released
Hi everyone,
I have released a Puppet module to deploy Kafka 0.8 in case anyone is
interested.
The module uses Puppet parameterized classes and as such decouples code
(Puppet manifests) from configuration data -- hence you can use Puppet
Hiera to configure the way Kafka is deployed without having to write or
fork/modify Puppet manifests. The module is available under the Apache
v2 license. Any code contributions, bug reports, etc. are of course
very welcome.
The module including docs and examples is available at:
https://github.com/miguno/puppet-kafka
Enjoy!
Michael
Re: Puppet module for deploying Kafka released
Posted by François Langelier <f....@gmail.com>.
Andrew,
It's will be great to add a link to your prebuilt deb patch on your repo! ;)
What should I do if I am to build the debian package my self?
François Langelier
Étudiant en génie Logiciel - École de Technologie
Supérieure<http://www.etsmtl.ca/>
Capitaine Club Capra <http://capra.etsmtl.ca/>
VP-Communication - CS Games <http://csgames.org> 2014
Jeux de Génies <http://www.jdgets.com/> 2011 à 2014
Argentier Fraternité du Piranhas <http://fraternitedupiranha.com/> 2012-2014
Comité Organisateur Olympiades ÉTS 2012
Compétition Québécoise d'Ingénierie 2012 - Compétition Senior
On Wed, Feb 26, 2014 at 2:35 PM, Andrew Otto <ot...@wikimedia.org> wrote:
> Ah cool, missed that, thanks! I'm equally envious of the Hiera support in
> yours :)
>
>
>
> On Feb 26, 2014, at 12:00 PM, Michael G. Noll <mi...@michael-noll.com>
> wrote:
>
> > Andrew,
> >
> > I am actually referencing the WM puppet module (notably because it
> > targets Debian whereas ours is currently focused on RHEL). I really
> > like that your module already supports Kafka mirroring and jmxtrans. :-)
> >
> > --Michael
> >
> >
> > On 02/26/2014 03:41 PM, Andrew Otto wrote:
> >> Oh so many puppet modules!
> >>
> >> https://github.com/wikimedia/puppet-kafka
> >>
> >> This one requires a Kafka .deb built from
> https://github.com/wikimedia/operations-debs-kafka/tree/debian/debian,
> which can be found prebuilt here:
> >>
> >> http://apt.wikimedia.org/wikimedia/pool/universe/k/kafka/
> >>
> >> :)
> >
> >
>
>
Re: Puppet module for deploying Kafka released
Posted by Andrew Otto <ot...@wikimedia.org>.
Ah cool, missed that, thanks! I’m equally envious of the Hiera support in yours :)
On Feb 26, 2014, at 12:00 PM, Michael G. Noll <mi...@michael-noll.com> wrote:
> Andrew,
>
> I am actually referencing the WM puppet module (notably because it
> targets Debian whereas ours is currently focused on RHEL). I really
> like that your module already supports Kafka mirroring and jmxtrans. :-)
>
> --Michael
>
>
> On 02/26/2014 03:41 PM, Andrew Otto wrote:
>> Oh so many puppet modules!
>>
>> https://github.com/wikimedia/puppet-kafka
>>
>> This one requires a Kafka .deb built from https://github.com/wikimedia/operations-debs-kafka/tree/debian/debian, which can be found prebuilt here:
>>
>> http://apt.wikimedia.org/wikimedia/pool/universe/k/kafka/
>>
>> :)
>
>
Re: Puppet module for deploying Kafka released
Posted by "Michael G. Noll" <mi...@michael-noll.com>.
Andrew,
I am actually referencing the WM puppet module (notably because it
targets Debian whereas ours is currently focused on RHEL). I really
like that your module already supports Kafka mirroring and jmxtrans. :-)
--Michael
On 02/26/2014 03:41 PM, Andrew Otto wrote:
> Oh so many puppet modules!
>
> https://github.com/wikimedia/puppet-kafka
>
> This one requires a Kafka .deb built from https://github.com/wikimedia/operations-debs-kafka/tree/debian/debian, which can be found prebuilt here:
>
> http://apt.wikimedia.org/wikimedia/pool/universe/k/kafka/
>
> :)
Re: Puppet module for deploying Kafka released
Posted by Andrew Otto <ot...@wikimedia.org>.
Oh so many puppet modules!
https://github.com/wikimedia/puppet-kafka
This one requires a Kafka .deb built from https://github.com/wikimedia/operations-debs-kafka/tree/debian/debian, which can be found prebuilt here:
http://apt.wikimedia.org/wikimedia/pool/universe/k/kafka/
:)
On Feb 26, 2014, at 6:02 AM, Neha Narkhede <ne...@gmail.com> wrote:
> Thanks for sharing! I added this to our ecosystem page -
> https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem
>
>
> On Wed, Feb 26, 2014 at 2:36 AM, pushkar priyadarshi <
> priyadarshi.pushkar@gmail.com> wrote:
>
>> i have been using one from here.
>>
>> https://github.com/whisklabs/puppet-kafka
>> but had to fix few small problem like when this starts kafka as upstart
>> service it does not provide log path so kafka logs never appear since as a
>> service they dont have default terminal.
>>
>> Thanks for sharing.Will start using it.Any plans for adding this to puppet
>> labs?
>>
>> Regards,
>> Pushkar
>>
>>
>> On Wed, Feb 26, 2014 at 2:23 PM, Michael G. Noll
>> <mi...@michael-noll.com>wrote:
>>
>>> Hi everyone,
>>>
>>> I have released a Puppet module to deploy Kafka 0.8 in case anyone is
>>> interested.
>>>
>>> The module uses Puppet parameterized classes and as such decouples code
>>> (Puppet manifests) from configuration data -- hence you can use Puppet
>>> Hiera to configure the way Kafka is deployed without having to write or
>>> fork/modify Puppet manifests. The module is available under the Apache
>>> v2 license. Any code contributions, bug reports, etc. are of course
>>> very welcome.
>>>
>>> The module including docs and examples is available at:
>>> https://github.com/miguno/puppet-kafka
>>>
>>> Enjoy!
>>> Michael
>>>
>>>
>>>
>>>
>>
Re: Puppet module for deploying Kafka released
Posted by Neha Narkhede <ne...@gmail.com>.
Thanks for sharing! I added this to our ecosystem page -
https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem
On Wed, Feb 26, 2014 at 2:36 AM, pushkar priyadarshi <
priyadarshi.pushkar@gmail.com> wrote:
> i have been using one from here.
>
> https://github.com/whisklabs/puppet-kafka
> but had to fix few small problem like when this starts kafka as upstart
> service it does not provide log path so kafka logs never appear since as a
> service they dont have default terminal.
>
> Thanks for sharing.Will start using it.Any plans for adding this to puppet
> labs?
>
> Regards,
> Pushkar
>
>
> On Wed, Feb 26, 2014 at 2:23 PM, Michael G. Noll
> <mi...@michael-noll.com>wrote:
>
> > Hi everyone,
> >
> > I have released a Puppet module to deploy Kafka 0.8 in case anyone is
> > interested.
> >
> > The module uses Puppet parameterized classes and as such decouples code
> > (Puppet manifests) from configuration data -- hence you can use Puppet
> > Hiera to configure the way Kafka is deployed without having to write or
> > fork/modify Puppet manifests. The module is available under the Apache
> > v2 license. Any code contributions, bug reports, etc. are of course
> > very welcome.
> >
> > The module including docs and examples is available at:
> > https://github.com/miguno/puppet-kafka
> >
> > Enjoy!
> > Michael
> >
> >
> >
> >
>
Re: Puppet module for deploying Kafka released
Posted by pushkar priyadarshi <pr...@gmail.com>.
i have been using one from here.
https://github.com/whisklabs/puppet-kafka
but had to fix few small problem like when this starts kafka as upstart
service it does not provide log path so kafka logs never appear since as a
service they dont have default terminal.
Thanks for sharing.Will start using it.Any plans for adding this to puppet
labs?
Regards,
Pushkar
On Wed, Feb 26, 2014 at 2:23 PM, Michael G. Noll
<mi...@michael-noll.com>wrote:
> Hi everyone,
>
> I have released a Puppet module to deploy Kafka 0.8 in case anyone is
> interested.
>
> The module uses Puppet parameterized classes and as such decouples code
> (Puppet manifests) from configuration data -- hence you can use Puppet
> Hiera to configure the way Kafka is deployed without having to write or
> fork/modify Puppet manifests. The module is available under the Apache
> v2 license. Any code contributions, bug reports, etc. are of course
> very welcome.
>
> The module including docs and examples is available at:
> https://github.com/miguno/puppet-kafka
>
> Enjoy!
> Michael
>
>
>
>