You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Geeta Gharpure <ge...@gmail.com> on 2015/02/10 17:22:26 UTC
Ship Kafka in on prem product
Hello
I am looking for a reference about shipping kafka as part of Enterprise on
prem product. Does anyone know if Kafka can be redistributed safely and/or
is found secure enough to ship as part of enterprise product?
Thanks in advance for your help.
Thanks and regards,
Geeta
Re: Ship Kafka in on prem product
Posted by Gwen Shapira <gs...@cloudera.com>.
Thanks Joe :)
We definitely found Kafka to be solid enough for enterprise. It does
require taking care in shipping "safe" configurations.
Whether its secure enough depends on requirements - with no authentication,
authorization or encryptions, its definitely not secure enough for some use
cases (like serving as a centralized, distributed audit log).
Gwen
On Tue, Feb 10, 2015 at 9:03 AM, Joe Stein <jo...@stealth.ly> wrote:
> Hey Geeta, have you taken a look at
>
> http://www.cloudera.com/content/cloudera/en/developers/home/cloudera-labs/apache-kafka.html
> ??? I really liked what they did with 0.8.2-beta and the changes for
> 0.8.2.0 are looking good
> https://github.com/cloudera-labs/kafka/tree/cdh5-0.8.2_1.1.0 I don't know
> what their release plan is though.
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
> On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com>
> wrote:
>
> > Hello
> >
> > I am looking for a reference about shipping kafka as part of Enterprise
> on
> > prem product. Does anyone know if Kafka can be redistributed safely
> and/or
> > is found secure enough to ship as part of enterprise product?
> >
> > Thanks in advance for your help.
> >
> > Thanks and regards,
> > Geeta
> >
>
Re: Ship Kafka in on prem product
Posted by Joe Stein <jo...@stealth.ly>.
Hey Geeta, have you taken a look at
http://www.cloudera.com/content/cloudera/en/developers/home/cloudera-labs/apache-kafka.html
??? I really liked what they did with 0.8.2-beta and the changes for
0.8.2.0 are looking good
https://github.com/cloudera-labs/kafka/tree/cdh5-0.8.2_1.1.0 I don't know
what their release plan is though.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com> wrote:
> Hello
>
> I am looking for a reference about shipping kafka as part of Enterprise on
> prem product. Does anyone know if Kafka can be redistributed safely and/or
> is found secure enough to ship as part of enterprise product?
>
> Thanks in advance for your help.
>
> Thanks and regards,
> Geeta
>
Re: Ship Kafka in on prem product
Posted by David Morales <dm...@stratio.com>.
Hi,
I have shared this question with the devops team and i will keep this
thread updated.
Regards.
2015-02-16 16:14 GMT+01:00 Ivan Balashov <ib...@gmail.com>:
> David,
>
> Thanks for sharing this. Any plans to include 0.8.2 to the list of
> available packages?
> Or, any chance you could share your packaging script? Deb package for
> kafka 0.8.2 (or any other version for that matter) is sorely missed.
>
> Thanks,
>
> 2015-02-11 21:34 GMT+03:00 David Morales <dm...@stratio.com>:
> > Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> > which includes RPM and dev packages
> >
> > http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
> >
> > http://repository.stratio.com/sds/1.1/RHEL/
>
--
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>
<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
<https://twitter.com/StratioBD>*
Re: Ship Kafka in on prem product
Posted by Ivan Balashov <ib...@gmail.com>.
David,
Thanks for sharing this. Any plans to include 0.8.2 to the list of
available packages?
Or, any chance you could share your packaging script? Deb package for
kafka 0.8.2 (or any other version for that matter) is sorely missed.
Thanks,
2015-02-11 21:34 GMT+03:00 David Morales <dm...@stratio.com>:
> Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> which includes RPM and dev packages
>
> http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
>
> http://repository.stratio.com/sds/1.1/RHEL/
Re: Ship Kafka in on prem product
Posted by Otis Gospodnetic <ot...@gmail.com>.
+1. Although... would packages built and published by a third party be
considered trustworthy enough by others?
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Wed, Feb 11, 2015 at 1:45 PM, Joe Stein <jo...@stealth.ly> wrote:
> Cool!!!
>
> Maybe on the eco system confluence page we should have a packaging and/or
> distro section????
>
> ~ Joestein
>
> On Wed, Feb 11, 2015 at 1:34 PM, David Morales <dm...@stratio.com>
> wrote:
>
> > Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> > which includes RPM and dev packages
> >
> > http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
> >
> > http://repository.stratio.com/sds/1.1/RHEL/
> >
> >
> >
> > Regards.
> >
> >
> > 2015-02-11 19:22 GMT+01:00 Otis Gospodnetic <otis.gospodnetic@gmail.com
> >:
> >
> > > Hi,
> > >
> > > For what it's worth, we include Kafka (now 0.8.2) in our On Premises
> > > version of SPM and Logsene. Kafka is used to to transport metrics and
> > logs
> > > there.
> > >
> > > I do seem to recall some not-so-elegant stuff we had to do around
> > > packaging, though..... I think because
> > > http://kafka.apache.org/downloads.html has only archive files and not
> > > RPM/DEB packages.
> > >
> > > Otis
> > > --
> > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > > Solr & Elasticsearch Support * http://sematext.com/
> > >
> > >
> > > On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com>
> > > wrote:
> > >
> > > > Hello
> > > >
> > > > I am looking for a reference about shipping kafka as part of
> Enterprise
> > > on
> > > > prem product. Does anyone know if Kafka can be redistributed safely
> > > and/or
> > > > is found secure enough to ship as part of enterprise product?
> > > >
> > > > Thanks in advance for your help.
> > > >
> > > > Thanks and regards,
> > > > Geeta
> > > >
> > >
> >
> >
> >
> > --
> >
> > David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
> > <https://twitter.com/dmoralesdf>
> >
> >
> > <http://www.stratio.com/>
> > Vía de las dos Castillas, 33, Ática 4, 3ª Planta
> > 28224 Pozuelo de Alarcón, Madrid
> > Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
> > <https://twitter.com/StratioBD>*
> >
>
Re: Ship Kafka in on prem product
Posted by David Morales <dm...@stratio.com>.
That would be great... we will work on the new kafka version ASAP.
Regards.
2015-02-11 19:45 GMT+01:00 Joe Stein <jo...@stealth.ly>:
> Cool!!!
>
> Maybe on the eco system confluence page we should have a packaging and/or
> distro section????
>
> ~ Joestein
>
> On Wed, Feb 11, 2015 at 1:34 PM, David Morales <dm...@stratio.com>
> wrote:
>
> > Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> > which includes RPM and dev packages
> >
> > http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
> >
> > http://repository.stratio.com/sds/1.1/RHEL/
> >
> >
> >
> > Regards.
> >
> >
> > 2015-02-11 19:22 GMT+01:00 Otis Gospodnetic <otis.gospodnetic@gmail.com
> >:
> >
> > > Hi,
> > >
> > > For what it's worth, we include Kafka (now 0.8.2) in our On Premises
> > > version of SPM and Logsene. Kafka is used to to transport metrics and
> > logs
> > > there.
> > >
> > > I do seem to recall some not-so-elegant stuff we had to do around
> > > packaging, though..... I think because
> > > http://kafka.apache.org/downloads.html has only archive files and not
> > > RPM/DEB packages.
> > >
> > > Otis
> > > --
> > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > > Solr & Elasticsearch Support * http://sematext.com/
> > >
> > >
> > > On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com>
> > > wrote:
> > >
> > > > Hello
> > > >
> > > > I am looking for a reference about shipping kafka as part of
> Enterprise
> > > on
> > > > prem product. Does anyone know if Kafka can be redistributed safely
> > > and/or
> > > > is found secure enough to ship as part of enterprise product?
> > > >
> > > > Thanks in advance for your help.
> > > >
> > > > Thanks and regards,
> > > > Geeta
> > > >
> > >
> >
> >
> >
> > --
> >
> > David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
> > <https://twitter.com/dmoralesdf>
> >
> >
> > <http://www.stratio.com/>
> > Vía de las dos Castillas, 33, Ática 4, 3ª Planta
> > 28224 Pozuelo de Alarcón, Madrid
> > Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
> > <https://twitter.com/StratioBD>*
> >
>
--
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>
<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
<https://twitter.com/StratioBD>*
Re: Ship Kafka in on prem product
Posted by Joe Stein <jo...@stealth.ly>.
Cool!!!
Maybe on the eco system confluence page we should have a packaging and/or
distro section????
~ Joestein
On Wed, Feb 11, 2015 at 1:34 PM, David Morales <dm...@stratio.com> wrote:
> Regarding RPM/DEB packages, we, at stratio.com, have a public repository
> which includes RPM and dev packages
>
> http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
>
> http://repository.stratio.com/sds/1.1/RHEL/
>
>
>
> Regards.
>
>
> 2015-02-11 19:22 GMT+01:00 Otis Gospodnetic <ot...@gmail.com>:
>
> > Hi,
> >
> > For what it's worth, we include Kafka (now 0.8.2) in our On Premises
> > version of SPM and Logsene. Kafka is used to to transport metrics and
> logs
> > there.
> >
> > I do seem to recall some not-so-elegant stuff we had to do around
> > packaging, though..... I think because
> > http://kafka.apache.org/downloads.html has only archive files and not
> > RPM/DEB packages.
> >
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> > On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com>
> > wrote:
> >
> > > Hello
> > >
> > > I am looking for a reference about shipping kafka as part of Enterprise
> > on
> > > prem product. Does anyone know if Kafka can be redistributed safely
> > and/or
> > > is found secure enough to ship as part of enterprise product?
> > >
> > > Thanks in advance for your help.
> > >
> > > Thanks and regards,
> > > Geeta
> > >
> >
>
>
>
> --
>
> David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
> <https://twitter.com/dmoralesdf>
>
>
> <http://www.stratio.com/>
> Vía de las dos Castillas, 33, Ática 4, 3ª Planta
> 28224 Pozuelo de Alarcón, Madrid
> Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
> <https://twitter.com/StratioBD>*
>
Re: Ship Kafka in on prem product
Posted by David Morales <dm...@stratio.com>.
Regarding RPM/DEB packages, we, at stratio.com, have a public repository
which includes RPM and dev packages
http://repository.stratio.com/sds/1.1/ubuntu/13.10/binary/
http://repository.stratio.com/sds/1.1/RHEL/
Regards.
2015-02-11 19:22 GMT+01:00 Otis Gospodnetic <ot...@gmail.com>:
> Hi,
>
> For what it's worth, we include Kafka (now 0.8.2) in our On Premises
> version of SPM and Logsene. Kafka is used to to transport metrics and logs
> there.
>
> I do seem to recall some not-so-elegant stuff we had to do around
> packaging, though..... I think because
> http://kafka.apache.org/downloads.html has only archive files and not
> RPM/DEB packages.
>
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
> On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com>
> wrote:
>
> > Hello
> >
> > I am looking for a reference about shipping kafka as part of Enterprise
> on
> > prem product. Does anyone know if Kafka can be redistributed safely
> and/or
> > is found secure enough to ship as part of enterprise product?
> >
> > Thanks in advance for your help.
> >
> > Thanks and regards,
> > Geeta
> >
>
--
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>
<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
<https://twitter.com/StratioBD>*
Re: Ship Kafka in on prem product
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi,
For what it's worth, we include Kafka (now 0.8.2) in our On Premises
version of SPM and Logsene. Kafka is used to to transport metrics and logs
there.
I do seem to recall some not-so-elegant stuff we had to do around
packaging, though..... I think because
http://kafka.apache.org/downloads.html has only archive files and not
RPM/DEB packages.
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Tue, Feb 10, 2015 at 11:22 AM, Geeta Gharpure <ge...@gmail.com> wrote:
> Hello
>
> I am looking for a reference about shipping kafka as part of Enterprise on
> prem product. Does anyone know if Kafka can be redistributed safely and/or
> is found secure enough to ship as part of enterprise product?
>
> Thanks in advance for your help.
>
> Thanks and regards,
> Geeta
>