You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by vipul jhawar <vi...@gmail.com> on 2014/11/08 11:15:19 UTC
powered by kafka
Exponential @exponentialinc is using kafka in production to power the
events ingestion pipeline for real time analytics and log feed consumption.
Please post on powered by kafka wiki -
https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
Thanks
Vipul
http://in.linkedin.com/in/vjhawar/
Re: powered by kafka
Posted by Joe Stein <jo...@stealth.ly>.
Hey, I added you to the power by page and also ekaf to the Client Library
page too
https://cwiki.apache.org/confluence/display/KAFKA/Clients#Clients-Erlang
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Sat, Nov 15, 2014 at 6:13 AM, Bosky <bo...@helpshift.com> wrote:
> Helpshift <http://helpshift.com> produces billions of events with Kafka
> through an erlang based producer ekaf <http://github.com/helpshift/ekaf>
> that
> supports 8.0, and consumes topics primarily with storm and clojure.
>
> ~B
>
> On Mon, Nov 10, 2014 at 9:30 PM, Joe Stein <jo...@stealth.ly> wrote:
>
> > Cool, updated, thanks!!!
> >
> > On Mon, Nov 10, 2014 at 7:57 AM, Andrew Otto <ao...@wikimedia.org>
> wrote:
> >
> > > Oo, add us too!
> > >
> > > The Wikimedia Foundation (
> > http://wikimediafoundation.org/wiki/Our_projects)
> > > uses Kafka as a log transport for analytics data from production
> > webservers
> > > and applications. This data is consumed into Hadoop using Camus and to
> > > other processors of analytics data.
> > >
> > >
> > >
> > >
> > >
> > > > On Nov 10, 2014, at 9:56 AM, Yann Schwartz <y....@criteo.com>
> > > wrote:
> > > >
> > > > Hello,
> > > >
> > > > I'd just chime in then. Criteo ( http://www.criteo.com ) has been
> > using
> > > kafka for over a year for stream processing and log transfer (over 2M
> > > messages/s and growing)
> > > >
> > > > Yann.
> > > > ________________________________________
> > > > From: Joe Stein <jo...@stealth.ly>
> > > > Sent: Monday, November 10, 2014 2:03 PM
> > > > To: users@kafka.apache.org
> > > > Subject: Re: powered by kafka
> > > >
> > > > I added both Cityzen Data and Exoscale to the Wiki. Please feel free
> > to
> > > > edit and expand on how more. If you need edit permission let me know.
> > > >
> > > > /*******************************************
> > > > Joe Stein
> > > > Founder, Principal Consultant
> > > > Big Data Open Source Security LLC
> > > > http://www.stealth.ly
> > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > ********************************************/
> > > >
> > >
> > >
> >
>
Re: powered by kafka
Posted by Bosky <bo...@helpshift.com>.
Helpshift <http://helpshift.com> produces billions of events with Kafka
through an erlang based producer ekaf <http://github.com/helpshift/ekaf> that
supports 8.0, and consumes topics primarily with storm and clojure.
~B
On Mon, Nov 10, 2014 at 9:30 PM, Joe Stein <jo...@stealth.ly> wrote:
> Cool, updated, thanks!!!
>
> On Mon, Nov 10, 2014 at 7:57 AM, Andrew Otto <ao...@wikimedia.org> wrote:
>
> > Oo, add us too!
> >
> > The Wikimedia Foundation (
> http://wikimediafoundation.org/wiki/Our_projects)
> > uses Kafka as a log transport for analytics data from production
> webservers
> > and applications. This data is consumed into Hadoop using Camus and to
> > other processors of analytics data.
> >
> >
> >
> >
> >
> > > On Nov 10, 2014, at 9:56 AM, Yann Schwartz <y....@criteo.com>
> > wrote:
> > >
> > > Hello,
> > >
> > > I'd just chime in then. Criteo ( http://www.criteo.com ) has been
> using
> > kafka for over a year for stream processing and log transfer (over 2M
> > messages/s and growing)
> > >
> > > Yann.
> > > ________________________________________
> > > From: Joe Stein <jo...@stealth.ly>
> > > Sent: Monday, November 10, 2014 2:03 PM
> > > To: users@kafka.apache.org
> > > Subject: Re: powered by kafka
> > >
> > > I added both Cityzen Data and Exoscale to the Wiki. Please feel free
> to
> > > edit and expand on how more. If you need edit permission let me know.
> > >
> > > /*******************************************
> > > Joe Stein
> > > Founder, Principal Consultant
> > > Big Data Open Source Security LLC
> > > http://www.stealth.ly
> > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > ********************************************/
> > >
> >
> >
>
Re: powered by kafka
Posted by Joe Stein <jo...@stealth.ly>.
Cool, updated, thanks!!!
On Mon, Nov 10, 2014 at 7:57 AM, Andrew Otto <ao...@wikimedia.org> wrote:
> Oo, add us too!
>
> The Wikimedia Foundation (http://wikimediafoundation.org/wiki/Our_projects)
> uses Kafka as a log transport for analytics data from production webservers
> and applications. This data is consumed into Hadoop using Camus and to
> other processors of analytics data.
>
>
>
>
>
> > On Nov 10, 2014, at 9:56 AM, Yann Schwartz <y....@criteo.com>
> wrote:
> >
> > Hello,
> >
> > I'd just chime in then. Criteo ( http://www.criteo.com ) has been using
> kafka for over a year for stream processing and log transfer (over 2M
> messages/s and growing)
> >
> > Yann.
> > ________________________________________
> > From: Joe Stein <jo...@stealth.ly>
> > Sent: Monday, November 10, 2014 2:03 PM
> > To: users@kafka.apache.org
> > Subject: Re: powered by kafka
> >
> > I added both Cityzen Data and Exoscale to the Wiki. Please feel free to
> > edit and expand on how more. If you need edit permission let me know.
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > ********************************************/
> >
>
>
Re: powered by kafka
Posted by Andrew Otto <ao...@wikimedia.org>.
Oo, add us too!
The Wikimedia Foundation (http://wikimediafoundation.org/wiki/Our_projects) uses Kafka as a log transport for analytics data from production webservers and applications. This data is consumed into Hadoop using Camus and to other processors of analytics data.
> On Nov 10, 2014, at 9:56 AM, Yann Schwartz <y....@criteo.com> wrote:
>
> Hello,
>
> I'd just chime in then. Criteo ( http://www.criteo.com ) has been using kafka for over a year for stream processing and log transfer (over 2M messages/s and growing)
>
> Yann.
> ________________________________________
> From: Joe Stein <jo...@stealth.ly>
> Sent: Monday, November 10, 2014 2:03 PM
> To: users@kafka.apache.org
> Subject: Re: powered by kafka
>
> I added both Cityzen Data and Exoscale to the Wiki. Please feel free to
> edit and expand on how more. If you need edit permission let me know.
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
Re: powered by kafka
Posted by Joe Stein <jo...@stealth.ly>.
Awesome! updated, thanks!
On Mon, Nov 10, 2014 at 6:56 AM, Yann Schwartz <y....@criteo.com>
wrote:
> Hello,
>
> I'd just chime in then. Criteo ( http://www.criteo.com ) has been using
> kafka for over a year for stream processing and log transfer (over 2M
> messages/s and growing)
>
> Yann.
> ________________________________________
> From: Joe Stein <jo...@stealth.ly>
> Sent: Monday, November 10, 2014 2:03 PM
> To: users@kafka.apache.org
> Subject: Re: powered by kafka
>
> I added both Cityzen Data and Exoscale to the Wiki. Please feel free to
> edit and expand on how more. If you need edit permission let me know.
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
RE: powered by kafka
Posted by Yann Schwartz <y....@criteo.com>.
Hello,
I'd just chime in then. Criteo ( http://www.criteo.com ) has been using kafka for over a year for stream processing and log transfer (over 2M messages/s and growing)
Yann.
________________________________________
From: Joe Stein <jo...@stealth.ly>
Sent: Monday, November 10, 2014 2:03 PM
To: users@kafka.apache.org
Subject: Re: powered by kafka
I added both Cityzen Data and Exoscale to the Wiki. Please feel free to
edit and expand on how more. If you need edit permission let me know.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
Re: powered by kafka
Posted by Joe Stein <jo...@stealth.ly>.
I added both Cityzen Data and Exoscale to the Wiki. Please feel free to
edit and expand on how more. If you need edit permission let me know.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Mon, Nov 10, 2014 at 3:02 AM, Mathias Herberts <
mathias.herberts@gmail.com> wrote:
> Hi there,
>
> my company Cityzen Data uses Kafka as well, we provide a paltform for
> collecting, storing and analyzing machine data.
>
> http://www.cityzendata.com/
> @CityzenData
>
> Mathias.
>
> On Mon, Nov 10, 2014 at 11:57 AM, Pierre-Yves Ritschard
> <py...@spootnik.org> wrote:
> > I guess I should mention that exoscale (https://exoscale.ch) is powered
> by
> > kafka as well.
> >
> > Cheers,
> > - pyr
> >
> > On Sun, Nov 9, 2014 at 7:36 PM, Gwen Shapira <gs...@cloudera.com>
> wrote:
> >
> >> I'm not Jay, but fixed it anyways ;)
> >>
> >> Gwen
> >>
> >> On Sun, Nov 9, 2014 at 10:34 AM, vipul jhawar <vi...@gmail.com>
> >> wrote:
> >>
> >> > Hi Jay
> >> >
> >> > Thanks for posting the update.
> >> >
> >> > However, i checked the page history and the hyperlink is pointing to
> the
> >> > wrong domain.
> >> > Exponential refers to www.exponential.com. I sent the twitter handle,
> >> > should have sent the domain.
> >> > Please correct.
> >> >
> >> > Thanks
> >> >
> >> > On Sat, Nov 8, 2014 at 3:45 PM, vipul jhawar <vi...@gmail.com>
> >> > wrote:
> >> >
> >> > > Exponential @exponentialinc is using kafka in production to power
> the
> >> > > events ingestion pipeline for real time analytics and log feed
> >> > consumption.
> >> > >
> >> > > Please post on powered by kafka wiki -
> >> > > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
> >> > >
> >> > > Thanks
> >> > > Vipul
> >> > > http://in.linkedin.com/in/vjhawar/
> >> > >
> >> >
> >>
>
Re: powered by kafka
Posted by Mathias Herberts <ma...@gmail.com>.
Hi there,
my company Cityzen Data uses Kafka as well, we provide a paltform for
collecting, storing and analyzing machine data.
http://www.cityzendata.com/
@CityzenData
Mathias.
On Mon, Nov 10, 2014 at 11:57 AM, Pierre-Yves Ritschard
<py...@spootnik.org> wrote:
> I guess I should mention that exoscale (https://exoscale.ch) is powered by
> kafka as well.
>
> Cheers,
> - pyr
>
> On Sun, Nov 9, 2014 at 7:36 PM, Gwen Shapira <gs...@cloudera.com> wrote:
>
>> I'm not Jay, but fixed it anyways ;)
>>
>> Gwen
>>
>> On Sun, Nov 9, 2014 at 10:34 AM, vipul jhawar <vi...@gmail.com>
>> wrote:
>>
>> > Hi Jay
>> >
>> > Thanks for posting the update.
>> >
>> > However, i checked the page history and the hyperlink is pointing to the
>> > wrong domain.
>> > Exponential refers to www.exponential.com. I sent the twitter handle,
>> > should have sent the domain.
>> > Please correct.
>> >
>> > Thanks
>> >
>> > On Sat, Nov 8, 2014 at 3:45 PM, vipul jhawar <vi...@gmail.com>
>> > wrote:
>> >
>> > > Exponential @exponentialinc is using kafka in production to power the
>> > > events ingestion pipeline for real time analytics and log feed
>> > consumption.
>> > >
>> > > Please post on powered by kafka wiki -
>> > > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
>> > >
>> > > Thanks
>> > > Vipul
>> > > http://in.linkedin.com/in/vjhawar/
>> > >
>> >
>>
Re: powered by kafka
Posted by Pierre-Yves Ritschard <py...@spootnik.org>.
I guess I should mention that exoscale (https://exoscale.ch) is powered by
kafka as well.
Cheers,
- pyr
On Sun, Nov 9, 2014 at 7:36 PM, Gwen Shapira <gs...@cloudera.com> wrote:
> I'm not Jay, but fixed it anyways ;)
>
> Gwen
>
> On Sun, Nov 9, 2014 at 10:34 AM, vipul jhawar <vi...@gmail.com>
> wrote:
>
> > Hi Jay
> >
> > Thanks for posting the update.
> >
> > However, i checked the page history and the hyperlink is pointing to the
> > wrong domain.
> > Exponential refers to www.exponential.com. I sent the twitter handle,
> > should have sent the domain.
> > Please correct.
> >
> > Thanks
> >
> > On Sat, Nov 8, 2014 at 3:45 PM, vipul jhawar <vi...@gmail.com>
> > wrote:
> >
> > > Exponential @exponentialinc is using kafka in production to power the
> > > events ingestion pipeline for real time analytics and log feed
> > consumption.
> > >
> > > Please post on powered by kafka wiki -
> > > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
> > >
> > > Thanks
> > > Vipul
> > > http://in.linkedin.com/in/vjhawar/
> > >
> >
>
Re: powered by kafka
Posted by Gwen Shapira <gs...@cloudera.com>.
I'm not Jay, but fixed it anyways ;)
Gwen
On Sun, Nov 9, 2014 at 10:34 AM, vipul jhawar <vi...@gmail.com>
wrote:
> Hi Jay
>
> Thanks for posting the update.
>
> However, i checked the page history and the hyperlink is pointing to the
> wrong domain.
> Exponential refers to www.exponential.com. I sent the twitter handle,
> should have sent the domain.
> Please correct.
>
> Thanks
>
> On Sat, Nov 8, 2014 at 3:45 PM, vipul jhawar <vi...@gmail.com>
> wrote:
>
> > Exponential @exponentialinc is using kafka in production to power the
> > events ingestion pipeline for real time analytics and log feed
> consumption.
> >
> > Please post on powered by kafka wiki -
> > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
> >
> > Thanks
> > Vipul
> > http://in.linkedin.com/in/vjhawar/
> >
>
Re: powered by kafka
Posted by vipul jhawar <vi...@gmail.com>.
Hi Jay
Thanks for posting the update.
However, i checked the page history and the hyperlink is pointing to the
wrong domain.
Exponential refers to www.exponential.com. I sent the twitter handle,
should have sent the domain.
Please correct.
Thanks
On Sat, Nov 8, 2014 at 3:45 PM, vipul jhawar <vi...@gmail.com> wrote:
> Exponential @exponentialinc is using kafka in production to power the
> events ingestion pipeline for real time analytics and log feed consumption.
>
> Please post on powered by kafka wiki -
> https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
>
> Thanks
> Vipul
> http://in.linkedin.com/in/vjhawar/
>
Re: powered by kafka
Posted by Gwen Shapira <gs...@cloudera.com>.
Updated. Thanks!
On Sat, Nov 8, 2014 at 12:16 PM, Jimmy John <jj...@livefyre.com> wrote:
> Livefyre (http://web.livefyre.com/) uses kafka for the real time
> notifications, analytics pipeline and as the primary mechanism for general
> pub/sub.
>
> thx...
> jim
>
> On Sat, Nov 8, 2014 at 7:41 AM, Gwen Shapira <gs...@cloudera.com>
> wrote:
>
> > Done!
> >
> > Thank you for using Kafka and letting us know :)
> >
> > On Sat, Nov 8, 2014 at 2:15 AM, vipul jhawar <vi...@gmail.com>
> > wrote:
> >
> > > Exponential @exponentialinc is using kafka in production to power the
> > > events ingestion pipeline for real time analytics and log feed
> > consumption.
> > >
> > > Please post on powered by kafka wiki -
> > > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
> > >
> > > Thanks
> > > Vipul
> > > http://in.linkedin.com/in/vjhawar/
> > >
> >
>
Re: powered by kafka
Posted by Jimmy John <jj...@livefyre.com>.
Livefyre (http://web.livefyre.com/) uses kafka for the real time
notifications, analytics pipeline and as the primary mechanism for general
pub/sub.
thx...
jim
On Sat, Nov 8, 2014 at 7:41 AM, Gwen Shapira <gs...@cloudera.com> wrote:
> Done!
>
> Thank you for using Kafka and letting us know :)
>
> On Sat, Nov 8, 2014 at 2:15 AM, vipul jhawar <vi...@gmail.com>
> wrote:
>
> > Exponential @exponentialinc is using kafka in production to power the
> > events ingestion pipeline for real time analytics and log feed
> consumption.
> >
> > Please post on powered by kafka wiki -
> > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
> >
> > Thanks
> > Vipul
> > http://in.linkedin.com/in/vjhawar/
> >
>
Re: powered by kafka
Posted by Gwen Shapira <gs...@cloudera.com>.
Done!
Thank you for using Kafka and letting us know :)
On Sat, Nov 8, 2014 at 2:15 AM, vipul jhawar <vi...@gmail.com> wrote:
> Exponential @exponentialinc is using kafka in production to power the
> events ingestion pipeline for real time analytics and log feed consumption.
>
> Please post on powered by kafka wiki -
> https://cwiki.apache.org/confluence/display/KAFKA/Powered+By
>
> Thanks
> Vipul
> http://in.linkedin.com/in/vjhawar/
>