You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Vaibhav Puranik <vp...@gmail.com> on 2012/08/23 20:27:56 UTC
GumGum's usage of Kafka and Storm
Hi all,
In case you are interested here is my presentation on Kafka and Storm. It
also describes how we are using Kafka and Storm together.
http://www.ustream.tv/recorded/24877591
It describes our Kafka cluster (a small one) and our usecases. Also
introduces Kafka and Storm.
The initial company introduction is fast forwarded.
Regards,
Vaibhav
GumGum
Santa Monica
Re: GumGum's usage of Kafka and Storm
Posted by Something Something <ma...@gmail.com>.
Hold off on this for now :) It started working after I changed it to:
SpoutConfig.fromHostStrings(ImmutableList.of("localhost:*9092*"), 1,
"test", "/foo", "foo");
On Sat, Aug 25, 2012 at 11:06 AM, Something Something <
mailinglists19@gmail.com> wrote:
> Thanks for sharing this presentation. It's awesome. You mentioned that
> you have created your own version of SimpleKafkaSpout. Was that because
> the KafkaSpout didnt' work for you?
>
> For the past couple of days I have been trying to get KakfaSpout, Tridents
> Transactional & Opaque Kafka Spouts to work but haven't had any luck.
>
> Care to share your SimpleKafkaSpout ;) I am assuming it works with
> kafka-0.7.1-incubating & storm 0.8.0, correct?
>
> Here's how I am using the KafkaSpout:
>
> SpoutConfig spoutConfig =
> SpoutConfig.fromHostStrings(ImmutableList.of("localhost:2181"), 1, "test",
> "/foo", "foo");
> spoutConfig.zkServers = ImmutableList.of("localhost");
> spoutConfig.zkPort = 2181;
> spoutConfig.scheme = new StringScheme();
> spoutConfig.forceStartOffsetTime(-2);
> builder.setSpout("spout", new KafkaSpout(spoutConfig), 5);
>
> Do you see anything wrong with this?
>
> Thanks again for sharing your preso.
>
>
>
> On Fri, Aug 24, 2012 at 9:25 AM, Vaibhav Puranik <vp...@gmail.com>wrote:
>
>> Thanks Jun. It's done.
>>
>> Regards,
>> Vaibhav
>>
>> On Fri, Aug 24, 2012 at 6:44 AM, Jun Rao <ju...@gmail.com> wrote:
>>
>> > Vaibhav,
>> >
>> > Thanks for sharing this. Could you add the link to the presentation
>> section
>> > in our wiki?
>> >
>> > Jun
>> >
>> > On Thu, Aug 23, 2012 at 11:27 AM, Vaibhav Puranik <vpuranik@gmail.com
>> > >wrote:
>> >
>> > > Hi all,
>> > >
>> > > In case you are interested here is my presentation on Kafka and
>> Storm. It
>> > > also describes how we are using Kafka and Storm together.
>> > >
>> > > http://www.ustream.tv/recorded/24877591
>> > >
>> > > It describes our Kafka cluster (a small one) and our usecases. Also
>> > > introduces Kafka and Storm.
>> > >
>> > > The initial company introduction is fast forwarded.
>> > >
>> > > Regards,
>> > > Vaibhav
>> > > GumGum
>> > > Santa Monica
>> > >
>> >
>>
>
>
Re: GumGum's usage of Kafka and Storm
Posted by Something Something <ma...@gmail.com>.
Thanks for sharing this presentation. It's awesome. You mentioned that
you have created your own version of SimpleKafkaSpout. Was that because
the KafkaSpout didnt' work for you?
For the past couple of days I have been trying to get KakfaSpout, Tridents
Transactional & Opaque Kafka Spouts to work but haven't had any luck.
Care to share your SimpleKafkaSpout ;) I am assuming it works with
kafka-0.7.1-incubating & storm 0.8.0, correct?
Here's how I am using the KafkaSpout:
SpoutConfig spoutConfig =
SpoutConfig.fromHostStrings(ImmutableList.of("localhost:2181"), 1, "test",
"/foo", "foo");
spoutConfig.zkServers = ImmutableList.of("localhost");
spoutConfig.zkPort = 2181;
spoutConfig.scheme = new StringScheme();
spoutConfig.forceStartOffsetTime(-2);
builder.setSpout("spout", new KafkaSpout(spoutConfig), 5);
Do you see anything wrong with this?
Thanks again for sharing your preso.
On Fri, Aug 24, 2012 at 9:25 AM, Vaibhav Puranik <vp...@gmail.com> wrote:
> Thanks Jun. It's done.
>
> Regards,
> Vaibhav
>
> On Fri, Aug 24, 2012 at 6:44 AM, Jun Rao <ju...@gmail.com> wrote:
>
> > Vaibhav,
> >
> > Thanks for sharing this. Could you add the link to the presentation
> section
> > in our wiki?
> >
> > Jun
> >
> > On Thu, Aug 23, 2012 at 11:27 AM, Vaibhav Puranik <vpuranik@gmail.com
> > >wrote:
> >
> > > Hi all,
> > >
> > > In case you are interested here is my presentation on Kafka and Storm.
> It
> > > also describes how we are using Kafka and Storm together.
> > >
> > > http://www.ustream.tv/recorded/24877591
> > >
> > > It describes our Kafka cluster (a small one) and our usecases. Also
> > > introduces Kafka and Storm.
> > >
> > > The initial company introduction is fast forwarded.
> > >
> > > Regards,
> > > Vaibhav
> > > GumGum
> > > Santa Monica
> > >
> >
>
Re: GumGum's usage of Kafka and Storm
Posted by Vaibhav Puranik <vp...@gmail.com>.
Thanks Jun. It's done.
Regards,
Vaibhav
On Fri, Aug 24, 2012 at 6:44 AM, Jun Rao <ju...@gmail.com> wrote:
> Vaibhav,
>
> Thanks for sharing this. Could you add the link to the presentation section
> in our wiki?
>
> Jun
>
> On Thu, Aug 23, 2012 at 11:27 AM, Vaibhav Puranik <vpuranik@gmail.com
> >wrote:
>
> > Hi all,
> >
> > In case you are interested here is my presentation on Kafka and Storm. It
> > also describes how we are using Kafka and Storm together.
> >
> > http://www.ustream.tv/recorded/24877591
> >
> > It describes our Kafka cluster (a small one) and our usecases. Also
> > introduces Kafka and Storm.
> >
> > The initial company introduction is fast forwarded.
> >
> > Regards,
> > Vaibhav
> > GumGum
> > Santa Monica
> >
>
Re: GumGum's usage of Kafka and Storm
Posted by Jun Rao <ju...@gmail.com>.
Vaibhav,
Thanks for sharing this. Could you add the link to the presentation section
in our wiki?
Jun
On Thu, Aug 23, 2012 at 11:27 AM, Vaibhav Puranik <vp...@gmail.com>wrote:
> Hi all,
>
> In case you are interested here is my presentation on Kafka and Storm. It
> also describes how we are using Kafka and Storm together.
>
> http://www.ustream.tv/recorded/24877591
>
> It describes our Kafka cluster (a small one) and our usecases. Also
> introduces Kafka and Storm.
>
> The initial company introduction is fast forwarded.
>
> Regards,
> Vaibhav
> GumGum
> Santa Monica
>