You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Sean Allen <se...@monkeysnatchbanana.com> on 2013/12/23 14:33:30 UTC
New Storm Book available
Hi all,
I'm on of the authors of a new book on Storm that Manning released as a
MEAP last week. Its currently on sale for 50% through December 26th if you
use the code sallenco at time of purchase.
The 3 of us who have been working on 'Storm Applied' hope you find the book
useful. You can download a sample chapter from the MEAP site at
http://www.manning.com/sallen/ to get a feel for the book.
The first 3 of the book is an attempt to make sure that the reader has a
decent grounding in Storm concepts before we carry on to more advanced
topics as well as "getting the reader thinking in Storm". More advanced
topics are coming.
The book is built around a series of use cases where we introduce different
Storm concepts in a "as needed/on demand" fashion that matches how we
learned Storm by doing. If you have any question, please fire away either
in response to this, in a personal email or on the author's forum.
Thanks,
Sean
--
Ce n'est pas une signature
Re: New Storm Book available
Posted by Edison <xe...@gmail.com>.
Chris,
I solved my problem. TransactionalTridentKafkaSpout is working fine. I set
the max spout pending value to 10000. And it's this value impacting the
Trident bolt execution, and bringing the delay.
BRS,
Edison
2013/12/24 Edison <xe...@gmail.com>
> Chris,
> It's OK. I'm trying to write some sample codes and raise a issue to the
> proj.
>
> Thanks,
>
>
> 2013/12/24 Chris Bedford <ch...@buildlackey.com>
>
>> Hi, Edison - I use the wurstmeister<https://github.com/wurstmeister/storm-kafka-0.8-plus> version...
>> same as you. but i have not tried the TransactionalTridentKafkaSpout.
>> sorry.
>>
>>
>> On Mon, Dec 23, 2013 at 8:32 PM, Edison <xe...@gmail.com> wrote:
>>
>>> Hi Chris,
>>>
>>> I'm also using Storm/Kafka within my project. Old KafkaSpout can not be
>>> used for Kafka 0.8+, so I used another one here
>>> https://github.com/wurstmeister/storm-kafka-0.8-plus. For the
>>> KafkaSpout, it's working with greate performance. But for the TransactionalTridentKafkaSpout,
>>> I don't know why, some delay is introduced in the spout. Did you face the
>>> issue?
>>>
>>> - Edison
>>>
>>>
>>> 2013/12/24 Chris Bedford <ch...@buildlackey.com>
>>>
>>>> Hi, Sean -
>>>>
>>>> are you going to talk about the Storm/Kafka spout in your book ? I am
>>>> using it on my current project and I think it is a really useful way to
>>>> talk to Kafka. It uses the more efficient (but trickier) simple consumer
>>>> API to consume kafka messages in batch and it seems to dynamically respond
>>>> to changes in partition layout. The only problem is that it needs to be
>>>> more thoroughly documented. A chapter in your book that clarifies its
>>>> usage would be quite helpful.
>>>>
>>>> Integration testing with storm/kafka is also tricky. I put up a public
>>>> example of how I am doing it on my project here:
>>>>
>>>> > https://github.com/buildlackey/cep
>>>>
>>>> i am hoping to get in touch with the original author of the code (Jason
>>>> Jackson, I believe) and maybe buy him a beer if he helps me with some
>>>> knowledge transfer that enables me to improve the documentation and maybe
>>>> helps me write some additional unit tests that illustrate advanced usage.
>>>> The client I am working for will likely depend on this library if we
>>>> continue to use it through roll-out to production. But to give them
>>>> additional confidence we need to understand it a bit better than we do now.
>>>>
>>>> I'm happy to share any insight I obtain with you for your book
>>>>
>>>> - chris
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <
>>>> sean@monkeysnatchbanana.com> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I'm on of the authors of a new book on Storm that Manning released as
>>>>> a MEAP last week. Its currently on sale for 50% through December 26th if
>>>>> you use the code sallenco at time of purchase.
>>>>>
>>>>> The 3 of us who have been working on 'Storm Applied' hope you find the
>>>>> book useful. You can download a sample chapter from the MEAP site at
>>>>> http://www.manning.com/sallen/ to get a feel for the book.
>>>>>
>>>>> The first 3 of the book is an attempt to make sure that the reader has
>>>>> a decent grounding in Storm concepts before we carry on to more advanced
>>>>> topics as well as "getting the reader thinking in Storm". More advanced
>>>>> topics are coming.
>>>>>
>>>>> The book is built around a series of use cases where we introduce
>>>>> different Storm concepts in a "as needed/on demand" fashion that matches
>>>>> how we learned Storm by doing. If you have any question, please fire away
>>>>> either in response to this, in a personal email or on the author's forum.
>>>>>
>>>>> Thanks,
>>>>> Sean
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Ce n'est pas une signature
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Chris Bedford
>>>>
>>>> Founder & Lead Lackey
>>>> Build Lackey Labs: http://buildlackey.com
>>>> Go Grails!: http://blog.buildlackey.com
>>>>
>>>>
>>>>
>>>
>>
>>
>> --
>> Chris Bedford
>>
>> Founder & Lead Lackey
>> Build Lackey Labs: http://buildlackey.com
>> Go Grails!: http://blog.buildlackey.com
>>
>>
>>
>
Re: New Storm Book available
Posted by Edison <xe...@gmail.com>.
Chris,
It's OK. I'm trying to write some sample codes and raise a issue to the
proj.
Thanks,
2013/12/24 Chris Bedford <ch...@buildlackey.com>
> Hi, Edison - I use the wurstmeister<https://github.com/wurstmeister/storm-kafka-0.8-plus> version...
> same as you. but i have not tried the TransactionalTridentKafkaSpout.
> sorry.
>
>
> On Mon, Dec 23, 2013 at 8:32 PM, Edison <xe...@gmail.com> wrote:
>
>> Hi Chris,
>>
>> I'm also using Storm/Kafka within my project. Old KafkaSpout can not be
>> used for Kafka 0.8+, so I used another one here
>> https://github.com/wurstmeister/storm-kafka-0.8-plus. For the
>> KafkaSpout, it's working with greate performance. But for the TransactionalTridentKafkaSpout,
>> I don't know why, some delay is introduced in the spout. Did you face the
>> issue?
>>
>> - Edison
>>
>>
>> 2013/12/24 Chris Bedford <ch...@buildlackey.com>
>>
>>> Hi, Sean -
>>>
>>> are you going to talk about the Storm/Kafka spout in your book ? I am
>>> using it on my current project and I think it is a really useful way to
>>> talk to Kafka. It uses the more efficient (but trickier) simple consumer
>>> API to consume kafka messages in batch and it seems to dynamically respond
>>> to changes in partition layout. The only problem is that it needs to be
>>> more thoroughly documented. A chapter in your book that clarifies its
>>> usage would be quite helpful.
>>>
>>> Integration testing with storm/kafka is also tricky. I put up a public
>>> example of how I am doing it on my project here:
>>>
>>> > https://github.com/buildlackey/cep
>>>
>>> i am hoping to get in touch with the original author of the code (Jason
>>> Jackson, I believe) and maybe buy him a beer if he helps me with some
>>> knowledge transfer that enables me to improve the documentation and maybe
>>> helps me write some additional unit tests that illustrate advanced usage.
>>> The client I am working for will likely depend on this library if we
>>> continue to use it through roll-out to production. But to give them
>>> additional confidence we need to understand it a bit better than we do now.
>>>
>>> I'm happy to share any insight I obtain with you for your book
>>>
>>> - chris
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <sean@monkeysnatchbanana.com
>>> > wrote:
>>>
>>>> Hi all,
>>>>
>>>> I'm on of the authors of a new book on Storm that Manning released as a
>>>> MEAP last week. Its currently on sale for 50% through December 26th if you
>>>> use the code sallenco at time of purchase.
>>>>
>>>> The 3 of us who have been working on 'Storm Applied' hope you find the
>>>> book useful. You can download a sample chapter from the MEAP site at
>>>> http://www.manning.com/sallen/ to get a feel for the book.
>>>>
>>>> The first 3 of the book is an attempt to make sure that the reader has
>>>> a decent grounding in Storm concepts before we carry on to more advanced
>>>> topics as well as "getting the reader thinking in Storm". More advanced
>>>> topics are coming.
>>>>
>>>> The book is built around a series of use cases where we introduce
>>>> different Storm concepts in a "as needed/on demand" fashion that matches
>>>> how we learned Storm by doing. If you have any question, please fire away
>>>> either in response to this, in a personal email or on the author's forum.
>>>>
>>>> Thanks,
>>>> Sean
>>>>
>>>>
>>>> --
>>>>
>>>> Ce n'est pas une signature
>>>>
>>>
>>>
>>>
>>> --
>>> Chris Bedford
>>>
>>> Founder & Lead Lackey
>>> Build Lackey Labs: http://buildlackey.com
>>> Go Grails!: http://blog.buildlackey.com
>>>
>>>
>>>
>>
>
>
> --
> Chris Bedford
>
> Founder & Lead Lackey
> Build Lackey Labs: http://buildlackey.com
> Go Grails!: http://blog.buildlackey.com
>
>
>
Re: New Storm Book available
Posted by Chris Bedford <ch...@buildlackey.com>.
Hi, Edison - I use the
wurstmeister<https://github.com/wurstmeister/storm-kafka-0.8-plus>
version...
same as you. but i have not tried the TransactionalTridentKafkaSpout.
sorry.
On Mon, Dec 23, 2013 at 8:32 PM, Edison <xe...@gmail.com> wrote:
> Hi Chris,
>
> I'm also using Storm/Kafka within my project. Old KafkaSpout can not be
> used for Kafka 0.8+, so I used another one here
> https://github.com/wurstmeister/storm-kafka-0.8-plus. For the KafkaSpout,
> it's working with greate performance. But for the TransactionalTridentKafkaSpout,
> I don't know why, some delay is introduced in the spout. Did you face the
> issue?
>
> - Edison
>
>
> 2013/12/24 Chris Bedford <ch...@buildlackey.com>
>
>> Hi, Sean -
>>
>> are you going to talk about the Storm/Kafka spout in your book ? I am
>> using it on my current project and I think it is a really useful way to
>> talk to Kafka. It uses the more efficient (but trickier) simple consumer
>> API to consume kafka messages in batch and it seems to dynamically respond
>> to changes in partition layout. The only problem is that it needs to be
>> more thoroughly documented. A chapter in your book that clarifies its
>> usage would be quite helpful.
>>
>> Integration testing with storm/kafka is also tricky. I put up a public
>> example of how I am doing it on my project here:
>>
>> > https://github.com/buildlackey/cep
>>
>> i am hoping to get in touch with the original author of the code (Jason
>> Jackson, I believe) and maybe buy him a beer if he helps me with some
>> knowledge transfer that enables me to improve the documentation and maybe
>> helps me write some additional unit tests that illustrate advanced usage.
>> The client I am working for will likely depend on this library if we
>> continue to use it through roll-out to production. But to give them
>> additional confidence we need to understand it a bit better than we do now.
>>
>> I'm happy to share any insight I obtain with you for your book
>>
>> - chris
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <se...@monkeysnatchbanana.com>wrote:
>>
>>> Hi all,
>>>
>>> I'm on of the authors of a new book on Storm that Manning released as a
>>> MEAP last week. Its currently on sale for 50% through December 26th if you
>>> use the code sallenco at time of purchase.
>>>
>>> The 3 of us who have been working on 'Storm Applied' hope you find the
>>> book useful. You can download a sample chapter from the MEAP site at
>>> http://www.manning.com/sallen/ to get a feel for the book.
>>>
>>> The first 3 of the book is an attempt to make sure that the reader has a
>>> decent grounding in Storm concepts before we carry on to more advanced
>>> topics as well as "getting the reader thinking in Storm". More advanced
>>> topics are coming.
>>>
>>> The book is built around a series of use cases where we introduce
>>> different Storm concepts in a "as needed/on demand" fashion that matches
>>> how we learned Storm by doing. If you have any question, please fire away
>>> either in response to this, in a personal email or on the author's forum.
>>>
>>> Thanks,
>>> Sean
>>>
>>>
>>> --
>>>
>>> Ce n'est pas une signature
>>>
>>
>>
>>
>> --
>> Chris Bedford
>>
>> Founder & Lead Lackey
>> Build Lackey Labs: http://buildlackey.com
>> Go Grails!: http://blog.buildlackey.com
>>
>>
>>
>
--
Chris Bedford
Founder & Lead Lackey
Build Lackey Labs: http://buildlackey.com
Go Grails!: http://blog.buildlackey.com
Re: New Storm Book available
Posted by Edison <xe...@gmail.com>.
Hi Chris,
I'm also using Storm/Kafka within my project. Old KafkaSpout can not be
used for Kafka 0.8+, so I used another one here
https://github.com/wurstmeister/storm-kafka-0.8-plus. For the KafkaSpout,
it's working with greate performance. But for the
TransactionalTridentKafkaSpout,
I don't know why, some delay is introduced in the spout. Did you face the
issue?
- Edison
2013/12/24 Chris Bedford <ch...@buildlackey.com>
> Hi, Sean -
>
> are you going to talk about the Storm/Kafka spout in your book ? I am
> using it on my current project and I think it is a really useful way to
> talk to Kafka. It uses the more efficient (but trickier) simple consumer
> API to consume kafka messages in batch and it seems to dynamically respond
> to changes in partition layout. The only problem is that it needs to be
> more thoroughly documented. A chapter in your book that clarifies its
> usage would be quite helpful.
>
> Integration testing with storm/kafka is also tricky. I put up a public
> example of how I am doing it on my project here:
>
> > https://github.com/buildlackey/cep
>
> i am hoping to get in touch with the original author of the code (Jason
> Jackson, I believe) and maybe buy him a beer if he helps me with some
> knowledge transfer that enables me to improve the documentation and maybe
> helps me write some additional unit tests that illustrate advanced usage.
> The client I am working for will likely depend on this library if we
> continue to use it through roll-out to production. But to give them
> additional confidence we need to understand it a bit better than we do now.
>
> I'm happy to share any insight I obtain with you for your book
>
> - chris
>
>
>
>
>
>
>
>
>
>
>
> On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <se...@monkeysnatchbanana.com>wrote:
>
>> Hi all,
>>
>> I'm on of the authors of a new book on Storm that Manning released as a
>> MEAP last week. Its currently on sale for 50% through December 26th if you
>> use the code sallenco at time of purchase.
>>
>> The 3 of us who have been working on 'Storm Applied' hope you find the
>> book useful. You can download a sample chapter from the MEAP site at
>> http://www.manning.com/sallen/ to get a feel for the book.
>>
>> The first 3 of the book is an attempt to make sure that the reader has a
>> decent grounding in Storm concepts before we carry on to more advanced
>> topics as well as "getting the reader thinking in Storm". More advanced
>> topics are coming.
>>
>> The book is built around a series of use cases where we introduce
>> different Storm concepts in a "as needed/on demand" fashion that matches
>> how we learned Storm by doing. If you have any question, please fire away
>> either in response to this, in a personal email or on the author's forum.
>>
>> Thanks,
>> Sean
>>
>>
>> --
>>
>> Ce n'est pas une signature
>>
>
>
>
> --
> Chris Bedford
>
> Founder & Lead Lackey
> Build Lackey Labs: http://buildlackey.com
> Go Grails!: http://blog.buildlackey.com
>
>
>
Re: New Storm Book available
Posted by Sean Allen <se...@monkeysnatchbanana.com>.
Peter, one of my coauthors, has some thoughts on what various bits of
integration with Kafka we will be covering (outside of what needs to be
covered as part of Trident). He's busy right now but is planning on
responding in this thread.
-Sean-
On Mon, Dec 23, 2013 at 3:01 PM, Chris Bedford <ch...@buildlackey.com>wrote:
> Hi, Sean -
>
> are you going to talk about the Storm/Kafka spout in your book ? I am
> using it on my current project and I think it is a really useful way to
> talk to Kafka. It uses the more efficient (but trickier) simple consumer
> API to consume kafka messages in batch and it seems to dynamically respond
> to changes in partition layout. The only problem is that it needs to be
> more thoroughly documented. A chapter in your book that clarifies its
> usage would be quite helpful.
>
> Integration testing with storm/kafka is also tricky. I put up a public
> example of how I am doing it on my project here:
>
> > https://github.com/buildlackey/cep
>
> i am hoping to get in touch with the original author of the code (Jason
> Jackson, I believe) and maybe buy him a beer if he helps me with some
> knowledge transfer that enables me to improve the documentation and maybe
> helps me write some additional unit tests that illustrate advanced usage.
> The client I am working for will likely depend on this library if we
> continue to use it through roll-out to production. But to give them
> additional confidence we need to understand it a bit better than we do now.
>
> I'm happy to share any insight I obtain with you for your book
>
> - chris
>
>
>
>
>
>
>
>
>
>
>
> On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <se...@monkeysnatchbanana.com>wrote:
>
>> Hi all,
>>
>> I'm on of the authors of a new book on Storm that Manning released as a
>> MEAP last week. Its currently on sale for 50% through December 26th if you
>> use the code sallenco at time of purchase.
>>
>> The 3 of us who have been working on 'Storm Applied' hope you find the
>> book useful. You can download a sample chapter from the MEAP site at
>> http://www.manning.com/sallen/ to get a feel for the book.
>>
>> The first 3 of the book is an attempt to make sure that the reader has a
>> decent grounding in Storm concepts before we carry on to more advanced
>> topics as well as "getting the reader thinking in Storm". More advanced
>> topics are coming.
>>
>> The book is built around a series of use cases where we introduce
>> different Storm concepts in a "as needed/on demand" fashion that matches
>> how we learned Storm by doing. If you have any question, please fire away
>> either in response to this, in a personal email or on the author's forum.
>>
>> Thanks,
>> Sean
>>
>>
>> --
>>
>> Ce n'est pas une signature
>>
>
>
>
> --
> Chris Bedford
>
> Founder & Lead Lackey
> Build Lackey Labs: http://buildlackey.com
> Go Grails!: http://blog.buildlackey.com
>
>
>
--
Ce n'est pas une signature
Re: New Storm Book available
Posted by Chris Bedford <ch...@buildlackey.com>.
Hi, Sean -
are you going to talk about the Storm/Kafka spout in your book ? I am
using it on my current project and I think it is a really useful way to
talk to Kafka. It uses the more efficient (but trickier) simple consumer
API to consume kafka messages in batch and it seems to dynamically respond
to changes in partition layout. The only problem is that it needs to be
more thoroughly documented. A chapter in your book that clarifies its
usage would be quite helpful.
Integration testing with storm/kafka is also tricky. I put up a public
example of how I am doing it on my project here:
> https://github.com/buildlackey/cep
i am hoping to get in touch with the original author of the code (Jason
Jackson, I believe) and maybe buy him a beer if he helps me with some
knowledge transfer that enables me to improve the documentation and maybe
helps me write some additional unit tests that illustrate advanced usage.
The client I am working for will likely depend on this library if we
continue to use it through roll-out to production. But to give them
additional confidence we need to understand it a bit better than we do now.
I'm happy to share any insight I obtain with you for your book
- chris
On Mon, Dec 23, 2013 at 5:33 AM, Sean Allen <se...@monkeysnatchbanana.com>wrote:
> Hi all,
>
> I'm on of the authors of a new book on Storm that Manning released as a
> MEAP last week. Its currently on sale for 50% through December 26th if you
> use the code sallenco at time of purchase.
>
> The 3 of us who have been working on 'Storm Applied' hope you find the
> book useful. You can download a sample chapter from the MEAP site at
> http://www.manning.com/sallen/ to get a feel for the book.
>
> The first 3 of the book is an attempt to make sure that the reader has a
> decent grounding in Storm concepts before we carry on to more advanced
> topics as well as "getting the reader thinking in Storm". More advanced
> topics are coming.
>
> The book is built around a series of use cases where we introduce
> different Storm concepts in a "as needed/on demand" fashion that matches
> how we learned Storm by doing. If you have any question, please fire away
> either in response to this, in a personal email or on the author's forum.
>
> Thanks,
> Sean
>
>
> --
>
> Ce n'est pas une signature
>
--
Chris Bedford
Founder & Lead Lackey
Build Lackey Labs: http://buildlackey.com
Go Grails!: http://blog.buildlackey.com