You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by "Davis, Mark (TS R&D Galway)" <ma...@hpe.com> on 2015/12/08 12:25:14 UTC
FW: Storm-Kafka support for 0.9 consumer
Hi,
Per Michael Noll's article: http://www.michael-noll.com/blog/2014/05/27/kafka-storm-integration-example-tutorial/
"The Kafka project is working on an improved, consolidated consumer API for Kafka 0.9. Take a look at the respective discussions in the kafka-user<http://grokbase.com/t/kafka/users/142avhm32j/new-consumer-api-discussion> and kafka-dev<http://grokbase.com/t/kafka/dev/142avhm32j/new-consumer-api-discussion> mailing lists. The Kafka 0.9 Consumer Rewrite Design<https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design> document is also worth a read. Moving forward this API initiative should simplify interaction with Kafka in general and integration with storm-kafka in particular."
Well this release and consumer is out now as of 0.9.0. so are there plans for a new storm-kafka spout that makes use of it so it can be configured and monitored as per any other kafka producer/consumer?
Thanks!
Mark Davis.
RE: FW: Storm-Kafka support for 0.9 consumer
Posted by "Davis, Mark (TS R&D Galway)" <ma...@hpe.com>.
Thanks Harsha, missed that one!
From: Harsha [mailto:storm@harsha.io]
Sent: 08 December 2015 17:21
To: user@storm.apache.org
Subject: Re: FW: Storm-Kafka support for 0.9 consumer
Mark,
Here is the JIRA https://issues.apache.org/jira/browse/STORM-650 to make the kafak connector to use 0.9 . Its in the works.
Thanks,
Harsha
On Tue, Dec 8, 2015, at 03:25 AM, Davis, Mark (TS R&D Galway) wrote:
Hi,
Per Michael Noll’s article: http://www.michael-noll.com/blog/2014/05/27/kafka-storm-integration-example-tutorial/
“The Kafka project is working on an improved, consolidated consumer API for Kafka 0.9. Take a look at the respective discussions in the kafka-user<http://grokbase.com/t/kafka/users/142avhm32j/new-consumer-api-discussion> and kafka-dev<http://grokbase.com/t/kafka/dev/142avhm32j/new-consumer-api-discussion> mailing lists. The Kafka 0.9 Consumer Rewrite Design<https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design> document is also worth a read. Moving forward this API initiative should simplify interaction with Kafka in general and integration with storm-kafka in particular.”
Well this release and consumer is out now as of 0.9.0. so are there plans for a new storm-kafka spout that makes use of it so it can be configured and monitored as per any other kafka producer/consumer?
Thanks!
Mark Davis.
Re: FW: Storm-Kafka support for 0.9 consumer
Posted by Harsha <st...@harsha.io>.
Mark, Here is the JIRA
https://issues.apache.org/jira/browse/STORM-650 to make the kafak
connector to use 0.9 . Its in the works. Thanks, Harsha
On Tue, Dec 8, 2015, at 03:25 AM, Davis, Mark (TS R&D Galway) wrote:
> Hi,
>
> Per Michael Noll’s article:
http://www.michael-noll.com/blog/2014/05/27/kafka-storm-integration-example-tutorial/
>
> “The Kafka project is working on an improved, consolidated consumer
> API for Kafka 0.9. Take a look at the respective discussions in the
>
kafka-user[1] and kafka-dev[2] mailing lists. The Kafka 0.9 Consumer
Rewrite Design[3] document is also worth a read. Moving forward this API
initiative should simplify interaction with Kafka in general and
integration with storm-kafka in particular.”
>
> Well this release and consumer is out now as of 0.9.0. so are there
> plans for a new storm-kafka spout that makes use of it so it can be
> configured and monitored as per any other kafka producer/consumer?
>
> Thanks!
>
> Mark Davis.
Links:
1. http://grokbase.com/t/kafka/users/142avhm32j/new-consumer-api-discussion
2. http://grokbase.com/t/kafka/dev/142avhm32j/new-consumer-api-discussion
3. https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design