Non-blocking scala client for Kafka 0.8

[Aniket Bhatnagar <an...@gmail.com>]

I am integrating Kafka in my in-stream processing and have begun using the
provided Java API (we use Scala in our project). I am wondering if anyone
also feels the need for non-blocking Kafka client in Scala? Producer can
simply return Future[SendResponse] or Future[List[SendResponse]] and
consumers can expose Iteratees to allow for reactive consumption of
messages. The client can have configurable options for producer batch size,
consumer fetch size, etc (much like async-hbase). Is anyone planing on
these lines already?

Re: Non-blocking scala client for Kafka 0.8

[Neha Narkhede <ne...@gmail.com>]

This is proposed as part of the Client Rewrite project. Wiki is here -
https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite#ClientRewrite-ProposedProducerAPI.
Please feel free to leave feedback on the new proposal.

Thanks,
Neha


On Tue, Sep 24, 2013 at 11:14 PM, Aniket Bhatnagar <
aniket.bhatnagar@gmail.com> wrote:

> I am integrating Kafka in my in-stream processing and have begun using the
> provided Java API (we use Scala in our project). I am wondering if anyone
> also feels the need for non-blocking Kafka client in Scala? Producer can
> simply return Future[SendResponse] or Future[List[SendResponse]] and
> consumers can expose Iteratees to allow for reactive consumption of
> messages. The client can have configurable options for producer batch size,
> consumer fetch size, etc (much like async-hbase). Is anyone planing on
> these lines already?
>