You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Shlomi Hazan <sh...@viber.com> on 2014/11/17 13:46:30 UTC
selecting java producer (0.8.2 or 0.8.1.1?)
Hi,
I need to make a choice and I can't get a full picture on the differences
between the two.
E.g.:
Are both producers async capable to the same extent?
Is the new producer stable for production?
Is there some usage example for the new producer?
What are the tradeoffs using one or another?
10x,
Shlomi
Re: selecting java producer (0.8.2 or 0.8.1.1?)
Posted by Jun Rao <ju...@gmail.com>.
In the 0.8.2 final release, the java doc will be updated properly.
See KAFKA-1769
Thanks,
Jun
On Tue, Nov 18, 2014 at 8:46 PM, Jason Rosenberg <jb...@squareup.com> wrote:
> So that java-doc link includes a new KafkaConsumer (but it seems in other
> threads that's not being referred to as ready for use until 0.9, is that
> right?).....Is there a way to know which parts of that javadoc are
> considered beta-ready in 0.8.2 and which are not?
>
> Jason
>
> On Tue, Nov 18, 2014 at 11:03 PM, Joe Stein <jo...@stealth.ly> wrote:
>
> > 0.8.2-beta java doc
> > https://archive.apache.org/dist/kafka/0.8.2-beta/java-doc/
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop
> > ********************************************/
> > On Nov 18, 2014 10:33 PM, "Jason Rosenberg" <jb...@squareup.com> wrote:
> >
> > > Hi Jun,
> > >
> > > Is this the official java doc for the new producer (www.trieuvan.com)?
> > > I'm
> > > not seeing any links to it (or any documentation) on the apache kafka
> > site
> > > (am I overlooking it)?
> > >
> > > Should there be a link to it in the 0.8.2-beta documentation page?
> > >
> > > Jason
> > >
> > > On Tue, Nov 18, 2014 at 7:23 PM, Jun Rao <ju...@gmail.com> wrote:
> > >
> > > > The new producer in 0.8.2 is considered stable, although it's
> > relatively
> > > > new. Compared with the old producer, it has the following features.
> > > >
> > > > 1. Use non-blocking socket to send requests to the broker. So uses
> > fewer
> > > > threads and have better throughput.
> > > > 2. Bound the memory consumption.
> > > > 3. Support a callback when sending a request asynchronously.
> > > > 4. Returns the offset for each produced message.
> > > >
> > > > You can look at the example in the java doc.
> > > >
> > > >
> > >
> >
> http://www.trieuvan.com/apache/kafka/0.8.2-beta/java-doc/org/apache/kafka/clients/producer/KafkaProducer.html
> > > >
> > > > Thanks,
> > > >
> > > > Jun
> > > >
> > > > On Mon, Nov 17, 2014 at 4:46 AM, Shlomi Hazan <sh...@viber.com>
> > wrote:
> > > >
> > > > > Hi,
> > > > > I need to make a choice and I can't get a full picture on the
> > > differences
> > > > > between the two.
> > > > > E.g.:
> > > > > Are both producers async capable to the same extent?
> > > > > Is the new producer stable for production?
> > > > > Is there some usage example for the new producer?
> > > > > What are the tradeoffs using one or another?
> > > > > 10x,
> > > > > Shlomi
> > > > >
> > > >
> > >
> >
>
Re: selecting java producer (0.8.2 or 0.8.1.1?)
Posted by Jason Rosenberg <jb...@squareup.com>.
So that java-doc link includes a new KafkaConsumer (but it seems in other
threads that's not being referred to as ready for use until 0.9, is that
right?).....Is there a way to know which parts of that javadoc are
considered beta-ready in 0.8.2 and which are not?
Jason
On Tue, Nov 18, 2014 at 11:03 PM, Joe Stein <jo...@stealth.ly> wrote:
> 0.8.2-beta java doc
> https://archive.apache.org/dist/kafka/0.8.2-beta/java-doc/
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop
> ********************************************/
> On Nov 18, 2014 10:33 PM, "Jason Rosenberg" <jb...@squareup.com> wrote:
>
> > Hi Jun,
> >
> > Is this the official java doc for the new producer (www.trieuvan.com)?
> > I'm
> > not seeing any links to it (or any documentation) on the apache kafka
> site
> > (am I overlooking it)?
> >
> > Should there be a link to it in the 0.8.2-beta documentation page?
> >
> > Jason
> >
> > On Tue, Nov 18, 2014 at 7:23 PM, Jun Rao <ju...@gmail.com> wrote:
> >
> > > The new producer in 0.8.2 is considered stable, although it's
> relatively
> > > new. Compared with the old producer, it has the following features.
> > >
> > > 1. Use non-blocking socket to send requests to the broker. So uses
> fewer
> > > threads and have better throughput.
> > > 2. Bound the memory consumption.
> > > 3. Support a callback when sending a request asynchronously.
> > > 4. Returns the offset for each produced message.
> > >
> > > You can look at the example in the java doc.
> > >
> > >
> >
> http://www.trieuvan.com/apache/kafka/0.8.2-beta/java-doc/org/apache/kafka/clients/producer/KafkaProducer.html
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Mon, Nov 17, 2014 at 4:46 AM, Shlomi Hazan <sh...@viber.com>
> wrote:
> > >
> > > > Hi,
> > > > I need to make a choice and I can't get a full picture on the
> > differences
> > > > between the two.
> > > > E.g.:
> > > > Are both producers async capable to the same extent?
> > > > Is the new producer stable for production?
> > > > Is there some usage example for the new producer?
> > > > What are the tradeoffs using one or another?
> > > > 10x,
> > > > Shlomi
> > > >
> > >
> >
>
Re: selecting java producer (0.8.2 or 0.8.1.1?)
Posted by Joe Stein <jo...@stealth.ly>.
0.8.2-beta java doc
https://archive.apache.org/dist/kafka/0.8.2-beta/java-doc/
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop
********************************************/
On Nov 18, 2014 10:33 PM, "Jason Rosenberg" <jb...@squareup.com> wrote:
> Hi Jun,
>
> Is this the official java doc for the new producer (www.trieuvan.com)?
> I'm
> not seeing any links to it (or any documentation) on the apache kafka site
> (am I overlooking it)?
>
> Should there be a link to it in the 0.8.2-beta documentation page?
>
> Jason
>
> On Tue, Nov 18, 2014 at 7:23 PM, Jun Rao <ju...@gmail.com> wrote:
>
> > The new producer in 0.8.2 is considered stable, although it's relatively
> > new. Compared with the old producer, it has the following features.
> >
> > 1. Use non-blocking socket to send requests to the broker. So uses fewer
> > threads and have better throughput.
> > 2. Bound the memory consumption.
> > 3. Support a callback when sending a request asynchronously.
> > 4. Returns the offset for each produced message.
> >
> > You can look at the example in the java doc.
> >
> >
> http://www.trieuvan.com/apache/kafka/0.8.2-beta/java-doc/org/apache/kafka/clients/producer/KafkaProducer.html
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Nov 17, 2014 at 4:46 AM, Shlomi Hazan <sh...@viber.com> wrote:
> >
> > > Hi,
> > > I need to make a choice and I can't get a full picture on the
> differences
> > > between the two.
> > > E.g.:
> > > Are both producers async capable to the same extent?
> > > Is the new producer stable for production?
> > > Is there some usage example for the new producer?
> > > What are the tradeoffs using one or another?
> > > 10x,
> > > Shlomi
> > >
> >
>
Re: selecting java producer (0.8.2 or 0.8.1.1?)
Posted by Jason Rosenberg <jb...@squareup.com>.
Hi Jun,
Is this the official java doc for the new producer (www.trieuvan.com)? I'm
not seeing any links to it (or any documentation) on the apache kafka site
(am I overlooking it)?
Should there be a link to it in the 0.8.2-beta documentation page?
Jason
On Tue, Nov 18, 2014 at 7:23 PM, Jun Rao <ju...@gmail.com> wrote:
> The new producer in 0.8.2 is considered stable, although it's relatively
> new. Compared with the old producer, it has the following features.
>
> 1. Use non-blocking socket to send requests to the broker. So uses fewer
> threads and have better throughput.
> 2. Bound the memory consumption.
> 3. Support a callback when sending a request asynchronously.
> 4. Returns the offset for each produced message.
>
> You can look at the example in the java doc.
>
> http://www.trieuvan.com/apache/kafka/0.8.2-beta/java-doc/org/apache/kafka/clients/producer/KafkaProducer.html
>
> Thanks,
>
> Jun
>
> On Mon, Nov 17, 2014 at 4:46 AM, Shlomi Hazan <sh...@viber.com> wrote:
>
> > Hi,
> > I need to make a choice and I can't get a full picture on the differences
> > between the two.
> > E.g.:
> > Are both producers async capable to the same extent?
> > Is the new producer stable for production?
> > Is there some usage example for the new producer?
> > What are the tradeoffs using one or another?
> > 10x,
> > Shlomi
> >
>
Re: selecting java producer (0.8.2 or 0.8.1.1?)
Posted by Jun Rao <ju...@gmail.com>.
The new producer in 0.8.2 is considered stable, although it's relatively
new. Compared with the old producer, it has the following features.
1. Use non-blocking socket to send requests to the broker. So uses fewer
threads and have better throughput.
2. Bound the memory consumption.
3. Support a callback when sending a request asynchronously.
4. Returns the offset for each produced message.
You can look at the example in the java doc.
http://www.trieuvan.com/apache/kafka/0.8.2-beta/java-doc/org/apache/kafka/clients/producer/KafkaProducer.html
Thanks,
Jun
On Mon, Nov 17, 2014 at 4:46 AM, Shlomi Hazan <sh...@viber.com> wrote:
> Hi,
> I need to make a choice and I can't get a full picture on the differences
> between the two.
> E.g.:
> Are both producers async capable to the same extent?
> Is the new producer stable for production?
> Is there some usage example for the new producer?
> What are the tradeoffs using one or another?
> 10x,
> Shlomi
>