You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@samza.apache.org by David Yu <da...@optimizely.com> on 2016/07/26 17:38:03 UTC

Sync Kafka producer by default?

Our session-roll-up Samza job is experience throughput issues. We would
like to fine-tune our Kafka producer. Does Samza use "producer.type=sync"
by default? From the JMX console, I'm seeing some producer batching
metrics. I thought those are for async producers.

Thanks,
David

Re: Sync Kafka producer by default?

Posted by David Yu <da...@optimizely.com>.

I'm using 0.10.

Thanks for confirming.

On Tue, Jul 26, 2016 at 1:12 PM Navina Ramesh <nr...@linkedin.com.invalid>
wrote:

> Hi David,
> Which version of Samza are you using? Starting with Samza 0.8, I think we
> always used async producer.
>
> Thanks!
> Navina
>
> On Tue, Jul 26, 2016 at 10:38 AM, David Yu <da...@optimizely.com>
> wrote:
>
> > Our session-roll-up Samza job is experience throughput issues. We would
> > like to fine-tune our Kafka producer. Does Samza use "producer.type=sync"
> > by default? From the JMX console, I'm seeing some producer batching
> > metrics. I thought those are for async producers.
> >
> > Thanks,
> > David
> >
>
>
>
> --
> Navina R.
>

Re: Sync Kafka producer by default?

Posted by Navina Ramesh <nr...@linkedin.com.INVALID>.

Hi David,
Which version of Samza are you using? Starting with Samza 0.8, I think we
always used async producer.

Thanks!
Navina

On Tue, Jul 26, 2016 at 10:38 AM, David Yu <da...@optimizely.com> wrote:

> Our session-roll-up Samza job is experience throughput issues. We would
> like to fine-tune our Kafka producer. Does Samza use "producer.type=sync"
> by default? From the JMX console, I'm seeing some producer batching
> metrics. I thought those are for async producers.
>
> Thanks,
> David
>

-- 
Navina R.