You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Gaurav Agarwal <ga...@gmail.com> on 2016/08/22 07:06:47 UTC
kafka dependency version
Hi All,
What kafka version is supported by Samza release 0.10.1?
In the gradle build file (dependency-versions.gradle) I see it as kafkaVersion
= "0.8.2.1". This is very old kafka version and lot of very serious bugs
have been fixed since then (including the one we are hitting where kafka
client blocks indefeinitelly in face of betwork hiccups).
Any clues on what version is safe enough to upgrade this dependency to (if
I am planning to self build and host the samza binaries privately)? 0.9.0 /
0.10.0 ?
I noticed that AdminUtils.CreateTopic() call breaks if I take kafka 0.10.0.
There may be more errors (some may not manifest as directly as this one).
Any plans to upgrade this dependency for samza soon?
https://issues.apache.org/jira/browse/KAFKA-1733
--
--cheers, gaurav
Re: kafka dependency version
Posted by Gaurav Agarwal <ga...@gmail.com>.
thanks! will do.
On Mon, Aug 22, 2016 at 10:56 PM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Gaurav,
>
> There is already an effort going on for this one: SAMZA-855
> <https://issues.apache.org/jira/browse/SAMZA-855>. It would be good if you
> can try out the patch.
>
> Thanks!
>
> -Yi
>
> On Mon, Aug 22, 2016 at 1:11 AM, Gaurav Agarwal <ga...@gmail.com>
> wrote:
>
> > My initial attempt to build against kafka 0.9.0 or 0.10.0 stopped short
> due
> > to some non-trivial interface changes and refactorings in Kafka; and I
> did
> > not want to make those changes without having a correct understanding.
> >
> > Can someone guide me what would be the correct procedure to upgrade this
> > dependency? Should I attempt to make the build/tests pass against kafka
> > 0.10 and submit a PR? Or would someone from samza dev team prefer to do
> > this?
> >
> > On Mon, Aug 22, 2016 at 12:36 PM, Gaurav Agarwal <
> gauravagarwal4@gmail.com
> > >
> > wrote:
> >
> > > Hi All,
> > >
> > > What kafka version is supported by Samza release 0.10.1?
> > >
> > > In the gradle build file (dependency-versions.gradle) I see it as
> > kafkaVersion
> > > = "0.8.2.1". This is very old kafka version and lot of very serious
> bugs
> > > have been fixed since then (including the one we are hitting where
> kafka
> > > client blocks indefeinitelly in face of betwork hiccups).
> > >
> > > Any clues on what version is safe enough to upgrade this dependency to
> > (if
> > > I am planning to self build and host the samza binaries privately)?
> > 0.9.0 /
> > > 0.10.0 ?
> > > I noticed that AdminUtils.CreateTopic() call breaks if I take kafka
> > > 0.10.0. There may be more errors (some may not manifest as directly as
> > this
> > > one).
> > >
> > > Any plans to upgrade this dependency for samza soon?
> > >
> > > https://issues.apache.org/jira/browse/KAFKA-1733
> > > --
> > > --cheers, gaurav
> > >
> >
>
Re: kafka dependency version
Posted by Yi Pan <ni...@gmail.com>.
Hi, Gaurav,
There is already an effort going on for this one: SAMZA-855
<https://issues.apache.org/jira/browse/SAMZA-855>. It would be good if you
can try out the patch.
Thanks!
-Yi
On Mon, Aug 22, 2016 at 1:11 AM, Gaurav Agarwal <ga...@gmail.com>
wrote:
> My initial attempt to build against kafka 0.9.0 or 0.10.0 stopped short due
> to some non-trivial interface changes and refactorings in Kafka; and I did
> not want to make those changes without having a correct understanding.
>
> Can someone guide me what would be the correct procedure to upgrade this
> dependency? Should I attempt to make the build/tests pass against kafka
> 0.10 and submit a PR? Or would someone from samza dev team prefer to do
> this?
>
> On Mon, Aug 22, 2016 at 12:36 PM, Gaurav Agarwal <gauravagarwal4@gmail.com
> >
> wrote:
>
> > Hi All,
> >
> > What kafka version is supported by Samza release 0.10.1?
> >
> > In the gradle build file (dependency-versions.gradle) I see it as
> kafkaVersion
> > = "0.8.2.1". This is very old kafka version and lot of very serious bugs
> > have been fixed since then (including the one we are hitting where kafka
> > client blocks indefeinitelly in face of betwork hiccups).
> >
> > Any clues on what version is safe enough to upgrade this dependency to
> (if
> > I am planning to self build and host the samza binaries privately)?
> 0.9.0 /
> > 0.10.0 ?
> > I noticed that AdminUtils.CreateTopic() call breaks if I take kafka
> > 0.10.0. There may be more errors (some may not manifest as directly as
> this
> > one).
> >
> > Any plans to upgrade this dependency for samza soon?
> >
> > https://issues.apache.org/jira/browse/KAFKA-1733
> > --
> > --cheers, gaurav
> >
>
Re: kafka dependency version
Posted by Gaurav Agarwal <ga...@gmail.com>.
My initial attempt to build against kafka 0.9.0 or 0.10.0 stopped short due
to some non-trivial interface changes and refactorings in Kafka; and I did
not want to make those changes without having a correct understanding.
Can someone guide me what would be the correct procedure to upgrade this
dependency? Should I attempt to make the build/tests pass against kafka
0.10 and submit a PR? Or would someone from samza dev team prefer to do
this?
On Mon, Aug 22, 2016 at 12:36 PM, Gaurav Agarwal <ga...@gmail.com>
wrote:
> Hi All,
>
> What kafka version is supported by Samza release 0.10.1?
>
> In the gradle build file (dependency-versions.gradle) I see it as kafkaVersion
> = "0.8.2.1". This is very old kafka version and lot of very serious bugs
> have been fixed since then (including the one we are hitting where kafka
> client blocks indefeinitelly in face of betwork hiccups).
>
> Any clues on what version is safe enough to upgrade this dependency to (if
> I am planning to self build and host the samza binaries privately)? 0.9.0 /
> 0.10.0 ?
> I noticed that AdminUtils.CreateTopic() call breaks if I take kafka
> 0.10.0. There may be more errors (some may not manifest as directly as this
> one).
>
> Any plans to upgrade this dependency for samza soon?
>
> https://issues.apache.org/jira/browse/KAFKA-1733
> --
> --cheers, gaurav
>