You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Debraj Manna <su...@gmail.com> on 2017/11/22 14:04:44 UTC
Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Hi
I am facing the same below issue when trying to use kafka client 1.0 with
samza
https://issues.apache.org/jira/browse/SAMZA-1418
I could not find any related ticket with a fix.
How are we supposed to run apache samza with the latest Kafka Client 1.0?
It looks like I have to use kafka-clients-0.11.0.0.jar .
*Versions*
Kafka Broker / Cluster - 1.0
samza-api-0.13.0.jar
samza-core_2.11-0.13.0.jar
samza-kafka_2.11-0.13.0.jar
samza-kv_2.11-0.13.0.jar
samza-yarn_2.11-0.13.0.jar
*PS - I could not find any users mailing list for samza in mailing list
<http://samza.apache.org/community/mailing-lists.html> page. If this is not
the right forum to ask this query. Can you please point me to the correct
forum?*
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Yi Pan <ni...@gmail.com>.
Hey, Debraj,
The exception you saw looks strange. The exception class
TopicExistsException is from org.apache.kafka:kafka-clients:0.10.1.1 (which
is the version included in samza 0.13.1), which should exist if you have
the whole samza jars installed in your classpath. Could you check whether
you have multiple versions of kafka-clients jars in your classpath?
Thanks!
-Yi
On Wed, Nov 29, 2017 at 8:45 AM, Debraj Manna <su...@gmail.com>
wrote:
> Hi
>
> Hi
>
> I am trying to upgrade a single node kafka broker to latest 1.0 from 0.10
> with samza 0.13.1.
>
> The steps followed
>
>
> 1. Stopped Kafka Broker
> 2. Replaced bin/, libs & site-docs/ with the latest
> 3. Started Kafka
>
> But I am seeing the below exception in logs - Is this related to the that
> is being discussed here?
>
> 017-11-29 16:21:36.591 [main-EventThread] ClientCnxn [INFO] EventThread
> shut down
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/kafka/common/errors/TopicExistsException
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$2.apply(KafkaSystemAdmin.scala:442)
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$2.apply(KafkaSystemAdmin.scala:440)
> at org.apache.samza.util.ExponentialSleepStrategy.run(
> ExponentialSleepStrategy.scala:81)
> at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
> KafkaSystemAdmin.scala:422)
> at org.apache.samza.system.kafka.KafkaSystemAdmin.
> createCoordinatorStream(KafkaSystemAdmin.scala:337)
> at org.apache.samza.job.JobRunner.run(JobRunner.scala:88)
> at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:52)
> at org.apache.samza.job.JobRunner$.main(JobRunner.scala:47)
> at org.apache.samza.job.JobRunner.main(JobRunner.scala)
> Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
> errors.TopicExistsException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 9 more
>
> On Mon, Nov 27, 2017 at 1:29 PM, Yi Pan <ni...@gmail.com> wrote:
>
> > Hi, Debraj,
> >
> > Makes sense. I have opened a ticket to upgrade Samza's Kafka client
> > libraries to 0.11 (SAMZA-1509). If you have concerns/suggestions, please
> > add comments to that ticket.
> >
> > Thanks!
> >
> > -Yi
> >
> > On Wed, Nov 22, 2017 at 10:04 AM, Debraj Manna <subharaj.manna@gmail.com
> >
> > wrote:
> >
> > > Since we were moving our brokers to 1.0 so was trying to have the same
> > > client version.
> > >
> > > Sent from GMail on Android
> > >
> > > On Nov 22, 2017 11:32 PM, "Yi Pan" <ni...@gmail.com> wrote:
> > >
> > > > And just one more question on your requirement for Kafka Client 1.0:
> is
> > > > this requirement because of your broker version is Kafka 1.0? Or you
> > want
> > > > some client side features from Kafka client 1.0?
> > > >
> > > > Just talked to our in-house Kafka expert and confirmed that Kafka
> > client
> > > > 0.10.1 should be able to talk to higher version of Kafka broker,
> > > including
> > > > 1.0, if the concern is on client/broker compatibility.
> > > >
> > > > -Yi
> > > >
> > > > On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <ni...@gmail.com> wrote:
> > > >
> > > > > Hi, Debraj,
> > > > >
> > > > > First, yes, this is the correct forum for user questions as well.
> > > > >
> > > > > Second, we are actively working on a patch to bring in Kafka 0.11
> > > client
> > > > > in Samza. It would require a lot of testing on Samza side to make
> > sure:
> > > > 1)
> > > > > back-compat w/ older version of brokers; 2) performance test. We
> > > already
> > > > > have a PR to include Kafka 0.11 under review.
> > > > >
> > > > > Thanks!
> > > > >
> > > > > -Yi
> > > > >
> > > > > On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <
> > > subharaj.manna@gmail.com>
> > > > > wrote:
> > > > >
> > > > >> Hi
> > > > >>
> > > > >>
> > > > >> I am facing the same below issue when trying to use kafka client
> 1.0
> > > > with
> > > > >> samza
> > > > >>
> > > > >> https://issues.apache.org/jira/browse/SAMZA-1418
> > > > >>
> > > > >> I could not find any related ticket with a fix.
> > > > >>
> > > > >> How are we supposed to run apache samza with the latest Kafka
> Client
> > > > 1.0?
> > > > >> It looks like I have to use kafka-clients-0.11.0.0.jar .
> > > > >>
> > > > >> *Versions*
> > > > >> Kafka Broker / Cluster - 1.0
> > > > >> samza-api-0.13.0.jar
> > > > >> samza-core_2.11-0.13.0.jar
> > > > >> samza-kafka_2.11-0.13.0.jar
> > > > >> samza-kv_2.11-0.13.0.jar
> > > > >> samza-yarn_2.11-0.13.0.jar
> > > > >>
> > > > >>
> > > > >> *PS - I could not find any users mailing list for samza in mailing
> > > list
> > > > >> <http://samza.apache.org/community/mailing-lists.html> page. If
> > this
> > > is
> > > > >> not
> > > > >> the right forum to ask this query. Can you please point me to the
> > > > correct
> > > > >> forum?*
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Debraj Manna <su...@gmail.com>.
Hi
Hi
I am trying to upgrade a single node kafka broker to latest 1.0 from 0.10
with samza 0.13.1.
The steps followed
1. Stopped Kafka Broker
2. Replaced bin/, libs & site-docs/ with the latest
3. Started Kafka
But I am seeing the below exception in logs - Is this related to the that
is being discussed here?
017-11-29 16:21:36.591 [main-EventThread] ClientCnxn [INFO] EventThread
shut down
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/kafka/common/errors/TopicExistsException
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$2.apply(KafkaSystemAdmin.scala:442)
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$2.apply(KafkaSystemAdmin.scala:440)
at org.apache.samza.util.ExponentialSleepStrategy.run(
ExponentialSleepStrategy.scala:81)
at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
KafkaSystemAdmin.scala:422)
at org.apache.samza.system.kafka.KafkaSystemAdmin.
createCoordinatorStream(KafkaSystemAdmin.scala:337)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:88)
at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:52)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:47)
at org.apache.samza.job.JobRunner.main(JobRunner.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
errors.TopicExistsException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 9 more
On Mon, Nov 27, 2017 at 1:29 PM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Debraj,
>
> Makes sense. I have opened a ticket to upgrade Samza's Kafka client
> libraries to 0.11 (SAMZA-1509). If you have concerns/suggestions, please
> add comments to that ticket.
>
> Thanks!
>
> -Yi
>
> On Wed, Nov 22, 2017 at 10:04 AM, Debraj Manna <su...@gmail.com>
> wrote:
>
> > Since we were moving our brokers to 1.0 so was trying to have the same
> > client version.
> >
> > Sent from GMail on Android
> >
> > On Nov 22, 2017 11:32 PM, "Yi Pan" <ni...@gmail.com> wrote:
> >
> > > And just one more question on your requirement for Kafka Client 1.0: is
> > > this requirement because of your broker version is Kafka 1.0? Or you
> want
> > > some client side features from Kafka client 1.0?
> > >
> > > Just talked to our in-house Kafka expert and confirmed that Kafka
> client
> > > 0.10.1 should be able to talk to higher version of Kafka broker,
> > including
> > > 1.0, if the concern is on client/broker compatibility.
> > >
> > > -Yi
> > >
> > > On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <ni...@gmail.com> wrote:
> > >
> > > > Hi, Debraj,
> > > >
> > > > First, yes, this is the correct forum for user questions as well.
> > > >
> > > > Second, we are actively working on a patch to bring in Kafka 0.11
> > client
> > > > in Samza. It would require a lot of testing on Samza side to make
> sure:
> > > 1)
> > > > back-compat w/ older version of brokers; 2) performance test. We
> > already
> > > > have a PR to include Kafka 0.11 under review.
> > > >
> > > > Thanks!
> > > >
> > > > -Yi
> > > >
> > > > On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <
> > subharaj.manna@gmail.com>
> > > > wrote:
> > > >
> > > >> Hi
> > > >>
> > > >>
> > > >> I am facing the same below issue when trying to use kafka client 1.0
> > > with
> > > >> samza
> > > >>
> > > >> https://issues.apache.org/jira/browse/SAMZA-1418
> > > >>
> > > >> I could not find any related ticket with a fix.
> > > >>
> > > >> How are we supposed to run apache samza with the latest Kafka Client
> > > 1.0?
> > > >> It looks like I have to use kafka-clients-0.11.0.0.jar .
> > > >>
> > > >> *Versions*
> > > >> Kafka Broker / Cluster - 1.0
> > > >> samza-api-0.13.0.jar
> > > >> samza-core_2.11-0.13.0.jar
> > > >> samza-kafka_2.11-0.13.0.jar
> > > >> samza-kv_2.11-0.13.0.jar
> > > >> samza-yarn_2.11-0.13.0.jar
> > > >>
> > > >>
> > > >> *PS - I could not find any users mailing list for samza in mailing
> > list
> > > >> <http://samza.apache.org/community/mailing-lists.html> page. If
> this
> > is
> > > >> not
> > > >> the right forum to ask this query. Can you please point me to the
> > > correct
> > > >> forum?*
> > > >>
> > > >
> > > >
> > >
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Yi Pan <ni...@gmail.com>.
Hi, Debraj,
Makes sense. I have opened a ticket to upgrade Samza's Kafka client
libraries to 0.11 (SAMZA-1509). If you have concerns/suggestions, please
add comments to that ticket.
Thanks!
-Yi
On Wed, Nov 22, 2017 at 10:04 AM, Debraj Manna <su...@gmail.com>
wrote:
> Since we were moving our brokers to 1.0 so was trying to have the same
> client version.
>
> Sent from GMail on Android
>
> On Nov 22, 2017 11:32 PM, "Yi Pan" <ni...@gmail.com> wrote:
>
> > And just one more question on your requirement for Kafka Client 1.0: is
> > this requirement because of your broker version is Kafka 1.0? Or you want
> > some client side features from Kafka client 1.0?
> >
> > Just talked to our in-house Kafka expert and confirmed that Kafka client
> > 0.10.1 should be able to talk to higher version of Kafka broker,
> including
> > 1.0, if the concern is on client/broker compatibility.
> >
> > -Yi
> >
> > On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <ni...@gmail.com> wrote:
> >
> > > Hi, Debraj,
> > >
> > > First, yes, this is the correct forum for user questions as well.
> > >
> > > Second, we are actively working on a patch to bring in Kafka 0.11
> client
> > > in Samza. It would require a lot of testing on Samza side to make sure:
> > 1)
> > > back-compat w/ older version of brokers; 2) performance test. We
> already
> > > have a PR to include Kafka 0.11 under review.
> > >
> > > Thanks!
> > >
> > > -Yi
> > >
> > > On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <
> subharaj.manna@gmail.com>
> > > wrote:
> > >
> > >> Hi
> > >>
> > >>
> > >> I am facing the same below issue when trying to use kafka client 1.0
> > with
> > >> samza
> > >>
> > >> https://issues.apache.org/jira/browse/SAMZA-1418
> > >>
> > >> I could not find any related ticket with a fix.
> > >>
> > >> How are we supposed to run apache samza with the latest Kafka Client
> > 1.0?
> > >> It looks like I have to use kafka-clients-0.11.0.0.jar .
> > >>
> > >> *Versions*
> > >> Kafka Broker / Cluster - 1.0
> > >> samza-api-0.13.0.jar
> > >> samza-core_2.11-0.13.0.jar
> > >> samza-kafka_2.11-0.13.0.jar
> > >> samza-kv_2.11-0.13.0.jar
> > >> samza-yarn_2.11-0.13.0.jar
> > >>
> > >>
> > >> *PS - I could not find any users mailing list for samza in mailing
> list
> > >> <http://samza.apache.org/community/mailing-lists.html> page. If this
> is
> > >> not
> > >> the right forum to ask this query. Can you please point me to the
> > correct
> > >> forum?*
> > >>
> > >
> > >
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Debraj Manna <su...@gmail.com>.
Since we were moving our brokers to 1.0 so was trying to have the same
client version.
Sent from GMail on Android
On Nov 22, 2017 11:32 PM, "Yi Pan" <ni...@gmail.com> wrote:
> And just one more question on your requirement for Kafka Client 1.0: is
> this requirement because of your broker version is Kafka 1.0? Or you want
> some client side features from Kafka client 1.0?
>
> Just talked to our in-house Kafka expert and confirmed that Kafka client
> 0.10.1 should be able to talk to higher version of Kafka broker, including
> 1.0, if the concern is on client/broker compatibility.
>
> -Yi
>
> On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <ni...@gmail.com> wrote:
>
> > Hi, Debraj,
> >
> > First, yes, this is the correct forum for user questions as well.
> >
> > Second, we are actively working on a patch to bring in Kafka 0.11 client
> > in Samza. It would require a lot of testing on Samza side to make sure:
> 1)
> > back-compat w/ older version of brokers; 2) performance test. We already
> > have a PR to include Kafka 0.11 under review.
> >
> > Thanks!
> >
> > -Yi
> >
> > On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <su...@gmail.com>
> > wrote:
> >
> >> Hi
> >>
> >>
> >> I am facing the same below issue when trying to use kafka client 1.0
> with
> >> samza
> >>
> >> https://issues.apache.org/jira/browse/SAMZA-1418
> >>
> >> I could not find any related ticket with a fix.
> >>
> >> How are we supposed to run apache samza with the latest Kafka Client
> 1.0?
> >> It looks like I have to use kafka-clients-0.11.0.0.jar .
> >>
> >> *Versions*
> >> Kafka Broker / Cluster - 1.0
> >> samza-api-0.13.0.jar
> >> samza-core_2.11-0.13.0.jar
> >> samza-kafka_2.11-0.13.0.jar
> >> samza-kv_2.11-0.13.0.jar
> >> samza-yarn_2.11-0.13.0.jar
> >>
> >>
> >> *PS - I could not find any users mailing list for samza in mailing list
> >> <http://samza.apache.org/community/mailing-lists.html> page. If this is
> >> not
> >> the right forum to ask this query. Can you please point me to the
> correct
> >> forum?*
> >>
> >
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Yi Pan <ni...@gmail.com>.
And just one more question on your requirement for Kafka Client 1.0: is
this requirement because of your broker version is Kafka 1.0? Or you want
some client side features from Kafka client 1.0?
Just talked to our in-house Kafka expert and confirmed that Kafka client
0.10.1 should be able to talk to higher version of Kafka broker, including
1.0, if the concern is on client/broker compatibility.
-Yi
On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <ni...@gmail.com> wrote:
> Hi, Debraj,
>
> First, yes, this is the correct forum for user questions as well.
>
> Second, we are actively working on a patch to bring in Kafka 0.11 client
> in Samza. It would require a lot of testing on Samza side to make sure: 1)
> back-compat w/ older version of brokers; 2) performance test. We already
> have a PR to include Kafka 0.11 under review.
>
> Thanks!
>
> -Yi
>
> On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <su...@gmail.com>
> wrote:
>
>> Hi
>>
>>
>> I am facing the same below issue when trying to use kafka client 1.0 with
>> samza
>>
>> https://issues.apache.org/jira/browse/SAMZA-1418
>>
>> I could not find any related ticket with a fix.
>>
>> How are we supposed to run apache samza with the latest Kafka Client 1.0?
>> It looks like I have to use kafka-clients-0.11.0.0.jar .
>>
>> *Versions*
>> Kafka Broker / Cluster - 1.0
>> samza-api-0.13.0.jar
>> samza-core_2.11-0.13.0.jar
>> samza-kafka_2.11-0.13.0.jar
>> samza-kv_2.11-0.13.0.jar
>> samza-yarn_2.11-0.13.0.jar
>>
>>
>> *PS - I could not find any users mailing list for samza in mailing list
>> <http://samza.apache.org/community/mailing-lists.html> page. If this is
>> not
>> the right forum to ask this query. Can you please point me to the correct
>> forum?*
>>
>
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Yi Pan <ni...@gmail.com>.
Hi, Debraj,
First, yes, this is the correct forum for user questions as well.
Second, we are actively working on a patch to bring in Kafka 0.11 client in
Samza. It would require a lot of testing on Samza side to make sure: 1)
back-compat w/ older version of brokers; 2) performance test. We already
have a PR to include Kafka 0.11 under review.
Thanks!
-Yi
On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <su...@gmail.com>
wrote:
> Hi
>
>
> I am facing the same below issue when trying to use kafka client 1.0 with
> samza
>
> https://issues.apache.org/jira/browse/SAMZA-1418
>
> I could not find any related ticket with a fix.
>
> How are we supposed to run apache samza with the latest Kafka Client 1.0?
> It looks like I have to use kafka-clients-0.11.0.0.jar .
>
> *Versions*
> Kafka Broker / Cluster - 1.0
> samza-api-0.13.0.jar
> samza-core_2.11-0.13.0.jar
> samza-kafka_2.11-0.13.0.jar
> samza-kv_2.11-0.13.0.jar
> samza-yarn_2.11-0.13.0.jar
>
>
> *PS - I could not find any users mailing list for samza in mailing list
> <http://samza.apache.org/community/mailing-lists.html> page. If this is
> not
> the right forum to ask this query. Can you please point me to the correct
> forum?*
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Ismael Juma <is...@juma.me.uk>.
Yes. Since the Scala clients have not changed much, there isn't much
benefit in upgrading anyway.
Ismael
On Wed, Nov 22, 2017 at 3:59 PM, Debraj Manna <su...@gmail.com>
wrote:
> Ok so until the issue is resolved by samza I have to stick with kafka
> client 0.11 ?
>
> On Wed, Nov 22, 2017 at 9:11 PM, Ismael Juma <is...@juma.me.uk> wrote:
>
> > Hi Debraj,
> >
> > It looks like Samza is relying on an internal class. My understanding is
> > that kafka.javaapi.TopicMetadata is the public version. Either way, all
> > these classes are used by the deprecated Scala consumers and will be
> > removed in a future version. It would be great if Samza migrated to the
> > Java consumer.
> >
> > Ismael
> >
> > On Wed, Nov 22, 2017 at 2:52 PM, Debraj Manna <su...@gmail.com>
> > wrote:
> >
> > > Hi
> > >
> > > I posted the same query in samza mailing list. But I did not get any
> > reply.
> > >
> > > Anyone has any thoughts?
> > >
> > > Sent from GMail on Android
> > > ---------- Forwarded message ----------
> > > From: "Debraj Manna" <su...@gmail.com>
> > > Date: Nov 21, 2017 5:34 PM
> > > Subject: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA -
> 1418
> > > To: <de...@samza.apache.org>
> > > Cc:
> > >
> > > Hi
> > >
> > >
> > > I am facing the same below issue when trying to use kafka client 1.0
> with
> > > samza
> > >
> > > https://issues.apache.org/jira/browse/SAMZA-1418
> > >
> > > I could not find any related ticket with a fix.
> > >
> > > How are we supposed to run apache samza with the latest Kafka Client
> 1.0?
> > > It looks like I have to use kafka-clients-0.11.0.0.jar .
> > >
> > > *Versions*
> > > Kafka Broker / Cluster - 1.0
> > > samza-api-0.13.0.jar
> > > samza-core_2.11-0.13.0.jar
> > > samza-kafka_2.11-0.13.0.jar
> > > samza-kv_2.11-0.13.0.jar
> > > samza-yarn_2.11-0.13.0.jar
> > >
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Debraj Manna <su...@gmail.com>.
Ok so until the issue is resolved by samza I have to stick with kafka
client 0.11 ?
On Wed, Nov 22, 2017 at 9:11 PM, Ismael Juma <is...@juma.me.uk> wrote:
> Hi Debraj,
>
> It looks like Samza is relying on an internal class. My understanding is
> that kafka.javaapi.TopicMetadata is the public version. Either way, all
> these classes are used by the deprecated Scala consumers and will be
> removed in a future version. It would be great if Samza migrated to the
> Java consumer.
>
> Ismael
>
> On Wed, Nov 22, 2017 at 2:52 PM, Debraj Manna <su...@gmail.com>
> wrote:
>
> > Hi
> >
> > I posted the same query in samza mailing list. But I did not get any
> reply.
> >
> > Anyone has any thoughts?
> >
> > Sent from GMail on Android
> > ---------- Forwarded message ----------
> > From: "Debraj Manna" <su...@gmail.com>
> > Date: Nov 21, 2017 5:34 PM
> > Subject: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
> > To: <de...@samza.apache.org>
> > Cc:
> >
> > Hi
> >
> >
> > I am facing the same below issue when trying to use kafka client 1.0 with
> > samza
> >
> > https://issues.apache.org/jira/browse/SAMZA-1418
> >
> > I could not find any related ticket with a fix.
> >
> > How are we supposed to run apache samza with the latest Kafka Client 1.0?
> > It looks like I have to use kafka-clients-0.11.0.0.jar .
> >
> > *Versions*
> > Kafka Broker / Cluster - 1.0
> > samza-api-0.13.0.jar
> > samza-core_2.11-0.13.0.jar
> > samza-kafka_2.11-0.13.0.jar
> > samza-kv_2.11-0.13.0.jar
> > samza-yarn_2.11-0.13.0.jar
> >
>
Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Ismael Juma <is...@juma.me.uk>.
Hi Debraj,
It looks like Samza is relying on an internal class. My understanding is
that kafka.javaapi.TopicMetadata is the public version. Either way, all
these classes are used by the deprecated Scala consumers and will be
removed in a future version. It would be great if Samza migrated to the
Java consumer.
Ismael
On Wed, Nov 22, 2017 at 2:52 PM, Debraj Manna <su...@gmail.com>
wrote:
> Hi
>
> I posted the same query in samza mailing list. But I did not get any reply.
>
> Anyone has any thoughts?
>
> Sent from GMail on Android
> ---------- Forwarded message ----------
> From: "Debraj Manna" <su...@gmail.com>
> Date: Nov 21, 2017 5:34 PM
> Subject: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
> To: <de...@samza.apache.org>
> Cc:
>
> Hi
>
>
> I am facing the same below issue when trying to use kafka client 1.0 with
> samza
>
> https://issues.apache.org/jira/browse/SAMZA-1418
>
> I could not find any related ticket with a fix.
>
> How are we supposed to run apache samza with the latest Kafka Client 1.0?
> It looks like I have to use kafka-clients-0.11.0.0.jar .
>
> *Versions*
> Kafka Broker / Cluster - 1.0
> samza-api-0.13.0.jar
> samza-core_2.11-0.13.0.jar
> samza-kafka_2.11-0.13.0.jar
> samza-kv_2.11-0.13.0.jar
> samza-yarn_2.11-0.13.0.jar
>
Fwd: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Posted by Debraj Manna <su...@gmail.com>.
Hi
I posted the same query in samza mailing list. But I did not get any reply.
Anyone has any thoughts?
Sent from GMail on Android
---------- Forwarded message ----------
From: "Debraj Manna" <su...@gmail.com>
Date: Nov 21, 2017 5:34 PM
Subject: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
To: <de...@samza.apache.org>
Cc:
Hi
I am facing the same below issue when trying to use kafka client 1.0 with
samza
https://issues.apache.org/jira/browse/SAMZA-1418
I could not find any related ticket with a fix.
How are we supposed to run apache samza with the latest Kafka Client 1.0?
It looks like I have to use kafka-clients-0.11.0.0.jar .
*Versions*
Kafka Broker / Cluster - 1.0
samza-api-0.13.0.jar
samza-core_2.11-0.13.0.jar
samza-kafka_2.11-0.13.0.jar
samza-kv_2.11-0.13.0.jar
samza-yarn_2.11-0.13.0.jar