Ignite Data Streamer Kafka version 2.0

[Mahesh Nair <ma...@gmail.com>]

Hi,

I am trying to stream some data from a few kafka topics to an Ignite cache
using the ignite data streamer. I was using ignite version 2.6.0 and kafka
version 0.10 and that was working fine. Now we have upgraded the kafka
version to 2.0 and the streamer has stopped working.

I understand with the 2.6.0 version of ignite the KafkaStreamer uses the
deprecated ConsumerConfig which has since changed in version 2.7.0.

I see that the kafka.version for 2.7.0 is 1.1.1 and for the master branch
it is 2.0.

Has anyone tried using the 2.6.0/2.7.0 with Kafka 2.0? as in build ignite
with that version?


Mahesh

Re: Ignite Data Streamer Kafka version 2.0

[Alexey Kukushkin <ku...@gmail.com>]

Hi Mahesh,

I do not think Kafka streamer uses any 2.x specific Kafka client APIs. From
what you say I think kafka-client-1.1 (that Ignite 2.7 uses) cannot connect
to Kafka 2.x cluster. Can you manually replace kafka-client-1.1.jar with
kafka-client-2.0 jar on the Kafka streamer side and see if it fixes your
issue? BTW, how does your issue look like? What is the error message?



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/