You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by rishi007bansod <ri...@gmail.com> on 2017/02/15 11:09:04 UTC
Issue in starting IgniteSinkConnector with Distributed Worker mode
Hi,
As mentioned in post,
https://dzone.com/articles/linking-apache-ignite-and-apache-kafka-for-highly
<https://dzone.com/articles/linking-apache-ignite-and-apache-kafka-for-highly>
, I am able to use connect-standalone.sh for ignite kafka connection. But
now for scaling up these connectors across cluster I am trying to use
connect-distributed.sh from kafka. I have also attached *.properties files I
am using.
But in case of connect-distributed.sh i.e. distributed worker mode
Ignite instance is not getting started at all. What might be issue in this
case? Is kafka Distributed Worker mode supported in Ignite?
connect-distributed.properties
<http://apache-ignite-users.70518.x6.nabble.com/file/n10647/connect-distributed.properties>
ignite-connector.properties
<http://apache-ignite-users.70518.x6.nabble.com/file/n10647/ignite-connector.properties>
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Issue in starting IgniteSinkConnector with Distributed Worker
mode
Posted by dkarachentsev <dk...@gridgain.com>.
Hi,
I'm not quite familiar with Kafka connector, but I'm going to figure it out
and come back to help you.
Thanks!
-Dmitry.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p10664.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Issue in starting IgniteSinkConnector with Distributed Worker
mode
Posted by Roman Shtykh <rs...@yahoo.com>.
The connector is not created and no connection to your Ignite cluster is done in a distributed mode, if you pass connector configuration on the command line.In a distributed mode, you have to use REST API, like below.
$ curl -X POST -H "Content-Type: application/json" --data '{"name": "string-ignite-connector", "config": {"connector.class":"org.apache.ignite.stream.kafka.connect.IgniteSinkConnector", "tasks.max":"2","topics":"test","cacheName":"cache1","igniteCfg":"path_to_/ignite.xml"}}' http://localhost:8083/connectors
Hope this helps.
Roman
On Tuesday, March 14, 2017 4:45 PM, dkarachentsev <dk...@gridgain.com> wrote:
Hi,
Could you please attach logs and thread dumps (in case of hang) if problem
is still relevant?
-Dmitry.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p11161.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Issue in starting IgniteSinkConnector with Distributed Worker
mode
Posted by dkarachentsev <dk...@gridgain.com>.
Hi,
Could you please attach logs and thread dumps (in case of hang) if problem
is still relevant?
-Dmitry.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p11161.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.