You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by shubhamshirur <sh...@gmail.com> on 2021/05/15 09:20:12 UTC
Data replication from kafka-topic to ignite cluster
I am trying to replicate data from Kafka topic to apache ignite cluster. I
have added ignite-core.jar along with all other required files in plugins
and it's loaded in connector as per the logs. Still I'm facing this error.
Any suggestions would be helpful. Thank you.
INFO Instantiated connector string-ignite-connector with version 6.1.1-ccs
of type class org.apache.ignite.stream.kafka.connect.IgniteSinkConnector
(org.apache.kafka.connect.runtime.Worker:284)
[2021-05-15 08:52:43,717] INFO Finished creating connector
string-ignite-connector (org.apache.kafka.connect.runtime.Worker:310)
[2021-05-15 08:52:43,719] ERROR WorkerConnector{id=string-ignite-connector}
Error while starting connector
(org.apache.kafka.connect.runtime.WorkerConnector:193)
java.lang.NoClassDefFoundError:
org/apache/ignite/internal/util/typedef/internal/A
at
org.apache.ignite.stream.kafka.connect.IgniteSinkConnector.start(IgniteSinkConnector.java:55)
at
org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:185)
at
org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:210)
at
org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:349)
at
org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:332)
at
org.apache.kafka.connect.runtime.WorkerConnector.doRun(WorkerConnector.java:140)
at
org.apache.kafka.connect.runtime.WorkerConnector.run(WorkerConnector.java:117)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException:
org.apache.ignite.internal.util.typedef.internal.A
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at
org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 12 more
[2021-05-15 08:52:43,723] ERROR Failed to create job for
myconfig/ignite-connector.properties
(org.apache.kafka.connect.cli.ConnectStandalone:110)
[2021-05-15 08:52:43,723] ERROR Stopping after connector error
(org.apache.kafka.connect.cli.ConnectStandalone:121)
java.util.concurrent.ExecutionException:
org.apache.kafka.connect.errors.ConnectException: Failed to transition
connector string-ignite-connector to state STARTED
at
org.apache.kafka.connect.util.ConvertingFutureCallback.result(ConvertingFutureCallback.java:115)
at
org.apache.kafka.connect.util.ConvertingFutureCallback.get(ConvertingFutureCallback.java:99)
at
org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:118)
Caused by: org.apache.kafka.connect.errors.ConnectException: Failed to
transition connector string-ignite-connector to state STARTED
at
org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:335)
at
org.apache.kafka.connect.runtime.WorkerConnector.doRun(WorkerConnector.java:140)
at
org.apache.kafka.connect.runtime.WorkerConnector.run(WorkerConnector.java:117)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoClassDefFoundError:
org/apache/ignite/internal/util/typedef/internal/A
at
org.apache.ignite.stream.kafka.connect.IgniteSinkConnector.start(IgniteSinkConnector.java:55)
at
org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:185)
at
org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:210)
at
org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:349)
at
org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:332)
... 7 more
Caused by: java.lang.ClassNotFoundException:
org.apache.ignite.internal.util.typedef.internal.A
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at
org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 12 more
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Data replication from kafka-topic to ignite cluster
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
Maybe you should ask on Kafka list about the specifics of its class
loading. "org.apache.kafka.connect.runtime.isolation" suggests that there
may be some limitations.
Regards,
--
Ilya Kasnacheev
пн, 17 мая 2021 г. в 13:32, shubhamshirur <sh...@gmail.com>:
> Thank you sir for replying. I have added ignite-core.jar and I have
> mentioned
> its path in plugin.path. This particular jar is loaded in while connector
> instantiation I have checked it in the log. Can you please enlighten me on
> this ?
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Data replication from kafka-topic to ignite cluster
Posted by shubhamshirur <sh...@gmail.com>.
Thank you sir for replying. I have added ignite-core.jar and I have mentioned
its path in plugin.path. This particular jar is loaded in while connector
instantiation I have checked it in the log. Can you please enlighten me on
this ?
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Data replication from kafka-topic to ignite cluster
Posted by Stephen Darlington <st...@gridgain.com>.
The error says that it can’t find “org/apache/ignite/internal/util/typedef/internal/A” and that’s in ignite-core. So, despite putting it somewhere sensible, it doesn’t seem to be able to find ignite-core.jar. Check your environment, make sure it’s in your CLASSPATH.
> On 15 May 2021, at 10:20, shubhamshirur <sh...@gmail.com> wrote:
>
> I am trying to replicate data from Kafka topic to apache ignite cluster. I
> have added ignite-core.jar along with all other required files in plugins
> and it's loaded in connector as per the logs. Still I'm facing this error.
> Any suggestions would be helpful. Thank you.
>
>
>
> INFO Instantiated connector string-ignite-connector with version 6.1.1-ccs
> of type class org.apache.ignite.stream.kafka.connect.IgniteSinkConnector
> (org.apache.kafka.connect.runtime.Worker:284)
> [2021-05-15 08:52:43,717] INFO Finished creating connector
> string-ignite-connector (org.apache.kafka.connect.runtime.Worker:310)
> [2021-05-15 08:52:43,719] ERROR WorkerConnector{id=string-ignite-connector}
> Error while starting connector
> (org.apache.kafka.connect.runtime.WorkerConnector:193)
> java.lang.NoClassDefFoundError:
> org/apache/ignite/internal/util/typedef/internal/A
> at
> org.apache.ignite.stream.kafka.connect.IgniteSinkConnector.start(IgniteSinkConnector.java:55)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:185)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:210)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:349)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:332)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doRun(WorkerConnector.java:140)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.run(WorkerConnector.java:117)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.ignite.internal.util.typedef.internal.A
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at
> org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 12 more
> [2021-05-15 08:52:43,723] ERROR Failed to create job for
> myconfig/ignite-connector.properties
> (org.apache.kafka.connect.cli.ConnectStandalone:110)
> [2021-05-15 08:52:43,723] ERROR Stopping after connector error
> (org.apache.kafka.connect.cli.ConnectStandalone:121)
> java.util.concurrent.ExecutionException:
> org.apache.kafka.connect.errors.ConnectException: Failed to transition
> connector string-ignite-connector to state STARTED
> at
> org.apache.kafka.connect.util.ConvertingFutureCallback.result(ConvertingFutureCallback.java:115)
> at
> org.apache.kafka.connect.util.ConvertingFutureCallback.get(ConvertingFutureCallback.java:99)
> at
> org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:118)
> Caused by: org.apache.kafka.connect.errors.ConnectException: Failed to
> transition connector string-ignite-connector to state STARTED
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:335)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doRun(WorkerConnector.java:140)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.run(WorkerConnector.java:117)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/ignite/internal/util/typedef/internal/A
> at
> org.apache.ignite.stream.kafka.connect.IgniteSinkConnector.start(IgniteSinkConnector.java:55)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:185)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:210)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:349)
> at
> org.apache.kafka.connect.runtime.WorkerConnector.doTransitionTo(WorkerConnector.java:332)
> ... 7 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.ignite.internal.util.typedef.internal.A
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at
> org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 12 more
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/