You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by DC Gong <gg...@gmail.com> on 2019/12/24 07:39:16 UTC

CaptureChangeMySQL Error.

Hello,

I want to use a CaptureChangeMySQL processor.

The properties settings are set, but the error below occurs.
I think it's a ZOOKEEPER error, but I don't know what the problem is.

Can you tell me what settings to look at?

My setting is below.

MySQL Hosts : localhost:3306
MySQL Driver Class Name : com.mysql.jdbc.Driver
MySQL Driver Location(s) : /home/test/mysql-connector-java-8.0.18.jar
Username : test
Password: test
Server ID : 1
Database/Schema Name Pattern : testdb
Table Name Pattern : test_table
OTHERS : default.

Please reply.

Best Regards ggong.

Re: CaptureChangeMySQL Error.

Posted by DC Gong <gg...@gmail.com>.
Thank you very much Shawn.

I followed your advice and it was settled.

Have a nice day. :)

Thanks
DC Gong

2019년 12월 25일 (수) 오후 11:24, Shawn Weeks <sw...@weeksconsulting.us>님이 작성:

> That means you haven’t setup state management usually. Are you running a
> cluster or a single node? If it’s a cluster you’ll need to set your
> zookeeper string in the state management config file.
>
> Thanks
> Shawn
>
> Sent from my iPhone
>
> On Dec 24, 2019, at 7:05 AM, DC Gong <gg...@gmail.com> wrote:
>
> 
> Sorry, i was missing it in email posting.
>
> The exception is below.
>
> -----------------------------------------------------------------
>
> 2019-12-24 11:10:31,830 ERROR [Timer-Driven Process Thread-6]
> o.a.n.c.m.processors.CaptureChangeMySQL
> CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4]
> CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4] failed to
> process session due to java.lang.IllegalArgumentException: A HostProvider
> may not be empty!; Processor Administratively Yielded for 1 sec:
> java.lang.IllegalArgumentException: A HostProvider may not be empty!
> java.lang.IllegalArgumentException: A HostProvider may not be empty!
>         at
> org.apache.zookeeper.client.StaticHostProvider.init(StaticHostProvider.java:136)
>         at
> org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:87)
>         at
> org.apache.zookeeper.ZooKeeper.createDefaultHostProvider(ZooKeeper.java:1312)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:951)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:688)
>         at
> org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getZooKeeper(ZooKeeperStateProvider.java:170)
>         at
> org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getState(ZooKeeperStateProvider.java:403)
>         at
> org.apache.nifi.controller.state.manager.StandardStateManagerProvider$1.getState(StandardStateManagerProvider.java:305)
>         at
> org.apache.nifi.controller.state.StandardStateManager.getState(StandardStateManager.java:63)
>         at
> org.apache.nifi.controller.lifecycle.TaskTerminationAwareStateManager.getState(TaskTerminationAwareStateManager.java:52)
>         at
> org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.setup(CaptureChangeMySQL.java:435)
>         at
> org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.onTrigger(CaptureChangeMySQL.java:544)
>         at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1176)
>         at
> org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213)
>         at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
>         at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> ------------------------------------------------------------
>
>
> Thanks.
>
>
>
>
> 2019년 12월 24일 (화) 오후 9:59, Shawn Weeks <sw...@weeksconsulting.us>님이 작성:
>
>> What the exception your seeing?
>>
>>
>>
>> Thanks
>>
>> Shawn
>>
>>
>>
>> *From: *DC Gong <gg...@gmail.com>
>> *Reply-To: *"users@nifi.apache.org" <us...@nifi.apache.org>
>> *Date: *Tuesday, December 24, 2019 at 1:39 AM
>> *To: *"users@nifi.apache.org" <us...@nifi.apache.org>
>> *Subject: *CaptureChangeMySQL Error.
>>
>>
>>
>> Hello,
>>
>>
>>
>> I want to use a CaptureChangeMySQL processor.
>>
>>
>>
>> The properties settings are set, but the error below occurs.
>> I think it's a ZOOKEEPER error, but I don't know what the problem is.
>>
>> Can you tell me what settings to look at?
>>
>>
>>
>> My setting is below.
>>
>>
>>
>> MySQL Hosts : localhost:3306
>>
>> MySQL Driver Class Name : com.mysql.jdbc.Driver
>>
>> MySQL Driver Location(s) : /home/test/mysql-connector-java-8.0.18.jar
>>
>> Username : test
>>
>> Password: test
>>
>> Server ID : 1
>>
>> Database/Schema Name Pattern : testdb
>>
>> Table Name Pattern : test_table
>>
>> OTHERS : default.
>>
>>
>>
>> Please reply.
>>
>>
>>
>> Best Regards ggong.
>>
>>
>>
>

Re: CaptureChangeMySQL Error.

Posted by Shawn Weeks <sw...@weeksconsulting.us>.
That means you haven’t setup state management usually. Are you running a cluster or a single node? If it’s a cluster you’ll need to set your zookeeper string in the state management config file.

Thanks
Shawn

Sent from my iPhone

On Dec 24, 2019, at 7:05 AM, DC Gong <gg...@gmail.com> wrote:


Sorry, i was missing it in email posting.

The exception is below.

-----------------------------------------------------------------

2019-12-24 11:10:31,830 ERROR [Timer-Driven Process Thread-6] o.a.n.c.m.processors.CaptureChangeMySQL CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4] CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4] failed to process session due to java.lang.IllegalArgumentException: A HostProvider may not be empty!; Processor Administratively Yielded for 1 sec: java.lang.IllegalArgumentException: A HostProvider may not be empty!
java.lang.IllegalArgumentException: A HostProvider may not be empty!
        at org.apache.zookeeper.client.StaticHostProvider.init(StaticHostProvider.java:136)
        at org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:87)
        at org.apache.zookeeper.ZooKeeper.createDefaultHostProvider(ZooKeeper.java:1312)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:951)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:688)
        at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getZooKeeper(ZooKeeperStateProvider.java:170)
        at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getState(ZooKeeperStateProvider.java:403)
        at org.apache.nifi.controller.state.manager.StandardStateManagerProvider$1.getState(StandardStateManagerProvider.java:305)
        at org.apache.nifi.controller.state.StandardStateManager.getState(StandardStateManager.java:63)
        at org.apache.nifi.controller.lifecycle.TaskTerminationAwareStateManager.getState(TaskTerminationAwareStateManager.java:52)
        at org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.setup(CaptureChangeMySQL.java:435)
        at org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.onTrigger(CaptureChangeMySQL.java:544)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1176)
        at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
        at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

------------------------------------------------------------


Thanks.




2019년 12월 24일 (화) 오후 9:59, Shawn Weeks <sw...@weeksconsulting.us>>님이 작성:
What the exception your seeing?

Thanks
Shawn

From: DC Gong <gg...@gmail.com>>
Reply-To: "users@nifi.apache.org<ma...@nifi.apache.org>" <us...@nifi.apache.org>>
Date: Tuesday, December 24, 2019 at 1:39 AM
To: "users@nifi.apache.org<ma...@nifi.apache.org>" <us...@nifi.apache.org>>
Subject: CaptureChangeMySQL Error.

Hello,

I want to use a CaptureChangeMySQL processor.

The properties settings are set, but the error below occurs.
I think it's a ZOOKEEPER error, but I don't know what the problem is.
Can you tell me what settings to look at?

My setting is below.

MySQL Hosts : localhost:3306
MySQL Driver Class Name : com.mysql.jdbc.Driver
MySQL Driver Location(s) : /home/test/mysql-connector-java-8.0.18.jar
Username : test
Password: test
Server ID : 1
Database/Schema Name Pattern : testdb
Table Name Pattern : test_table
OTHERS : default.

Please reply.

Best Regards ggong.

Re: CaptureChangeMySQL Error.

Posted by DC Gong <gg...@gmail.com>.
Sorry, i was missing it in email posting.

The exception is below.

-----------------------------------------------------------------

2019-12-24 11:10:31,830 ERROR [Timer-Driven Process Thread-6]
o.a.n.c.m.processors.CaptureChangeMySQL
CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4]
CaptureChangeMySQL[id=f0e81363-d438-157a-ffff-ffffd1676ca4] failed to
process session due to java.lang.IllegalArgumentException: A HostProvider
may not be empty!; Processor Administratively Yielded for 1 sec:
java.lang.IllegalArgumentException: A HostProvider may not be empty!
java.lang.IllegalArgumentException: A HostProvider may not be empty!
        at
org.apache.zookeeper.client.StaticHostProvider.init(StaticHostProvider.java:136)
        at
org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:87)
        at
org.apache.zookeeper.ZooKeeper.createDefaultHostProvider(ZooKeeper.java:1312)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:951)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:688)
        at
org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getZooKeeper(ZooKeeperStateProvider.java:170)
        at
org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.getState(ZooKeeperStateProvider.java:403)
        at
org.apache.nifi.controller.state.manager.StandardStateManagerProvider$1.getState(StandardStateManagerProvider.java:305)
        at
org.apache.nifi.controller.state.StandardStateManager.getState(StandardStateManager.java:63)
        at
org.apache.nifi.controller.lifecycle.TaskTerminationAwareStateManager.getState(TaskTerminationAwareStateManager.java:52)
        at
org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.setup(CaptureChangeMySQL.java:435)
        at
org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.onTrigger(CaptureChangeMySQL.java:544)
        at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1176)
        at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213)
        at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
        at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

------------------------------------------------------------


Thanks.




2019년 12월 24일 (화) 오후 9:59, Shawn Weeks <sw...@weeksconsulting.us>님이 작성:

> What the exception your seeing?
>
>
>
> Thanks
>
> Shawn
>
>
>
> *From: *DC Gong <gg...@gmail.com>
> *Reply-To: *"users@nifi.apache.org" <us...@nifi.apache.org>
> *Date: *Tuesday, December 24, 2019 at 1:39 AM
> *To: *"users@nifi.apache.org" <us...@nifi.apache.org>
> *Subject: *CaptureChangeMySQL Error.
>
>
>
> Hello,
>
>
>
> I want to use a CaptureChangeMySQL processor.
>
>
>
> The properties settings are set, but the error below occurs.
> I think it's a ZOOKEEPER error, but I don't know what the problem is.
>
> Can you tell me what settings to look at?
>
>
>
> My setting is below.
>
>
>
> MySQL Hosts : localhost:3306
>
> MySQL Driver Class Name : com.mysql.jdbc.Driver
>
> MySQL Driver Location(s) : /home/test/mysql-connector-java-8.0.18.jar
>
> Username : test
>
> Password: test
>
> Server ID : 1
>
> Database/Schema Name Pattern : testdb
>
> Table Name Pattern : test_table
>
> OTHERS : default.
>
>
>
> Please reply.
>
>
>
> Best Regards ggong.
>
>
>

Re: CaptureChangeMySQL Error.

Posted by Shawn Weeks <sw...@weeksconsulting.us>.
What the exception your seeing?

Thanks
Shawn

From: DC Gong <gg...@gmail.com>
Reply-To: "users@nifi.apache.org" <us...@nifi.apache.org>
Date: Tuesday, December 24, 2019 at 1:39 AM
To: "users@nifi.apache.org" <us...@nifi.apache.org>
Subject: CaptureChangeMySQL Error.

Hello,

I want to use a CaptureChangeMySQL processor.

The properties settings are set, but the error below occurs.
I think it's a ZOOKEEPER error, but I don't know what the problem is.
Can you tell me what settings to look at?

My setting is below.

MySQL Hosts : localhost:3306
MySQL Driver Class Name : com.mysql.jdbc.Driver
MySQL Driver Location(s) : /home/test/mysql-connector-java-8.0.18.jar
Username : test
Password: test
Server ID : 1
Database/Schema Name Pattern : testdb
Table Name Pattern : test_table
OTHERS : default.

Please reply.

Best Regards ggong.