You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Aldrin Piri <al...@gmail.com> on 2019/07/12 12:37:25 UTC
Re: Minifi could not start CaptureChangeMySQL processor
Hi there,
You will need to provide the CDC NAR as part of your MiNiFi installation as
it is not bundled with the default distribution.
With all the great work that went into supporting extensions into registry,
I hope to have some additional tooling to make this process much easier.
On Thu, Jul 11, 2019 at 11:52 PM wanglei2@geekplus.com.cn <
wanglei2@geekplus.com.cn> wrote:
>
> Build a simpe data flow using nifi, create template as xml, transform
> the xml to config.yml using minifi-toolkit-0.5.0/bin/config.sh
> But there's error after start minifi
>
> ERROR [main] o.apache.nifi.controller.FlowController Could not create
> Processor of type org.apache.nifi.cdc.mys
> ql.processors.CaptureChangeMySQL for ID
> b6936ab5-07c5-3670-0000-000000000000; creating "Ghost" implementation
> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> Unable to find bundle for coordinate default:unknown:unversioned
> at
> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:1271)
> at
> org.apache.nifi.controller.FlowController.createProcessor(FlowController.java:1188)
> at
> org.apache.nifi.controller.FlowController.createProcessor(FlowController.java:1157)
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:1214)
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:359)
> at
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1697)
> at
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:84)
> at
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:723)
> at
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:534)
> at org.apache.nifi.minifi.MiNiFiServer.start(MiNiFiServer.java:122)
> at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:148)
> at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:247)
>
> o.apache.nifi.controller.FlowController Unable to start
> GhostProcessor[id=b6936ab5-07c5-3670-0000-000000000000] due to
> java.lang.IllegalStateException: Processor CaptureChangeMySQLLocal is not
> in a valid state due to ['Missing Processor' validated against 'Any
> Property' is invalid because Processor is of type
> org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL, but this is not a
> valid Processor type]
>
>
> I just downloade the minifi-0.5.0-bin.tar.gz, tar -xzvf and minifs.sh
> start
> I think i must have missed something. Some jar that needed?
>
>
>
>
> ------------------------------
> wanglei2@geekplus.com.cn
>
Re: Re: Minifi could not start CaptureChangeMySQL processor
Posted by "wanglei2@geekplus.com.cn" <wa...@geekplus.com.cn>.
I finally got it run by adding some steps.
Add some jars to the lib directory:
mysql-binlog-connector-java-0.11.0.jar
mysql-connector-java-5.1.47.jar
nifi-cdc-api-1.9.2.jar
nifi-cdc-mysql-processors-1.9.2.jar
nifi-distributed-cache-client-service-1.9.2.jar
nifi-distributed-cache-client-service-api-1.9.2.jar
nifi-distributed-cache-protocol-1.9.2.jar
nifi-distributed-cache-server-1.9.2.jar
nifi-ssl-context-service-api-1.9.2.jar
Manually add Map Cache Server to conf.yml if you use MapCacheClientService
- id: b1b0141c-016b-1000-5efe-7e9494b76948
name: Map Cacher Server
type: org.apache.nifi.distributed.cache.server.map.DistributedMapCacheServer
Properties:
Port: 4557
Maximum Cache Entries: 10000
Eviction Strategy: "Least Frequently Used"
wanglei2@geekplus.com.cn
From: Aldrin Piri
Date: 2019-07-12 20:37
To: users
Subject: Re: Minifi could not start CaptureChangeMySQL processor
Hi there,
You will need to provide the CDC NAR as part of your MiNiFi installation as it is not bundled with the default distribution.
With all the great work that went into supporting extensions into registry, I hope to have some additional tooling to make this process much easier.
On Thu, Jul 11, 2019 at 11:52 PM wanglei2@geekplus.com.cn <wa...@geekplus.com.cn> wrote:
Build a simpe data flow using nifi, create template as xml, transform the xml to config.yml using minifi-toolkit-0.5.0/bin/config.sh
But there's error after start minifi
ERROR [main] o.apache.nifi.controller.FlowController Could not create Processor of type org.apache.nifi.cdc.mys
ql.processors.CaptureChangeMySQL for ID b6936ab5-07c5-3670-0000-000000000000; creating "Ghost" implementation
org.apache.nifi.controller.exception.ProcessorInstantiationException: Unable to find bundle for coordinate default:unknown:unversioned
at org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:1271)
at org.apache.nifi.controller.FlowController.createProcessor(FlowController.java:1188)
at org.apache.nifi.controller.FlowController.createProcessor(FlowController.java:1157)
at org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:1214)
at org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:359)
at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1697)
at org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:84)
at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:723)
at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:534)
at org.apache.nifi.minifi.MiNiFiServer.start(MiNiFiServer.java:122)
at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:148)
at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:247)
o.apache.nifi.controller.FlowController Unable to start GhostProcessor[id=b6936ab5-07c5-3670-0000-000000000000] due to java.lang.IllegalStateException: Processor CaptureChangeMySQLLocal is not in a valid state due to ['Missing Processor' validated against 'Any Property' is invalid because Processor is of type org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL, but this is not a valid Processor type]
I just downloade the minifi-0.5.0-bin.tar.gz, tar -xzvf and minifs.sh start
I think i must have missed something. Some jar that needed?
wanglei2@geekplus.com.cn